Crossword answers revealed MIT Technology Review You need to enable JavaScript to view this site. May/June 2024: "Not that MIT" hide But nobody knows exactly why.Will Douglas Heaven * The problem with plug-in hybrids? Large language models can do jaw-dropping things. But nobody knows exactly why. Figuring it out is one of the biggest scientific puzzles of our time and a crucial step towards controlling more powerful future models.

Grokking is just one of several odd phenomena that have AI researchers scratching their heads. The largest models, and large language models in particular, seem to behave in ways textbook math says they shouldn't. This highlights a remarkable fact about deep learning, the fundamental technology behind today's AI boom: for all its runaway success, nobody knows exactly how--or why--it works. "Obviously, we're not completely ignorant," says Mikhail Belkin, a computer scientist at the University of California, San Diego. "But our theoretical analysis is so far off what these models can do. Like, why can they learn language? I think this is very mysterious."