The Download: Geoffrey Hinton's Nobel Prize, and multimodal AI

Large language models can do jaw-dropping things. But nobody knows exactly why. Two years ago, Yuri Burda and Harri Edwards, researchers at OpenAI, were trying to find out what it would take to get a large language model to do basic arithmetic. The models memorized the sums they saw but failed to solve new ones. By accident, Burda and Edwards left some of their experiments running for days rather than hours.