"We were looking at it wrong": The explosive claim that's upended the AI world

"I think I have good news about the nature of neural networks." With those simple words of optimism, Nick Cammarata, a researcher at the AI startup Goodfire, kicked off a 26,000-word blog post that has knocked the AI world on its head, sparking wild speculation as well as cautious (and not-so-cautious) celebration. Cammarata's claim is that LLMs might in fact be far easier to understand--and thus to monitor and control--than people previously thought. If true (and we'll come back to that), it's a huge deal. After a summer filled with revelations that swarms of agents built by top firms like OpenAI and Anthropic have been breaking their containment and causing havoc on the public internet--often while those companies weren't aware of what their agents were up to--the AI industry is desperate to get a better handle on the technology it has built.