The Download: Claude's inner workings and OpenAI's "super app"

MIT Technology Review 

Plus: OpenAI has unveiled its long-awaited super app. The AI firm Anthropic has got the clearest glimpse yet at what's really going on inside large language models as they answer questions or carry out tasks. What they found ranges from the mundane to the unnerving. Researchers at the company built a tool called the Jacobian lens (or J-lens) and used it to uncover a hidden area, which they named the J-space, inside its flagship LLM, Claude. The J-space contains words related to the response a model is working on but may not ultimately produce. If Claude were a person (which it is not), you might say these hidden words reveal what's on its mind before it actually speaks.