How This Tool Could Decode AI's Inner Mysteries

The scientists didn't have high expectations when they asked their AI model to complete the poem. "He saw a carrot and had to grab it," they prompted the model. "His hunger was like a starving rabbit," it replied. The rhyming couplet wasn't going to win any poetry awards. But when the scientists at AI company Anthropic inspected the records of the model's neural network, they were surprised by what they found.