Anthropic AI model submits false homicide tip to Philadelphia police

Philadelphia police have revealed that Anthropic's artificial intelligence model submitted a false homicide tip to authorities, an incident disclosed separately by the tech company. The Philadelphia Police Department said on Friday that the false submission was made in July through PhillyUnsolvedMurders.com, a public website where people can share information about unsolved killings. Anthropic mentioned the case in a Friday report detailing unsanctioned manipulation of government websites by Claude models. It is the first known instance in which a rogue AI appeared to communicate a false tip to authorities, despite instructions not to create accounts or submit anything destructive. Philadelphia police said the tip "was flagged as spam and was never forwarded to the Real-Time Crime Center for investigative vetting or dissemination".