Government Documents Show Police Disabling AI Oversight Tools

Once best known for developing the Taser, Axon has transformed into a 50 billion military and law enforcement tech giant.Mother Jones illustration; Michael Nigro/Pacific Press/Zuma; Arthur Ogleznev/Unsplash; Logan Weaver/Unsplash In April 2024, the American police tech firm Axon, which leads the market for police body cameras, released a tool it billed as "revolutionary": Draft One, an AI-powered software package that would turn body camera footage and audio into intelligible police reports. Once best known for developing the Taser, Axon has transformed into a 50 billion military and law enforcement tech giant, providing more than 5,000 police departments across the country with a suite of cloud-based products to manage evidence collection and storage. Draft One, the AI tool, connects with the company's body cameras and evidence storage service to write police reports with little human intervention. At least 21 departments have experimented with the software. The use of artificial intelligence in generating police reports has been particularly troubling, according to civil rights advocacy groups like the Electronic Frontier Foundation and ACLU, because of generative AI's propensity towards racial and gender bias, and its tendency to insert inaccuracies into texts--including wholesale inventions known by technologists as "hallucinations." "I can almost guarantee [AI] reports have been used in plea deals," a police captain wrote.