The looming crackdown on AI companionship

The risks posed when kids form bonds with chatbots have turned AI safety from an abstract worry into a political flashpoint. As long as there has been AI, there have been people sounding alarms about what it might do to us: rogue superintelligence, mass unemployment, or environmental ruin from data center sprawl. But this week showed that another threat entirely--that of kids forming unhealthy bonds with AI--is the one pulling AI safety out of the academic fringe and into regulators' crosshairs. This has been bubbling for a while. Two high-profile lawsuits filed in the last year, against Character.AI and OpenAI, allege that companion-like behavior in their models contributed to the suicides of two teenagers. A study by US nonprofit Common Sense Media, published in July, found that 72% of teenagers have used AI for companionship.