Back to School Mashable's Best: E-readers, robovacs, laptops, earbuds, smart home and more Mashable Selects Say More Look Up Trending Now Good Connection: Uplifting stories for a digital age Creator Playbook Switch Off Mashable Voices Safety Net Versus All Series A surprising ruling on AI CSAM doesn't mean what you think. Rebecca Ruiz is a Senior Reporter at Mashable. She frequently covers mental health, digital culture, and technology. Her areas of expertise include suicide prevention, screen use and mental health, parenting, youth well-being, and meditation and mindfulness. Rebecca's experience prior to Mashable includes working as a staff writer, reporter, and editor at NBC News Digital and as a staff writer at Forbes.

Many of the lawsuits xAI is facing'stem from a period at the start of this year when loose safeguards on Grok allowed users to direct it to remove clothing from photos and generate sexualized images'. Many of the lawsuits xAI is facing'stem from a period at the start of this year when loose safeguards on Grok allowed users to direct it to remove clothing from photos and generate sexualized images'. Child sexual abuse survivor alleges Elon Musk's AI chatbot used photos of her to generate new illegal images Musk denied he was aware Grok ever produced'any naked underage images' A survivor of child sexual abuse has sued Elon Musk's artificial intelligence company, alleging that its chatbot used pictures of her abuse to generate new illegal pornographic images that depict her. "Using real images of Plaintiff and class members, Grok generated child pornography depicting Plaintiff and class members," states the complaint, which was filed last week in a US district court in California. Attorneys for the plaintiff, who is listed as Jane Doe in the case to protect her identity, accuse xAI of both generating CSAM of their client and of ingesting child sexual abuse images depicting her into the company's datasets after new images were publicly posted.

Mashable's Best: E-readers, robovacs, laptops, earbuds, smart home and more Look Up Creator Playbook Mashable Voices Trending Now Say More Mashable Selects Safety Net Versus Gift Ideas For Everyone On Your List Switch Off In My Bag All Series Elon Musk's SpacexAI faces another lawsuit from child sexual abuse survivor A proposed class action case alleges Grok was trained on CSAM. Chase joined Mashable's Social Good team in 2020, covering online stories about digital activism, climate justice, accessibility, and media representation. Victims of Grok's controversial nudify features are taking the company to court. The proposed nationwide class action lawsuit, filed today, alleges that the AI company trained its chatbot on data sets containing child sexual abuse materials (CSAM) featuring real children. SpacexAI did not adequately block explicit content, prevent nonconsensual sexualized deepfakes of real people, and filter abusive material out of their training datasets, the lawsuit claims.

A fourth party is pursuing legal action against xAI, alleging that Grok was used to create child sexual abuse material (CSAM) based on her childhood photos. As first reported by Washington Post, the woman, named as Jane Doe 4 in the lawsuit, said that her stepfather used Grok to create "thousands of sexually explicit images of her as a child and traded them online." According to the the lawsuit, the stepfather created more than 7,000 "fake explicit images of her using the AI chatbot Grok," including converting a photo taken of her when she was 11 into a sexually explicit image. Eventually, state and local law enforcement raided her stepfather's electronic devices for CSAM and two days after, he was found dead by suicide in his car, according to the report. Jane Doe 4 joins three other teenagers, who filed the original lawsuit that alleged that Grok was used to create sexually explicit deepfake images of them.

Amazon discovered a'high volume' of CSAM in its AI training data but isn't saying where it came from The company's reports were inactionable, according to a child safety organization. The National Center for Missing and Exploited Children said it received more than 1 million reports of AI-related child sexual abuse material (CSAM) in 2025. The vast majority of that content was reported by Amazon, which found the material in its training data, according to an investigation by . In addition, Amazon said only that it obtained the inappropriate content from external sources used to train its AI services and claimed it could not provide any further details about where the CSAM came from. This is really an outlier, Fallon McNulty, executive director of NCMEC's CyberTipline, told . The CyberTipline is where many types of US-based companies are legally required to report suspected CSAM.

Elon Musk's Grok AI appears to have made child sexual imagery, says charity The Internet Watch Foundation (IWF) charity says its analysts have discovered criminal imagery of girls aged between 11 and 13 which appears to have been created using Grok. The AI tool is owned by Elon Musk's firm xAI. It can be accessed either through its website and app, or through the social media platform X. The IWF said it found sexualised and topless imagery of girls on a dark web forum in which users claimed they used Grok to create the imagery. The BBC has approached X and xAI for comment.

Grok Is Generating Sexual Content Far More Graphic Than What's on X A WIRED review of outputs hosted on Grok's official website shows it's being used to create violent sexual images and videos, as well as content that includes apparent minors. Elon Musk's Grok chatbot has drawn outrage and calls for investigation after being used to flood X with "undressed" images of women and sexualized images of what appear to be minors. However, that's not the only way people have been using the AI to generate sexualized images. Grok's website and app, which are are separate from X, include sophisticated video generation that is not available on X and is being used to produce extremely graphic, sometimes violent, sexual imagery of adults that is vastly more explicit than images created by Grok on X. It may also have been used to create sexualized videos of apparent minors.

On X, sexual harassment and perhaps even child abuse are the latest memes. Earlier this week, some people on X began replying to photos with a very specific kind of request. "Put her in a bikini," "take her dress off," "spread her legs," and so on, they commanded Grok, the platform's built-in chatbot. Again and again, the bot complied, using photos of real people--celebrities and noncelebrities, including some who appear to be young children--and putting them in bikinis, revealing underwear, or sexual poses. By one estimate, Grok generated one nonconsensual sexual image every minute in a roughly 24-hour stretch.

OpenAI's Child Exploitation Reports Increased Sharply This Year The company made 80 times as many reports to the National Center for Missing & Exploited Children during the first six months of 2025 as it did in the same period a year prior. OpenAI sent 80 times as many child exploitation incident reports to the National Center for Missing & Exploited Children during the first half of 2025 as it did during a similar time period in 2024, according to a recent update from the company. The NCMEC's CyberTipline is a Congressionally authorized clearinghouse for reporting child sexual abuse material (CSAM) and other forms of child exploitation. Companies are required by law to report apparent child exploitation to the CyberTipline. When a company sends a report, NCMEC reviews it and then forwards it to the appropriate law enforcement agency for investigation.

The UK government says it will ban so-called nudification apps as part of efforts to tackle misogyny online. New laws - announced on Thursday as part of a wider strategy to halve violence against women and girls - will make it illegal to create and supply AI tools letting users edit images to seemingly remove someone's clothing. The new offences would build on existing rules around sexually explicit deepfakes and intimate image abuse, the government said. Women and girls deserve to be safe online as well as offline, said Technology Secretary Liz Kendall. We will not stand by while technology is weaponised to abuse, humiliate and exploit them through the creation of non-consensual sexually explicit deepfakes.