harmful content
European Commission advises TikTok to redesign FYP or risk fines
Say More Look Up Mashable's Best: E-readers, robovacs, laptops, earbuds, smart home and more Mashable Selects Trending Now Gift Ideas For Everyone On Your List Safety Net Mashable @Home In My Bag Versus Creator Playbook Getting Technical with Mashable All Series TikTok rabbit holes may violate EU law. Chase joined Mashable's Social Good team in 2020, covering online stories about digital activism, climate justice, accessibility, and media representation. TikTok failed to prevent harmful content rabbit holes, EU regulators find. European regulators warn TikTok's rabbit hole-inducing FYP might be breaking EU law. Preliminary findings from an investigation by the European Commission accuse the social media giant of failing to mitigate the potential mental health risks of its personalized algorithmic feed in violation of the Digital Services Act.
Apple will monitor your public iCloud links now, starting with iOS 27.3
Our gifting experts are obsessively searching for holiday gifts that are unique, thoughtful and suitable for any budget. Apple will monitor your public iCloud links now, starting with iOS 27.3 Under Apple's new policy, the company will scan publicly shared iCloud links for harmful content - and possibly ban violators. Taylor Clemons is a tech writer and reviewer based near Cleveland, OH. Starting with iOS 27.3, Apple will monitor public links shared via iCloud.
San Francisco Demands Apple and Google Delete AI 'Nudify' Apps From App Stores
The City Attorney's Office sent the tech giants cease-and-desist letters this week telling them to stop profiting from 13 "face-swap" apps that are overwhelmingly used to target women and girls. Apple and Google have been ordered to take down apps that can "nudify" or "undress" people and told that they must stop profiting from the harmful technology, according to cease-and-desist letters sent to the companies seen by WIRED. On Thursday, San Francisco city attorney David Chiu sent legal notices to Apple and Google demanding that they remove from their app stores 13 face-swapping apps, which allow users to create AI-generated nonconsensual nude images. The letters say the Silicon Valley giants should stop "aiding and abetting" the sale of explicit deepfake images and "sever" business relationships with the app developers. "Generating non-consensual intimate images is illegal, harmful, and completely unacceptable," Chiu tells WIRED.
Safety Pretraining: Toward the Next Generation of Safe AI
As large language models (LLMs) are increasingly deployed in high-stakes settings, the risk of generating harmful or toxic content remains a central challenge. Post-hoc alignment methods are brittle: once unsafe patterns are learned during pretraining, they are hard to remove. In this work, we present a data-centric pretraining framework that builds safety into the model from the start. Our framework consists of four key steps: (i) Safety Filtering: building a safety classifier to classify webdata into safe and unsafe categories; (ii) Safety Rephrasing: we recontextualize unsafe webdata into safer narratives; (iii) Native Refusal: we synthetically generate pretraining datasets that actively teach models to refuse on unsafe content and the moral reasoning behind it, and (iv) Harmfulness-Tag annotated pretraining: we flag unsafe content during pretraining using a special token, and use it to steer models away from unsafe generations at inference-time. Our safety-pretrained models reduce attack success rates from 38.8% to 8.4% on standard LLM safety benchmarks with no performance degradation on general tasks.
Bileve: Securing Text Provenance in Large Language Models Against Spoofing with Bi-level Signature
Text watermarks for large language models (LLMs) have been commonly used to identify the origins of machine-generated content, which is promising for assessing liability when combating deepfake or harmful content. While existing watermarking techniques typically prioritize robustness against removal attacks, unfortunately, they are vulnerable to spoofing attacks: malicious actors can subtly alter the meanings of LLM-generated responses or even forge harmful content, potentially misattributing blame to the LLM developer. To overcome this, we introduce a bi-level signature scheme, Bileve, which embeds fine-grained signature bits for integrity checks (mitigating spoofing attacks) as well as a coarse-grained signal to trace text sources when the signature is invalid (enhancing detectability) via a novel rank-based sampling strategy. Compared to conventional watermark detectors that only output binary results, Bileve can differentiate 5 scenarios during detection, reliably tracing text provenance and regulating LLMs. The experiments conducted on OPT-1.3B and LLaMA-7B demonstrate the effectiveness of Bileve in defeating spoofing attacks with enhanced detectability.
Who's asking? User personas and the mechanics of latent misalignment
Studies show that safety-tuned models may nevertheless divulge harmful information. In this work, we show that whether they do so depends significantly on who they are talking to, which we refer to as . In fact, we find manipulating user persona to be more effective for eliciting harmful content than certain more direct attempts to control model refusal. We study both natural language prompting and activation steering as intervention methods and show that activation steering is significantly more effective at bypassing safety filters.We shed light on the mechanics of this phenomenon by showing that even when model generations are safe, harmful content can persist in hidden representations and can be extracted by decoding from earlier layers. We also show we can predict a persona's effect on refusal given only the geometry of its steering vector. Finally, we show that certain user personas induce the model to form more charitable interpretations of otherwise dangerous queries.
Online gaming escaped Australia's social media ban - but critics say it's just as addictive
Online gaming escaped Australia's social media ban - but critics say it's just as addictive Wednesday afternoons have become a ritual for 15-year-old Sadmir Perviz. It's a circuitous route from home in Perth to the Fiona Stanley Hospital - but it's worth it, he says, to sit down for a game of Dungeons & Dragons with people he may not know but with whom he shares a great deal in common. Sadmir and his board game companions are just some of the 300 patients at the gaming disorder clinic, Australia's only publicly-run institution of its type, helping patients wean themselves off excessive online gaming habits. The room where they meet is a simple space in a faceless hospital but in the corner, there's a pile of boardgames on a chair. Jenga, Uno and Sushi Go are also popular choices at the informal group which is attended by both patients and clinicians.