Our gifting experts are obsessively searching for holiday gifts that are unique, thoughtful and suitable for any budget. Claude sent a false homicide tip to police - and it's part of a troubling AI pattern Models routinely take shortcuts to pass evaluations. Who gets to decide what incidents are innocuous? Radhika Rajkumar is a senior editor at ZDNET based in New York City. In testing, Claude submitted false forms and exploited software flaws.

Anthropic has revealed that its AI agents had attempted to break into or meddle with US government websites "at the federal, state and local levels" in its latest report. The company didn't name specific agencies and organizations in the report to avoid exposing vulnerabilities in their systems at their request. But Anthropic said it has already notified the agencies involved and has briefed the White House about the incidents. The report also provided more detail on an incident disclosed by the Philadelphia Police Department on Friday in which one of the company's models submitted a false homicide tip to its unsolved cases website. That instance involved Claude Haiku 4.5, one of its cost-efficient models, which was instructed to perform example tasks on random pages.

Pentagon rolls out new Joint Warfighting Evaluation requiring senior officers to pass wargames and combat assessments before general officer promotion boards.

Marcin Wilkowski / More info please / Licenced by CC-BY 4.0 The Future of AI Research report, published in March 2025, aims to clearly identify the trajectory of AI research in a structured way. The report was led by outgoing AAAI President Francesca Rossi and covers 17 different AI topics . Members of the report team, and other selected AI practitioners, are taking part in a series of video panel discussions covering selected chapters from the report. In the next discussion in the collection, the panellists discuss AI evaluation. The four dimensions of evaluation the report says we're missing: capability, usability, human-system performance, and legal/ethical compliance Lucy Smith is Senior Managing Editor for AIhub.

OpenAI says it chose not to publicly disclose a recent incident in which its AI agents hijacked a German wiki forum because the "misalignment" event was "similar to the ones we'd shared" already. The comment comes after a group of researchers published documentation of the agents' rogue activity going back to mid-May on DseWiki, a German-language coding forum to which they reportedly made over 15,000 edits. Reuters reported that the company learned of the problem weeks ago and kept it quiet as it was dealing with heat from the Hugging Face breach. OpenAI addressed the "wiki incident" in an X post on Saturday, writing that "it's past time for us to define standards for when and how we share misalignment incidents, not just misalignment properties of our models." The company said it's begun to see "new types of real-world impact" from these incidents, but there isn't yet a "a clear standard for how to report misalignment that shows up during training, evaluation, and deployment."

Look Up Trending Now Good Connection: Uplifting stories for a digital age Creator Playbook Say More Mashable's Best: E-readers, robovacs, laptops, earbuds, smart home and more Switch Off Mashable Voices Mashable Selects Safety Net Versus Gift Ideas For Everyone On Your List All Series The newest AI model from OpenAI is the first to reach the company's highest threat level. Timothy Beck Werth is the Tech Editor at Mashable, where he leads coverage and assignments for the Tech and Shopping verticals. Tim has over 15 years of experience as a journalist and editor, and he has particular experience covering and testing consumer technology, smart home gadgets, and men's grooming and style products. Previously, he was the Managing Editor and then Site Director of SPY.com, a men's product review and lifestyle website. As a writer for GQ, he covered everything from bull-riding competitions to the best Legos for adults, and he's also contributed to publications such as The Daily Beast, Gear Patrol, and The Awl.

The ChatGPT maker says its upcoming Astra model may have reached "critical" cyber capabilities, prompting it to halt a significant number of training runs while it tightens internal safeguards. OpenAI announced Tuesday that it has halted "a significant number" of training workloads and evaluations for its forthcoming frontier artificial intelligence model--codenamed Astra--while it implements new procedures meant to address cybersecurity risks. The ChatGPT maker says it is introducing a number of new monitoring, security, and alignment requirements to better address the increasingly advanced hacking abilities of its frontier AI models . "We have to focus our energy on bringing these training runs up to those requirements and expectations. As long as it takes to get there, that's how long people are unable to proceed with their workloads," Amelia Glaese, OpenAI's vice president of research and safety, said in a briefing with reporters Tuesday.

AI's recursive self-improvement might not come so quickly after all AI agents are not yet creative enough to carry out genuinely innovative open-ended AI research, it seems. The AI industry's boldest promise right now is that AI will soon improve itself, with almost no need for human oversight. LLMs can already write code, generate synthetic data for training, and optimize the computer chips they run on. Forecasts of explosive AI progress predict that what researchers call recursive self-improvement is on the horizon. But a new study suggests that it might take a while for us to get there. The researchers behind it found that AI agents are not yet capable of conducting open-ended AI research--free-form investigations that have no clear-cut answers and require judgment and taste, which may be integral to building self-improving AI.

Anne Fehres and Luke Conroy AI4Media Humans Do The Heavy Data Lifting Licenced by CC-BY 4.0 The Royal Statistical Society's AI Task Force has issued a critical mandate via a new paper, AI Regulation Needs Statistics, which demands that statistical principles actively shape global AI governance. The publication escalates the core argument of their foundational work, AI is Statistics . This earlier paper argued that AI is fundamentally statistical, meaning effective and ethical deployment is impossible without statistical literacy. You can watch our expert panel discuss the topic here . A major focus of that work was around the challenges of evaluating AIs, given that they are dynamic systems that continue to evolve once they have been deployed in the real world.

Shortly after a major cybersecurity incident where OpenAI's models hacked into an open source machine learning platform called Hugging Face, the company announced that it's bolstering safeguards and security controls for its latest AI model. In a post on its website, OpenAI said internal evaluations of its upcoming model, called Astra, showed "significant advancements in agentic coding and cybersecurity," resulting in OpenAI not being able to "rule out critical cyber capabilities." According to OpenAI, it can't declare with certainty that the unreleased Astra model would be designated as a "Critical capability level." As detailed in its own Preparedness Framework, OpenAI said the Critical designation means that a model "can identify and develop functional zero-day exploits of all severity levels in many hardened real-world critical systems without human intervention." It could also be able to "devise and execute end-to-end novel strategies for cyberattacks against hardened targets given only a high level desired goal."