Accenture's long list of consulting services is expanding to include evaluating Anthropic's frontier AI models for safety compliance. Anthropic announced the partnership that would allow Accenture to serve as third-party evaluators that will be embedded within the AI giant. The partnership would see both companies invest at least 1 billion each into this joint effort over the next five years. Anthropic's partnership with Accenture is one of the first steps of a plan to slow down the pace of AI development, as proposed by its CEO, Dario Amodei, last week. In Amodei's three-step approach, the proposal called for all "frontier AI" companies to give "ongoing, employee-like access" to embedded third-party evaluators that are tasked with ensuring safety practices and commitments are being followed, reporting incidents and assessing AI model alignment.

CEO of Anthropic Dario Amodei, speaks in India in February. CEO of Anthropic Dario Amodei, speaks in India in February. AI CEOs say they need to slow the pace of development. After apocalyptic warnings about the threats posed by AI, leaders like Sam Altman and Elon Musk backed Anthropic CEO Dario Amodei's calls to'slow the pace' F acing a public uproar over Anthropic researchers' repeated warnings that artificial intelligence could kill all of humanity by 2030, the AI company's CEO Dario Amodei issued a proposal at the weekend to slow down the technology's advancement to ensure public safety. In a rare display of unity, the heads of the largest US artificial intelligence companies all agreed immediately.

Leaders of the world's biggest artificial intelligence platforms said it's time to slow the development pace of their most advanced -- and most lucrative -- models, citing escalating risks of the technology. Anthropic PBC Chief Executive Officer Dario Amodei issued a lengthy blog post Saturday saying his company would implement new safety steps such as third-party evaluators while calling on the industry to support a broader downshift. OpenAI chief Sam Altman quickly pledged to adopt Amodei's suggestion of "independent evaluators with employee-like access," while Elon Musk, who runs xAI Corp., wrote, "Dario is right." In a time of both misinformation and too much information, quality journalism is more crucial than ever. By subscribing, you can help us get the story right.

Dario Amodei said that AI development, if left unchecked, 'could outrun our ability to understand and control' it. Dario Amodei said that AI development, if left unchecked, 'could outrun our ability to understand and control' it. 'We must slow the pace': CEO of Anthropic calls for an AI slowdown The CEO of the artificial intelligence company Anthropic issued a new appeal on Saturday for the AI industry to "slow down" and offered a three-part plan for doing so, saying that his company would "unilaterally" commit to the first of the steps. In a post on social media, Dario Amodei shared a link to an essay titled We Must Pace the Frontier in which he lays out how Anthropic would provide "third-party evaluators with permanent, employee-level access to our systems, so that they can verify adherence to our safety measures, report on incidents, and assess models' alignment during training". The move comes after a former Anthropic researcher warned on Wednesday that AI could precipitate human extinction by 2030.

'If you build something vastly smarter than you, it better be on your side': can we stop AI from deceiving us? We are used to the idea that our fellow humans might intentionally mislead or manipulate us, but the idea that machines can now do the same is deeply unsettling. Researchers are racing to find solutions before it's too late The summer issue of the Long Read magazine is out now. I n November 2023 - a lifetime ago in the field of artificial intelligence - some of the most powerful people in the world descended on Bletchley Park, the wartime codebreaking hub in Buckinghamshire, to talk about AI safety . In attendance were the then US vice-president, Kamala Harris, the AI bosses Sam Altman and Dario Amodei, delegations from 28 countries, two of the three so-called "godfathers" of AI, and Elon Musk. The first iteration of ChatGPT had been released only a year earlier, and there was already plenty of evidence that AI models could be used for ill, from spreading misinformation to generating deepfakes. A presentation at the summit, however, highlighted a different issue: what if the biggest problem wasn't to come from people misusing the technology, but from AI's own behaviour? A UK government official presented an experiment conducted by Apollo Research, a London-based company that had been set up that year to study AI behaviour.

Despite the rapid advancement of LLM-based agents, the reliable evaluation of their safety and security remains a significant challenge. Existing rule-based or LLM-based evaluators often miss dangers in agents' step-by-step actions, overlook subtle meanings, fail to see how small issues compound, and get confused by unclear safety or security rules. To overcome this evaluation crisis, we introduce AgentAuditor, a universal, training-free, memory-augmented reasoning framework that empowers LLM evaluators to emulate human expert evaluators. AgentAuditor constructs an experiential memory by having an LLM adaptively extract structured semantic features (e.g., scenario, risk, behavior) and generate associated chain-of-thought reasoning traces for past interactions. A multi-stage, context-aware retrieval-augmented generation process then dynamically retrieves the most relevant reasoning experiences to guide the LLM evaluator's assessment of new cases. Moreover, we developed ASSEBench, the first benchmark designed to check how well LLM-based evaluators can spot both safety risks and security threats. ASSEBench comprises 2293 meticulously annotated interaction records, covering 15 risk types across 29 application scenarios. A key feature of ASSEBench is its nuanced approach to ambiguous risk situations, employing Strict and Lenient judgment standards. Experiments demonstrate that AgentAuditor not only consistently improves the evaluation performance of LLMs across all benchmarks but also sets a new state-of-the-art in LLM-as-a-judge for agent safety and security, achieving human-level accuracy.

T propose o address a no the vel challenge Agent-as-a-Judge of evaluating framew time-v ork. Our arying method and construct complex s answers, task-specific we judg answer of ten e a frontier g correctness ents based agentic and on a search source tree-structured systems attribution.

This position paper argues for two claims regarding AI testing and evaluation. First, to remain informative about deployment behaviour, evaluations need account for the possibility that AI systems understand their circumstances and reason strategically. Second, game-theoretic analysis can inform evaluation design by formalising and scrutinising the reasoning in evaluation-based safety cases. Drawing on examples from existing AI systems, a review of relevant research, and formal strategic analysis of a stylised evaluation scenario, we present evidence for these claims and motivate several research directions.

Recent advances in enhancing the reasoning ability of Large Language Models (LLMs) have been remarkably successful. LLMs trained with Reinforcement Learning (RL) for reasoning demonstrate strong performance in challenging tasks such as mathematics and coding, even with relatively small model sizes. However, despite these impressive improvements in task accuracy, the assessment of creativity in LLM generations has been largely overlooked in reasoning tasks, in contrast to writing tasks. The lack of research on creativity assessment in reasoning primarily stems from two challenges: (1) the difficulty of defining the range of creativity, and (2) the necessity of human evaluation in the assessment process. To address these challenges, we propose CLAWS, a novel method that defines and classifies mathematical solutions into Typical, Creative, and Hallucinated categories without human evaluation, by leveraging attention weights across prompt sections and output. CLAWS outperforms five existing white-box detection methods--Perplexity, Logit Entropy, Window Entropy, Hidden Score, and Attention Score--on five 7-8B math RL models (DeepSeek, Qwen, Mathstral, OpenMath2, and Oreal). We validate CLAWS on 4,545 math problems collected from 181 math contests (A(J)HSME, AMC, AIME). Our code is available at https://github.com/kkt94/CLAWS.

Realistic 3D indoor scene synthesis is vital for embodied AI and digital content creation. It can be naturally divided into two subtasks: object generation and layout generation. While recent generative models have significantly advanced object-level quality and controllability, layout generation remains challenging due to limited datasets. Existing methods either overfit to these datasets or rely on predefined constraints to optimize numerical layout that sacrifice flexibility. As a result, they fail to generate scenes that are both open-vocabulary and aligned with fine-grained user instructions.