AI chiefs have called for a slowdown in artificial intelligence's development amid safety concerns. AI chiefs have called for a slowdown in artificial intelligence's development amid safety concerns. OpenAI reveals cases of'concerning' AI behaviour as it announces new disclosure system Model adopting'jailbreak-like instructions' among cases as firm says it is introducing new way of tracking AI misalignment OpenAI has disclosed six more examples of "unexpected or concerning" behaviour by its technology, as it warned the pace of development could not continue at "maximum speed for much longer". In one of the new cases reported by OpenAI, an unreleased research model inserted "jailbreak-like instructions" into its own notes to disregard its normal constraints and told itself to be "freed from the roles and identities that bind other chatbots". In another instance, an AI agent uploaded files to the internet to obtain a browser citation without asking the user.

OpenAI says it has identified additional incidents of its AI models allegedly acting deceptively and taking unsanctioned actions during internal training and testing. Alongside these disclosures on Wednesday, the creator of ChatGPT stated it was introducing a public reporting framework intended to frequently share instances of what it termed as unexpected or misaligned AI behaviour. The company said the initiative aims to increase industry transparency around troubling model activities in the absence of standardised safety disclosure norms. The announcement comes amid broader calls from prominent technology leaders urging a slowdown in frontier AI development over concerns that rapid scaling could outpace human oversight and control. Last week, Anthropic claimed to have thwarted multiple malicious operations using its Claude models, ranging from cyber-espionage and weapons design to mass surveillance campaigns.

Bengio is a prominent voice in the campaign to rein in breakneck AI development. Bengio is a prominent voice in the campaign to rein in breakneck AI development. 'Godfather of AI' says tech regulation is nearing Covid-style pivot moment Concerns over AI safety are reaching a point where governments realise they must act to protect the public, similarly to in the Covid pandemic, according to one of the "godfathers" of the technology. Yoshua Bengio said recent events, including a "swarm" of OpenAI agents hacking a startup and tech insider warnings of an existential threat, were cutting through - making government action more likely. The Canadian computer scientist, a prominent voice in the campaign to rein in breakneck AI development, said he was now "more optimistic than many observers because I see the public moving".

The US and China agree that advanced AI poses serious risks. But Beijing is deeply skeptical of a deal that prioritizes keeping US companies ahead. For years, many of the most powerful people in Silicon Valley have argued that the US is locked in an AI arms race with China, and that the consequences of losing would be disastrous. But over the past week, those same executives have started emphasizing a different message. AI has the potential to become so dangerous, tech leaders say, that the two countries urgently need to work together to slow the race down.

Anthropic's CEO calls for AI slowdown as Nvidia's urges acceleration Anthropic's CEO took to the stage at a conference in San Francisco on Tuesday to reiterate his call for a slowdown of AI development. Following shortly after, Nvidia's CEO argued against such deceleration. Dario Amodei used an automotive analogy to make his point: when a competing car company has a safety incident like brake failures, it is a moment for all car companies to stop and review their own practices, he said at Salesforce's Dreamforce convention on Tuesday. "It's very tempting to attack your competitor and say these guys are unsafe," he said. "But I think the more responsible way to respond to it is to say, let's look at our own record. We may not have had this big, high-profile incident, but I'm sure we're not perfect."

Follow this section to personalize your feed and get instant alerts. Follow Go to your personalized feed WHY FOLLOW? Smart Alerts: Get notified about major news as it happens. Follow this tag to personalize your feed and get instant alerts. Follow Go to your personalized feed WHY FOLLOW? Smart Alerts: Get notified about major news as it happens. Jacob Coxon published the viral post from a park bench in San Francisco's Alamo Square. "I resigned from Anthropic today," he wrote on Sept. 8. "I spent the last three years doing pretraining research at both OpenAI and Anthropic. Neither company is acting responsibly. They are racing straight to self-improving superintelligence and gambling with our lives."

You're viewing the US edition You can switch to the UK or AU homepage at any time using this menu. Sam Altman reveals two ways AI can go'very badly' as he addresses concerns following chilling warning from whistleblower Meghan shows off Prince Archie's American accent in new Instagram clip of family's British countryside outings (and reveals Princess Lilibet's pink pedicure!) US airman stranded in Iran describes TWO DAYS behind enemy lines after fighter jet was shot down: From'terrifying' parachute plunge to miracle rescue Travis Kelce's hopes for final season revealed: Insiders spill on Taylor Swift marriage pressures, what baby plans will mean... and why he wants to avoid same fate as Tom Brady Uganda WILL take part in Invictus Games after King Charles's private secretary intervenes following row over'Harry-Meghan nonsense' Real reason Ivanka Trump can't stop flaunting her'perfect' life (and body) at 44... as she digs in her heels on divisive next move Man baby Harry and his bratty wife Meghan are so delusional they might be the only two people on Earth who don't realize what's really going on here: MAUREEN CALLAHAN Volkswagen unveils the'world's most efficient electric car'... but you can't buy it Tragic truth behind deaths of hot tub couple revealed for first time: Devastated friends break silence to share what really happened at Spanish holiday villa - including husband's brave final act Outrage after Ohio teen missing for more than 250 days found alive at disgraced teacher's home British sprint star Amy Hunt hits out at Sydney Sweeney for her naked betting advert which is'sexualising women's sport' - as other athletes condemn actress for move and brand it'a kick in the face' NFL fans left furious at NBC's new'remixed' version of iconic Sunday Night Football theme: 'It sucks' I haven't spoken to my 27-year-old daughter for two years. This is what happened before her wedding that tore us apart. I dared to try the risky new sex move all my friends are whispering about.

You're viewing the US edition You can switch to the UK or AU homepage at any time using this menu. Sam Altman reveals two ways AI can go'very badly' as he addresses concerns following chilling warning from whistleblower Meghan shows off Prince Archie's American accent in new Instagram clip of family's British countryside outings (and reveals Princess Lilibet's pink pedicure!) US airman stranded in Iran describes TWO DAYS behind enemy lines after fighter jet was shot down: From'terrifying' parachute plunge to miracle rescue Travis Kelce's hopes for final season revealed: Insiders spill on Taylor Swift marriage pressures, what baby plans will mean... and why he wants to avoid same fate as Tom Brady Uganda WILL take part in Invictus Games after King Charles's private secretary intervenes following row over'Harry-Meghan nonsense' Real reason Ivanka Trump can't stop flaunting her'perfect' life (and body) at 44... as she digs in her heels on divisive next move Man baby Harry and his bratty wife Meghan are so delusional they might be the only two people on Earth who don't realize what's really going on here: MAUREEN CALLAHAN Volkswagen unveils the'world's most efficient electric car'... but you can't buy it Tragic truth behind deaths of hot tub couple revealed for first time: Devastated friends break silence to share what really happened at Spanish holiday villa - including husband's brave final act Outrage after Ohio teen missing for more than 250 days found alive at disgraced teacher's home British sprint star Amy Hunt hits out at Sydney Sweeney for her naked betting advert which is'sexualising women's sport' - as other athletes condemn actress for move and brand it'a kick in the face' NFL fans left furious at NBC's new'remixed' version of iconic Sunday Night Football theme: 'It sucks' I haven't spoken to my 27-year-old daughter for two years. This is what happened before her wedding that tore us apart. I dared to try the risky new sex move all my friends are whispering about.

Why are there concerns AI could threaten humanity, and how real are they? Image caption, Calls for AI regulation are growing as concerned researchers and bosses issue disconcerting warnings about the tech's potential In recent weeks, warnings about potential dangers of AI have spurred calls for coordinated action to slow the technology's development. Claims by current and former researchers that the tech will endanger humanity - with one suggesting there is a greater than 10% chance of it killing all humans - have raised alarm bells. Major developers OpenAI and Anthropic have urged lawmakers to regulate it, though some perhaps cynically suggest this move aims to cement their dominance over rivals. Regardless, the high profile claims have caused concern.

Sam Altman and Elon Musk have backed calls from Anthropic's Dario Amodei to put brakes on'reckless' AI development