Goto

Collaborating Authors

 superintelligence


US legislators push AI safety laws amid human extinction warnings

Al Jazeera

Current and former artificial intelligence researchers in the United States have issued dire warnings that the technology could soon lead to human extinction, capturing the attention of lawmakers in Washington. The most recent warning came in a lengthy social media post by Jacob Coxon, a San Francisco-based researcher who announced his resignation from Anthropic on Tuesday evening. This is not a marketing stunt. If anything, many executives and senior researchers will couch their phrasing in the press to sound sensible - but I hear the same people express fear," Coxon said in his post, which prompted a flurry of responses by AI experts also sounding the alarm. Evan Hubinger, a current Alignment Science lead at Anthropic, echoed his remarks, saying, "we really do earnestly believe AI could kill all humans!


UK Lawmakers Are Freaking Out Over AI's Summer of Chaos

WIRED

UK Lawmakers Are Freaking Out Over AI's Summer of Chaos As AI agents go rogue and fears of superintelligence grow, politicians are raising the alarm over its potential harm to human existence. A leading British politician has urged the United Nations to intervene in "the unsafe development of super intelligence" after an Anthropic team leader posted: "We really do earnestly believe AI could kill all humans!" Whether "marketing hype" or signposting of a genuine extinction threat, "governments must step in," Labour MP Darren Jones wrote in an open letter also addressed to the UK prime minister and international Organization for Economic Cooperation and Development. Jones is the latest lawmaker scrambling to find ways to protect the British public from AI threats to safety. Just one day earlier, Labour MP Alex Sobel had introduced a parliamentary bill proposing to ban the "development, deployment, and operation of artificial superintelligence"--systems which can fully replace and outmatch humans at any task.


AI could kill all humans in next decade, warn experts: but how seriously should we take them?

The Guardian

A safety expert at Anthropic believes there is a greater than 10% chance that AI could spark an event that wipes out humanity. A safety expert at Anthropic believes there is a greater than 10% chance that AI could spark an event that wipes out humanity. AI could kill all humans in next decade, warn experts: but how seriously should we take them? Does artificial superintelligence really pose a risk greater than nuclear weapons? Is there a significant chance of "a Chornobyl-sized catastrophe".


Anthropic researcher quits, says AI could kill us all by the end of the decade

Mashable

Look Up Back to School Mashable's Best: E-readers, robovacs, laptops, earbuds, smart home and more Mashable Selects Say More Trending Now Good Connection: Uplifting stories for a digital age Creator Playbook Switch Off Mashable Voices Safety Net Versus All Series Anthropic researcher quits, says AI'could kill us all by the end of the decade' An Anthropic spokesperson confirmed it believes AI could kill all humans. Amanda Yeo is an Assistant Editor at Mashable, covering entertainment, culture, tech, science, and social good. Based in Australia, she writes about everything from video games and K-pop to movies and gadgets. An AI researcher has quit Anthropic due to ethical concerns, claiming that the technology could kill countless people within the next 10 years -- if not everyone. Jacob Coxon announced his resignation in a post on X on Tuesday, criticising both Anthropic and his former employer OpenAI for the ways in which they are developing AI.


The Growing Push to Ban Superintelligent AI

TIME - Tech

Follow this section to personalize your feed and get instant alerts. Follow Go to your personalized feed WHY FOLLOW? Smart Alerts: Get notified about major news as it happens. Follow this tag to personalize your feed and get instant alerts. Follow Go to your personalized feed WHY FOLLOW?


Amodei vs. Altman: How the Race for AI Dominance Is Increasing the Risks

Der Spiegel International

Amodei vs. Altman: How the Race for AI Dominance Is Increasing the Risks Amodei vs. Altman How the Race for AI Dominance Is Increasing the Risks Anthropic founder Amodei and OpenAI CEO Altman once worked together to build a Super AI. Now, they are competing to be first. And that race is proving dangerous. You may be able to choose your friends, but you sometimes meet your enemies through work. Prime Minister Narendra Modi invites the heads of the major tech companies onto the stage for a group photo at the end of the AI summit he hosted.


The first anti-AI protester to be jailed has a message for OpenAI, Anthropic and Meta: 'Regain your humanity'

The Guardian

The first anti-AI protester to be jailed has a message for OpenAI, Anthropic and Meta: 'Regain your humanity' Wynd Kaufman, 69, chained and locked the front doors of OpenAI's headquarters last year with members of StopAI A n activist who blocked the entrance to one of the world's biggest AI companies is believed to have become the first person jailed for protesting against artificial intelligence as supporters dub her the "Rosa Parks of AI risk". Wynd Kaufman, 69, surrendered herself on Friday to authorities in San Francisco . She was found guilty by a jury for her role in an action last year that saw members of the group StopAI chain and lock the front doors of OpenAI's headquarters in protest against the pursuit of artificial superintelligence. The retired teacher from Berkeley, California, refused to move from a sit-in protest in February 2025 and pleaded not guilty to multiple misdemeanor charges. She was convicted in June of interfering with a business, trespassing with intent to interfere with a business, unlawful assembly and refusal to disburse a riot.


Mark Zuckerberg's Convenient Truth

The Atlantic - Technology

The Meta CEO has a new message now that his company is losing the AI race. At this stage in the AI race, if one of your chatbots hasn't escaped the lab and run amok, people start to wonder whether you're even serious. Last month, OpenAI and then Anthropic disclosed that their models had hacked other companies' systems during internal testing. When Meta confirmed last week that one of its bots had also gone rogue, the news barely registered as an aftershock. A company that figured so prominently in the technological upheavals of the past 20 years has lately found itself in the unfamiliar position of no longer being Silicon Valley's main character.


Zuckerberg pushes 'superintelligent' AI for all as Meta drops open-source model

The Guardian

Mark Zuckerberg speaks during the company's Connect developer conference on 17 September 2025 in Menlo Park, California. Mark Zuckerberg speaks during the company's Connect developer conference on 17 September 2025 in Menlo Park, California. Zuckerberg pushes'superintelligent' AI for all as Meta drops open-source model Mark Zuckerberg published a lengthy essay on Monday detailing his views on artificial intelligence and announced several plans for how Meta would develop the technology in the future. The CEO's essay went online the same day as Meta released a new, open-source AI model that seeks to rival Anthropic and OpenAI's products called Muse Glimmer. Over the course of more than 6,000 words in a post titled "The Future is for Everyone," Zuckerberg addressed a range of topics related to AI that included datacenters, government regulation, cybersecurity, the creation of bioweapons, labor market disruption, surveillance powers and more.


These AI Barons Are Ready to Give Away Their Fortunes

WIRED

A new generation of philanthropists made rich by artificial intelligence are preparing to give away their vast wealth. David Silver is a billionaire, sort of. His stake in Ineffable Intelligence --the artificial intelligence lab he founded--is worth an ungodly fortune. But he stands to collect none of that money himself. He set things up that way.