Of all the threats presented by uncontrollable artificial intelligence, scientists say death by plague ranks low. Concerns about an AI-induced apocalypse are reaching a fever pitch, from Silicon Valley to Washington, DC. One of the top theories about how a rogue AI will wipe us out? Earlier this summer, AI CEOs called for new laws to control the manufacturing of synthetic DNA. Then last month, researchers at Stanford University and the Arc Institute showed that AI can design new viral genomes .

In recent weeks, leaders of some of the biggest AI companies have warned that the very tech they are developing is dangerous. Last weekend, Anthropic CEO Dario Amodei argued that AI carries serious risk and that progress should be slowed. OpenAI CEO Sam Altman responded on X: "I agree with Dario that we need to pace the frontier." Those posts came a few days after the AI researcher Jacob Coxon announced that he was leaving a role at Anthropic, charging that neither it nor OpenAI (where he had also worked) was acting responsibly. "The people building AI earnestly believe that it could kill us all by the end of the decade," he posted on X . Another Anthropic employee, Evan Hubinger, publicly agreed with him. "We really do earnestly believe AI could kill all humans!" he responded on X . "I personally think it is >10% within the next decade."

Here's What the AI Apocalypse Could Look Like This week on, we discuss three possible AI doomsday scenarios, AI safety, and the unexpected bipartisan alliance forming against AI. The debate of whether AI can kill us has been everywhere lately, but what would an actual AI catastrophe look like? This week, Brian Barrett, Zoë Schiffer, and Leah Feiger break down three real-world scenarios experts worry the most about--including hacked water supplies, bioweapons, and autonomous robots. We also discuss the highlights of Salesforce's annual conference, where OpenAI's Sam Altman and Anthropic's Dario Amodei defended their positions on AI safety. Plus, Leah tells us how this backlash against AI has become a rare bipartisan flashpoint, to the point that Bernie Sanders and Steve Bannon shared a stage over it this week. Washington Won't Be Regulating AI Anytime Soon Write to us at [email protected] . You can always listen to this week's podcast through the audio player on this page, but if you want to subscribe for free to get every episode, here's how: If you're on an iPhone or iPad, open the app called Podcasts, or just tap this link . And instead of just adding to the pile of hot takes that already exist, we're going to walk you through real specific scenarios to the best of our ability about how AI would actually do this, and why the tech CEOs and politicians cannot seem to agree on the way forward. OK, guys, so the debate about AI safety has officially escaped containment. AI researcher Jacob Coxon resigned from Anthropic and posted on X that, The people building AI earnestly believe that it could kill us all by the end of the decade. Anthropic's CEO Dario Amodei has called for a slowdown .

Should we worry AI will create deadly bioweapons? Artificial intelligence promises to transform biology, allowing us to design better drugs, vaccines and even synthetic organisms for, say, eating waste plastic. But some fear it could also be used for darker purposes, to create bioweapons that wouldn't be detected by conventional methods until it was too late. So, how worried should we be? "AI advances are fuelling breakthroughs in biology and medicine," says Eric Horvitz, chief scientific officer at Microsoft. "With new power comes responsibility for vigilance." His team has published a study looking at whether AI could design proteins that do the same thing as proteins that are known to be dangerous, but are different enough that they wouldn't be recognised as dangerous.

Imagine a world where everything from plastics to concrete is produced from biomass. Personalized cell and gene therapies prevent pandemics and treat previously incurable genetic diseases. Meat is lab-grown; enhanced nutrient grains are climate-resistant. This is what the future could look like in the years ahead. The next big game-changing revolution is in biology.

From The Terminator to The Day After Tomorrow, movies have envisioned just about every possibility for how the world might end. If you're a science fiction movie buff, you might think that some of these apocalyptic scenarios seem a little far-fetched. But hold onto your popcorn, as experts say that some of these disastrous plotlines could actually become a reality. While we don't need to worry about an asteroid wiping us out like in Armageddon, experts warn that a bioweapon leak like 12 Monkeys could really end the world. And if your favourite blockbuster does give us a glimpse at how the world will end, not even Bruce Willis will be able to save us. Apocalypse movies find their inspiration in a number of different disasters, but which are the most realistic. An escaped bioweapon could pose a genuine threat of destroying humanity.

Lawmakers and scientists have warned ChatGPT could help anyone develop deadly bioweapons that would wreck havoc on the world. While studies have suggested it is possible, new research from the chatbot's creator OpenAI claims GPT-4 - the lasted version -provides at most a mild uplift in biological threat creation accuracy. OpenAI conducted a study of 100 human participants who were separated into groups - one used the AI to craft a biotattack and the other just the internet. The study found that'GPT-4 may increase experts' ability to access information about biological threats, particularly for accuracy and completeness of tasks,' according to OpenAI's report. Results showed that the LLM group was able to obtain more information about bioweapons than the internet only group for ideation and acquisition, but more information is needed to accurately identify any potential risks.

A grave warning over the dangers of artificial intelligence (AI) to humans has come from Prime Minister Rishi Sunak today. While acknowledging the positive potential of the technology in areas such as healthcare, the PM said'humanity could lose control of AI completely' with'incredibly serious' consequences. The grave message coincides with the publication of a government report and comes ahead of the world's first AI Safety Summit in Buckinghamshire next week. Many of the world's top scientists attending the event think that in the near future, the technology could even be used to kill us. Here are the five ways humans could be eliminated by AI, from the development of novel bioweapons to autonomous cars and killer robots. Largely due to movies like The Terminator, a common doomsday scenario in popular culture depicts our demise at the hands of killer robots.

The UK government, with its reversals on climate policy and commitment to oil drilling and air pollution, usually seems to be pro-apocalypse. But lately, senior British politicians have been on a save-the-world tour. Prime minister Rishi Sunak, his ministers, and diplomats have been briefing their international counterparts about the existential dangers of runaway artificial superintelligence, which, they warn, could engineer bioweapons, empower autocrats, undermine democracy, and threaten the financial system. "I do not believe we can hold back the tide," deputy prime minister Oliver Dowden told the United Nations in late September. Dowden's doomerism is supposed to drum up support for the UK government's global summit on AI governance, scheduled for November 1 and 2. The event is being billed as the moment that the tide turns on the specter of killer AI, a chance to start building international consensus toward mitigating that risk.

Center for A.I. Safety Director Dan Hendrycks explains concerns about how the rapid growth of artificial intelligence could impact society. Tech experts, Silicon Valley billionaires and everyday Americans have voiced their concerns that artificial intelligence could spiral out of control and lead to the downfall of humanity. Now, researchers at the Center for AI Safety have detailed exactly what "catastrophic" risks AI poses to the world. "The world as we know it is not normal," researchers with the Center for AI Safety (CAIS) wrote in a recent paper titled "An Overview of Catastrophic AI Risks." "We take for granted that we can talk instantaneously with people thousands of miles away, fly to the other side of the world in less than a day, and access vast mountains of accumulated knowledge on devices we carry around in our pockets."