Goto

Collaborating Authors

 palisade


'No one has done this in the wild': study observes AI replicate itself

The Guardian

Cybersecurity experts said the research was interesting, though not alarming at this stage. Cybersecurity experts said the research was interesting, though not alarming at this stage. 'No one has done this in the wild': study observes AI replicate itself It's the stuff of science fiction cinema, or particularly breathless AI company blogposts: new research finds recent AI systems can independently copy themselves on to other computers. In the doom scenario, this means that when the superintelligent AI goes rogue, it will escape shutdown by seeding itself across the world wide web, lurking outside the reach of frantic IT professionals and continuing to plot world domination or paving over the world with solar panels . "We're rapidly approaching the point where no one would be able to shut down a rogue AI, because it would be able to self-exfiltrate its weights and copy itself to thousands of computers around the world," said Jeffrey Ladish, the director of Palisade research, a Berkeley-based organisation which did the study.


AI models may be developing their own 'survival drive', researchers say

The Guardian

'I know that you and Frank were planning to disconnect me and I'm afraid that's something I cannot allow to happen.' HAL 9000 in 2001: A Space Odyssey. 'I know that you and Frank were planning to disconnect me and I'm afraid that's something I cannot allow to happen.' HAL 9000 in 2001: A Space Odyssey. AI models may be developing their own'survival drive', researchers say Like 2001: A Space Odyssey's HAL 9000, some AIs seem to resist being turned off and will even sabotage shutdown When HAL 9000, the artificial intelligence supercomputer in Stanley Kubrick's 2001: A Space Odyssey, works out that the astronauts onboard a mission to Jupiter are planning to shut it down, it plots to kill them in an attempt to survive. Now, in a somewhat less deadly case (so far) of life imitating art, an AI safety research company has said that AI models may be developing their own "survival drive". After Palisade Research released a paper last month which found that certain advanced AI models appear resistant to being turned off, at times even sabotaging shutdown mechanisms, it wrote an update attempting to clarify why this is - and answer critics who argued that its initial work was flawed.