Pausing AI Developments Isn't Enough. We Need to Shut it All Down

An open letter published today calls for "all AI labs to immediately pause for at least 6 months the training of AI systems more powerful than GPT-4." This 6-month moratorium would be better than no moratorium. I have respect for everyone who stepped up and signed it. I refrained from signing because I think the letter is understating the seriousness of the situation and asking for too little to solve it. The key issue is not "human-competitive" intelligence (as the open letter puts it); it's what happens after AI gets to smarter-than-human intelligence.