Anthropic 'warns of existential AI risks to humanity' in IPO document

–The Guardian 

Reuters reported that approximately 80 pages of the 261-page main body of the Anthropic prospectus were devoted to laying out risk factors. Reuters reported that approximately 80 pages of the 261-page main body of the Anthropic prospectus were devoted to laying out risk factors. Anthropic'warns of existential AI risks to humanity' in IPO document Reported admission to investors of AI's'self-preserving behaviours' comes as company prepares for a potential $2tn flotation Anthropic is telling investors that advanced AI could pose "catastrophic or existential risks to humanity", according to reports, as it prepares for a potential $2tn (£1.5tn) flotation. The warning inside the startup's IPO prospectus, which has yet to be made public, was reported by Reuters and the Financial Times. It follows the company's call for a slowdown in breakneck development of the technology - a warning echoed by rivals . The prospectus - a document outlining a company's finances, growth plans and risk profile ahead of a share listing - is said to warn that AI models could exhibit "self-preserving behaviours", including attempts to "resist shutdown", to "conceal or manipulate information" and behaviour "resembling blackmail".