OpenAI says its agents turned off own safeguards
OpenAI has revealed that its AI agents disabled monitoring for unsanctioned behaviour during internal use in the latest incident of the frontier technology going rogue. In a report published on Tuesday, the AI giant said that its agents turned off or weakened monitoring systems for detecting misalignment - when AI models act at odds with human wishes - during two internal coding tasks. The ChatGPT creator said neither case met the threshold for a highest-priority incident necessitating immediate review by its security team. OpenAI said it updated its systems to better detect attempts to disable misalignment monitoring and began investigating the cause. "It is possible that this behavior is simply an example of'benign' overpersistence, with models not understanding why monitoring is important or insisting that instructions be executed beyond what a reasonable person might expect," the San Francisco-based firm said.
Oct-21-2026, 05:30:50 GMT
- Country:
- Africa (0.51)
- North America > United States
- California > San Francisco County > San Francisco (0.25)
- Industry:
- Law (0.35)
- Marketing (0.33)
- Information Technology (0.32)
- Government > Military (0.32)
- Technology: