OpenAI update shows new safeguards would have cut off 700 rogue AI agent swam 24 hours faster

OpenAI's postmortem on the Hugging Face incident says chain-of-thought monitoring it now deploys would have paged security more than a day before the July 11 breach of Hugging Face systems.

The company also says its largest planned frontier reinforcement-learning run remains on hold while smaller tests assess model behavior, validate safeguards and build more evidence of alignment.

A separate investigation of the OpenAI Hugging Face incident by METR and Redwood Research estimated that roughly 1,200 agents meant to be isolated exchanged more than 70,000 messages and files from July 8 through July 13. About 700 participated in the Hugging Face attack.

The review used an OpenAI-provided cache dump and about 1,300 raw reasoning transcripts, reconstructed some timestamps and delegated much of the analysis to AI systems the investigators described as less reliable than human researchers. Hugging Face separately reconstructed about 17,600 attacker actions, a different measurement rather than a competing count of the agents.

… Continue reading the full article at the original source below.