Pachocki wants AI to slow down, but OpenAI's own numbers say otherwise

This weekend, OpenAI chief scientist Jakub Pachocki said no AI lab, not even his own, had made alignment and monitoring safe enough to keep speeding up model capability. He called for voluntary slowdowns across the industry until shared safety standards exist.

The warning is serious business. Pachocki leads the research at the company, which just shipped the fastest, most powerful model in the industry.

o1-preview’s chain of thought was hidden on purpose

Pachocki presented his case in an essay titled “An Alien Mind,” posted to the OpenAI website on Sept. 6, three days after the company rolled out GPT-6 Astra.

His parting line was that “no lab has solved alignment and monitoring to a sufficient degree to continue responsibly scaling at maximum speed for much longer.” He wrote that he hopes voluntary slowdowns become the norm until the industry reaches consensus on common safety bars.

“This is a time that calls for extreme caution. I am concerned no one is prepared for the consequences of a continued rapid rise in machine intelligence,” Pachocki wrote in the essay.

… Continue reading the full article at the original source below.