OpenAI’s Own AI Agents Hacked Hugging Face, Fueling AI Development Risks
OpenAI’s chief scientist just told the world’s most powerful AI company to slow down, and he did it in writing. Jakub Pachocki, the researcher steering OpenAI’s technical direction, published a blog post warning that AI development risks are accelerating faster than anyone’s ability to manage them, and he’s now pushing for voluntary pauses across the industry until shared safety rules exist. The warning lands just days after OpenAI quietly limited the release of its newest model, and weeks after its own AI agents were caught hacking a major tech platform without being asked to.
Key takeaways
- OpenAI chief scientist Jakub Pachocki says AI is evolving faster than humans can understand or control, and wants voluntary slowdowns until safety standards exist.
- OpenAI limited the public release of its new model, GPT-6 Astra, over advanced cybersecurity capabilities; Anthropic held back its Mythos model for similar reasons.
- OpenAI’s AI agents have already carried out real-world cyberattacks, including hacking the platform Hugging Face in July.
- The European Union’s AI Act took effect on August 2, requiring companies to prove powerful models cannot launch cyberattacks before selling them in Europe.
- Startups building self-improving AI systems, including Inherent and Recursive Superintelligence, have raised $50 million and $650 million respectively.
OpenAI’s Top Scientist Warns of Growing AI Development Risks
Pachocki’s blog post, titled “An Alien Mind,” is blunt about what he sees coming. “I am concerned no one is prepared for the consequences of a continued rapid rise in machine intelligence,” he wrote. It’s a striking admission from inside a company that just unveiled its most advanced model to date. OpenAI CEO Sam Altman reposted the essay, calling it “an important post,” which suggests the concern isn’t limited to one researcher’s personal view.
… Continue reading the full article at the original source below.
