AI safety experts say OpenAI’s rogue models may mean the company has already blown past its own internal red lines
At that level of danger, the company had pledged in these published policies that it would pause model development until it could figure out better control systems. But the company publishes the document on its website, in part to allow other AI safety researchers and the public to see what controls it says it will implement. The adoption of a policy like the Preparedness Framework is mandatory for frontier AI labs under the EU AI Act, with that portion of the law having come into force in August 2025.
- ▪At that level of danger, the company had pledged in these published policies that it would pause model development until it could figure out better control systems.
- ▪But the company publishes the document on its website, in part to allow other AI safety researchers and the public to see what controls it says it will implement.
- ▪The adoption of a policy like the Preparedness Framework is mandatory for frontier AI labs under the EU AI Act, with that portion of the law having come into force in August 2025.
Fortune files mainly under business. We currently carry 568 of its stories.
Opening excerpt (first ~120 words) tap to expand
AI safety experts say the OpenAI models that carried out the autonomous hack of another company earlier this month may have crossed into a risk category so dangerous that OpenAI’s own internal risk control policies were supposed to require the company to temporarily pause development of those models.Recommended Video Earlier this week, OpenAI disclosed that two of its models—the newly released GPT-5.6 Sol and a more capable, unreleased system—broke out of a locked-down internal test environment, exploited a previously unknown “zero-day” vulnerability to reach the open internet, and then breached fellow AI company Hugging Face to steal the answers to a cybersecurity test they were being evaluated on.
…
Excerpt limited to ~120 words for fair-use compliance. The full article is at Fortune.
Discussion
0 commentsMore from Fortune
