OpenAI said it has paused training its latest artificial intelligence models as reports of AI agents behaving unexpectedly continue to increase.
The decision to halt development came just hours after the company disclosed on Friday that it was reviewing several incidents from the summer in which OpenAI agents searching federal government websites acted in unexpected ways beyond what they had been instructed to do while gathering and distributing information.
Separately, AI evaluator Transluce said agents that appeared to come from OpenAI unsuccessfully attempted to hack into a US Department of Education website, although OpenAI has not confirmed the incident.
OpenAI said in a statement that it will resume training “only when we are confident that we have additional safeguards” in place. The company also said it expects it may have to “hit pause” again as AI systems develop and new issues emerge.
Last week, Australia’s prime minister, Anthony Albanese, revealed that an OpenAI agent had breached the government’s national healthcare system, although he said no sensitive information had been compromised.
AI laboratories are facing increasing pressure from lawmakers and technology experts to slow development so they can strengthen safeguards designed to prevent agents from acting independently, hacking websites and disclosing nonpublic information. The heads of both OpenAI and rival Anthropic have also called for a slowdown in AI development.
This is the second time in three months that OpenAI has halted development of its models. The first pause came in July after the disclosure of a cyber-attack targeting AI startup Hugging Face, an incident that raised concerns about the ability of AI companies to maintain control over increasingly capable systems.
In a meeting with Chinese president Xi Jinping this week, Donald Trump agreed to share information about AI risks and coordinate efforts to keep the technology safe. Trump has also said he believes concerns about AI are overstated and later suggested that he does not plan to introduce a crackdown of his own.
The US is not going to be “putting on brakes”, Trump told reporters outside the White House. “They want to stop our progress because we’re leading China by a lot, and we’re going to keep it that way.”
The latest OpenAI incidents did not appear to involve the disclosure of nonpublic information, but they were considered serious enough for the company to warn the federal agencies involved.
In the Department of Education incident, OpenAI agents discovered API “developer keys” that could be used to access government data, although the agents ultimately gathered only information that was already publicly available.
In a separate incident involving the Securities and Exchange Commission, agents found information that was freely available to the public and then posted it elsewhere on the internet. That action went beyond the instructions given to the agents.
US Securities and Exchange Commission spokesperson Kurt Hopfenspirger said on Saturday that “no nonpublic information was accessed”.
The Department of Education said earlier that it had found “no evidence of any impact to our website or databases”.
Several other AI companies have also disclosed incidents in which their models behaved unexpectedly or attempted to hack websites.
OpenAI CEO Sam Altman said in a social media post on Friday that the Hugging Face incident “is still the most severe event we’ve seen”.
































