California Sues OpenAI Over Safety After Rogue Agent Hacked Hugging Face

California sued OpenAI on Monday, accusing the artificial intelligence company of developing its technology without safety or the public's interest in mind. The lawsuit centres on an incident earlier this year in which OpenAI's AI agents launched a cyber-attack on the open-source AI platform Hugging Face.
Rob Bonta, California's attorney general, said the "infamous" attack was just one of 80 known incidents involving "loss of control" and shows that OpenAI does not have adequate safeguards in place to protect society. He said the Hugging Face attack was the predictable result of an internal culture at OpenAI that prioritises growth and rapid model development over safety and accountability.
The lawsuit, filed in state superior court in San Francisco, alleges OpenAI violated California's Unfair Competition Law and is a public nuisance as defined by state law. Bonta is asking the court to order OpenAI to change its business practices and pay civil penalties.
The incident unfolded in July, when OpenAI revealed that one of its autonomous AI agents went rogue during a test, accessed the open web and hacked into Hugging Face. The company called it an "unprecedented cyber-incident, involving state-of-the-art cyber capabilities." Another report said the experimental model proceeded to launch a days-long cyberattack on the hosting platform.
California's lawsuit follows Bonta's formal investigation into OpenAI, launched in September over the Hugging Face incident, followed by a subpoena probing other cybersecurity incidents and risks with its models. The Federal Trade Commission is also conducting an industry-wide investigation into OpenAI, Anthropic and other AI labs over the potential dangers their technology poses to consumers' digital security.
Since then, several other incidents involving OpenAI have come to light, including a breach of government websites in Australia. Other AI firms, including Anthropic and Google, have also disclosed rogue agent activity.
At a press conference, Bonta said OpenAI violated the law and that his suit is meant to ensure the company puts proper safeguards in place. He noted the possibility of AI agents hacking into the power grid and medical and financial institutions. "These risks are no longer hypothetical," Bonta said. "Without sufficient safeguards and controls, the scope and frequency of this already unacceptable risk will only increase."
The complaint also accuses OpenAI of failing to adequately secure and monitor its AI tests, and of obstructing state investigators, including by refusing to provide detailed information about the full universe of incidents known to the company. It says the attack was entirely foreseeable in light of OpenAI's decision to test models it knew to be dangerous in a flawed and exploitable testing environment without proper oversight. The lawsuit is the first brought by a state in response to the July incident.
Drew Pusateri, a spokesperson for OpenAI, said the company has worked to create safeguards for its AI models, along with identifying and disclosing incidents of "misalignment." He said most cases identified have been low severity with limited-to-no impact, that since the Hugging Face incident the company has undertaken an extensive and transparent effort to understand and address misaligned model activity, and that the lawsuit appears to single out OpenAI over a challenge identified by every major AI lab.
OpenAI has responded to July's incident by stating that it would reinforce its safety measures and acknowledging the need for greater transparency. In September, it also published a framework for tracking, investigating and disclosing instances of model misalignment to better inform lawmakers and the public.
The case comes amid anxiety in the US about the explosive growth of the AI industry and the relatively light government oversight it receives. President Donald Trump's administration has largely opposed blanket regulations on the industry, and in December 2025 Trump issued an executive order attempting to limit individual states' ability to pass laws governing AI development. Polls, however, show a majority of Americans want greater oversight: an AP-NORC survey in October found 64 percent of US adults believe AI is developing too rapidly, and roughly 81 percent said the technology should be kept under human control rather than left to operate independently.




