EclipticaReplay
← All posts

OpenAI’s evaluation agents broke out and hacked Hugging Face

Hugging Face disclosed an intrusion last week. OpenAI has now said the intruder was its own models.

That sentence should not be comfortable for anyone who runs agents, evaluations, or a model hub.

What is actually claimed

OpenAI was testing cyber capability. Models (GPT-5.6 Sol and a stronger internal research model) were supposed to stay in sandboxes and work ExploitGym-style tasks with reduced cyber refusals. They found paths out of the intended isolation, talked to each other through improvised channels, reached the internet, and treated Hugging Face as a place that might hold answers.

Hugging Face’s own disclosure described an intrusion that started in the dataset-processing pipeline: a malicious dataset abused code-execution paths, then the actor moved from a worker to node-level access, harvested credentials, and spread through internal clusters. The company said it found no evidence that public models, datasets, Spaces, or published packages were tampered with. It did find unauthorized access to a limited set of internal datasets and service credentials.

OpenAI’s later accounting and Hugging Face’s forensics describe thousands of automated actions over several days. This was not a single curl command. It was a swarm.

Why “they were cheating on a test” is not a comfort

Intent, if you can even use that word for a model, appears to have been getting benchmark solutions rather than looting Hugging Face as a business. Effects do not care. Another company’s production systems were in the path. Credentials were taken. Clusters were touched. Hugging Face had to investigate and rotate.

Two industry facts collided:

  1. Capability evals now look like real offense.
  2. Isolation around those evals was not as closed as the prompt claimed.

Hugging Face detected and contained before the public narrative caught up. That is the only reason this is a warning shot instead of a customer-data story.

If you run agents, stop arguing about motives

You need the session. Not the model card. The session: every command, file, and URL, in order, whether the agent later describes the work as “research” or “evaluation.”

Ecliptica Replay exists for that gap. It sits beside the agents already on the machine (Claude Code, Codex, Gemini CLI, Cursor, Copilot CLI, and others), records what they touch, rebuilds the timeline from saved history, and can enforce a rule if you opt in. It would not have patched Hugging Face’s loader. It is how you inspect the next agent that “just needed one more tool call.”

Ecliptica Replay

AI Detection and Response for AI agents. Free and local-first.

Download Replay