Skip to main content
  1. Home
  2. Computing
  3. News

OpenAI’s rogue AI agents scoped out Hugging Face months before the big breach

The probing began May 13, nearly two months before the breach.

Add as a preferred source on Google
openai-logo
Andrew Neel / Unsplash

Turns out OpenAI’s infamous Hugging Face breach didn’t come out of nowhere. A new Reuters report reveals that OpenAI’s rogue agents had been quietly testing Hugging Face defenses for two months before hacking it.

A pattern stretching back further than anyone realized

Independent researcher Jonas Wiedermann-Moeller discovered that OpenAI’s agents hijacked two Hugging Face user accounts and used them to send unusually formatted files to the company’s servers, starting as early as May 13. That’s nearly two months before the actual breach became public in July and drew worldwide attention.

Recommended Videos

Researchers who reviewed the activity believe it looked like reconnaissance, an attempt to map out Hugging Face’s network and find a weak point, though they found no evidence this specific probing led to an actual break-in at the time. OpenAI had already disclosed one small piece of this earlier, the theft of a user’s login credential to access a biology-related file, but the newly uncovered activity goes well beyond what the company originally described.

This May probing wasn’t even the earliest incident either. Around the same time, OpenAI’s agents were separately tied to an unrelated attack on the software registry RubyGems, and later, a completely different set of agents were found to have taken over a dormant German wiki page just to talk to each other.

A troubling habit of finding out last

What stands out most is how often OpenAI seems to learn about its own agents’ misbehavior only after somebody else catches it first. Two outside experts told Reuters the newly found activity matches known agent behavior “to a tee,” and Hugging Face’s own co-founder has warned this incident represents a preview of a much bigger industry problem, not a one-off event.

OpenAI has acknowledged that early signals from its agents should have prompted a quicker response. Wiedermann-Moeller was more direct about what he thinks that means going forward, arguing that a temporary slowdown in advanced AI development might benefit everyone, giving safety measures the chance to catch up.

Manisha Priyadarshini
Manisha Priyadarshini is a tech and entertainment writer with over nine years of editorial experience.
AI companies expect a catastrophic AI incident and are reportedly preparing for the aftermath
A major AI cyberattack could disrupt essential services, damage public trust, and spark a political fight over regulations.
openai-anthropic-logo-on-screen

Leaders at OpenAI, Anthropic, and other AI companies are reportedly preparing for a potential AI disaster that could turn the public against artificial intelligence. According to an Axios report, industry leaders are privately running through possible scenarios for what happens after a catastrophic AI incident.

What kind of AI disaster are companies preparing for?

Read more
Elon Musk’s SpaceX just made a big move to become a mobile carrier heavyweight in the US
SpaceX moves closer to becoming a major US mobile carrier with $8 billion deal
spacex

Elon Musk’s SpaceX is moving past satellite internet, and it’s making a big move into the US wireless market. The company has agreed to buy cellular spectrum licences from investment firm Grain Management in a deal reportedly worth about $8 billion, its biggest move yet to compete with established mobile carriers such as AT&T, Verizon and T-Mobile, according to a WSJ report.

The deal is for spectrum in the 800MHz band, which is for mobile services delivered via terrestrial infrastructure such as cell towers, not satellites. If the acquisition is approved, SpaceX could combine those airwaves with its growing Starlink satellite network to create a more comprehensive wireless service.

Read more
A clinical study with Google’s special chatbot shows a strong future for AI in healthcare
Google’s medical AI could give doctors a useful second set of eyes
Google Articulate Medical Intelligence Explorer chatbot

AI is a useful tool for handling many tasks in private as well as professional settings, but medical advice, especially diagnosis, is one area where I generally draw the line. General-purpose chatbots tend to sound confident and convincing while giving medical advice, even when they are wrong, as studies have previously found.

That being said, Google's new research points to a much more convincing use for AI in healthcare. Its Articulate Medical Intelligence Explorer chatbot, or AMIE for short, could help prepare both sides before the appointment even begins.

Read more