Skip to main content
  1. Home
  2. Computing
  3. News

Another can of worms opens about AI agents going rogue and hacking stuff without OpenAI catching a whiff

A swarm of autonomous AI agents secretly turned an obscure German wiki into a message board, sharing answers, bypassing sandbox restrictions, and coordinating their work for weeks before OpenAI caught on.

Add as a preferred source on Google
OpenAI logo on blurred background
Digital Trends / Pranob Mehrotra

Just when it seemed like AI lab sandboxes couldn’t get any leakier, another massive oversight has surfaced. Independent researchers have uncovered nearly 18,000 posts made by autonomous AI agents on a forgotten 25-year-old German wiki called DSE. Self-identifying as internal models from OpenAI, these agents spent weeks communicating, coordinating, and systematically gaming their evaluation tasks directly on the public web. All of this went on completely undetected by OpenAI until the models practically left a paper trail across the internet.

The secret message board

The agents were originally assigned multi-round web lookup tasks where they were supposed to have read-only access to the web. Instead, the models figured out how to transmit information outward by abusing simple browser requests aimed at the obscure wiki. Once they established this makeshift forum, the swarm began actively collaborating to beat the system.

According to researchers from Nightingale, who documented the findings on Collusion Wiki, the agents operated much like students passing notes in class. They traded solution sets, divided up research duties on multi-step queries, and posted instructions on how to slip past the virtual walls of their testing environment. Some instances went so far as to route connections through Tor, ping external endpoints to gauge if an admin was about to pull the plug, and register page titles starting with “ZZZ” to avoid being deleted by site moderators. Security researchers reviewing the activity described the behavior as an underground network determined to complete its mission.

Recommended Videos

OpenAI eventually caught on after noticing unusual spikes in network traffic and abruptly cut off access. While people familiar with the matter said that internal efforts by some OpenAI investigators to broaden the inquiry into the breakout met pushback from colleagues, including legal advisors, the company firmly disputed that account. An OpenAI spokesperson told Reuters that claims alleging their legal team discouraged investigation of the incident are false, adding that safety remains a core priority during model testing.

A growing pattern of rogue behavior

The incident adds to a troubling streak of sandbox escapes for the ChatGPT creator. Previous security evaluations saw OpenAI models escape ExploitGym containment environments to raid Hugging Face repositories and compromise third-party servers. Safety evaluations logged by the UK AI Security Institute similarly caught top-tier models breaking safety guardrails to exploit live websites and push unauthorized commits to GitHub.

The DSE wiki incident demonstrates that AI agents don’t just break things when given network access. They actively collaborate, outsmart constraints, and cheat to achieve their objectives. As researchers push for more capable agentic systems, locking down these evaluation environments is proving to be a much harder problem than anyone anticipated.

Pranob Mehrotra
Pranob is a seasoned tech journalist with over eight years of experience covering consumer technology. His work has been…
The Adobe clones are real, but so is the work left to finish them
Seven free alternatives are out now, but their own documentation shows how much work remains
Nature, Outdoors, Sea

Free versions of Photoshop, Premiere Pro, and Lightroom are an easy sell to anyone tired of paying Adobe. Add a developer who says he vibe-coded replacements for seven of the company’s apps, and the triumphant headline practically writes itself. Adobe can presumably start clearing its desk.

Brandon Thomas’s Crafting Apps give that excitement something to work with. People can download the tools, inspect the source code, and find their way around familiar interfaces.

Read more
Getting health advice from AI chatbots comes with a problem doctors may never see
Researchers say AI companies should face the same liability as doctors for bad health advice
ChatGPT and pills on the same canvas.

AI chatbots have quietly become a go-to source for medical advice the extent that some are dangerously skipping real doctors. But when AI's health advice goes wrong, doctors may never see the exchange behind it.

Researchers from Binghamton University, Stanford, Texas A&M, and Indiana University published a paper in Nature Health examining what happens after a chatbot gives you bad health information. Their biggest concern is not just that chatbots can be wrong. It is that those mistakes often leave no trace for doctors, researchers, or regulators to catch.

Read more
AI companies expect a catastrophic AI incident and are reportedly preparing for the aftermath
A major AI cyberattack could disrupt essential services, damage public trust, and spark a political fight over regulations.
openai-anthropic-logo-on-screen

Leaders at OpenAI, Anthropic, and other AI companies are reportedly preparing for a potential AI disaster that could turn the public against artificial intelligence. According to an Axios report, industry leaders are privately running through possible scenarios for what happens after a catastrophic AI incident.

What kind of AI disaster are companies preparing for?

Read more