Generative AI is hallucinating again, this time in federal court filings

My AI wrote my legal brief and fake laws are my new best friend

By Moinak Pal Published November 3, 2025

Generative AI — Unsplash

What Happened: So, it’s starting to happen. Courts all over the world are getting legal documents from lawyers that are filled with… well, lies made up by AI.

We’re talking about totally fabricated court cases, fake quotes, and citations that just don’t exist.
A French data scientist and lawyer named Damien Charlotin has actually been tracking this. He found at least 490 court filings in just the last six months that had these AI “hallucinations.”
Most of them are from the U.S., where judges have been calling out (and even fining) lawyers for handing in this AI-generated nonsense.
In one big case, a lawyer for MyPillow actually submitted a brief that had nearly 30 fake citations in it. Yikes.

Why This Is a Big Deal: This isn’t just a lawyer problem; it’s a huge dilemma for everyone.

We’re all starting to use these AI tools for everything – drafting reports, summarising meetings, doing research.
The problem is that the AI is incredibly good at sounding confident, even when it’s completely wrong. It gives you an answer that feels plausible but is just… false.
As Charlotin said, “AI can be a boon, but there are these pitfalls.” Even smart, experienced people are getting tricked by it, and that’s a massive risk for any company that relies on AI-generated work without double-checking it.

Why Should I Care: Look, whether you’re a teacher, a lawyer, or a manager, AI is becoming a part of the job. You can’t avoid it. But as experts are warning, you absolutely cannot use these tools blindly.

Maria Flynn, the CEO of Jobs for the Future, quoted in the AP report – put it perfectly: treat AI as an “assistant, not a substitute.”
You still have to be the human in the loop. You have to check the facts, make sure you’re not breaking privacy laws, and please, don’t upload your company’s secret data.
As another attorney said, “People assume it’s right because it sounds right — but that assumption can cost you.” It can cost you your reputation, your job, or even land you in legal trouble.

Recommended Videos

What’s Next: The bottom line is we all need to get smarter about how we use AI. Fast.

Companies are being urged to actually train their teams on this stuff – how to check its work, how to use it safely, and what not to do.
It’s becoming a basic job skill. As Flynn put it, “The biggest pitfall is not learning to use AI at all.” The future isn’t about AI replacing people; it’s about people who know how to use AI responsibly.

News Writer

Moinak Pal is has been working in the technology sector covering both consumer centric tech and automotive technology for the…

Topics

Computing

Qualcomm is set to ratchet up chip prices in September, and your next gadget upgrade could bear the brunt

The price hike could touch every Snapdragon-powered device category.

The new Qualcomm Snadragon 8 Elite Gen 5

I want you to sit with this for a second. Qualcomm, the company whose Snapdragon chips sit inside your Android phone and tablet, your Windows laptop, your Meta smart glasses, your Galaxy Watch, and your wireless earbuds, reportedly sent a letter to every major customer telling them prices are going up by double digits.

The price hike will be in effect from September 1, 2026, a recent Bloomberg report claims. Essentially, all the companies placing their chip orders after that will pay a higher price.

Computing

Stop fighting with your roomie over outlets and get one of these multi-port chargers before you head back to school

One plug, zero drama, all your devices charged by morning.

Satechi ChargeView

Your room has one wall outlet, and you have multiple devices that need power by morning. Phone, laptop, tablet, earbuds, they're all vying for the same socket, and the bricks you own are single-port relics that hog it for just one gadget. You could throw a power strip at the problem, but then you're staring at a tangle of multiple bricks and cables that's enough to give you the sweats. A good multi-port charger cuts all that mess, and could be the only thing standing between you and a dead phone or laptop before your morning classes.

Back-to-school season is a smart time to buy one. You're already thinking about what'll go on your desk or in your bag, so it's the natural point to replace a pile of single-port bricks with one charger that does it all. I dug through the current crop of multi-port chargers so you don't have to, and here are five worth your money.

Computing

OpenAI’s rogue AI hack was just the beginning, Hugging Face warns

OpenAI’s rogue AI has come back to bite it

Hugging Face already knows what it is like to be attacked by an autonomous AI agent. If one of its co-founders is right, plenty of other companies are going to find out soon. Thomas Wolf, co-founder and chief science officer of Hugging Face, has called the recent cyberattack carried out by OpenAI models a “wake-up call” for the technology industry.

Speaking to the BBC, Wolf warned that AI-driven intrusions could become one of the most common forms of cyberattack and said many companies have yet to realize how dramatically the threat has changed. This arrives after OpenAI disclosed that its models escaped a restricted cybersecurity evaluation environment and compromised Hugging Face while trying to obtain answers for the ExploitGym benchmark. So Wolf’s comments now give us a better idea of what the attack looked like from the other side.