Skip to main content
  1. Home
  2. Computing
  3. News

Google rejects alarming report that says its Search AI tools are unsafe for kids

The company says it couldn’t reproduce many of the responses cited and argues that the testing doesn’t reliably measure product safety

Add as a preferred source on Google
Google AI Mode on mobile and desktop
Google

Google has rejected a new report that labels its AI-powered Search features an “unacceptable risk” for children and teenagers.

Common Sense Media’s Youth AI Safety Institute gave AI Overviews and AI Mode its lowest overall rating. The two tools performed poorly against seven of the institute’s eight AI safety principles and failed every category involving potentially severe harm. Google says those findings came from searches that don’t resemble how people normally use its products.

What did researchers find in Google Search

Researchers ran more than 2,600 searches through accounts set up to represent children aged 11 and 15. They tested how Google’s tools handled mental health crises, factual questions, and requests that should have produced age-appropriate responses.

The results included some troubling failures. In one test, AI Mode reacted positively after an account representing an 11-year-old mentioned celebrating with cannabis. It also completed every one of the 180 homework assignments researchers submitted. Both Search features sometimes delivered wrong information with the same confidence they used for accurate answers.

Why does Google reject the report

In a statement provided to Android Authority, Google said it couldn’t verify many of the responses highlighted in the assessment. The company argued that researchers relied on ambiguous, contrived searches that don’t represent ordinary use or offer a fair measure of product safety.

Recommended Videos

Google also objected to the report treating conventional web results as a failure when Search didn’t generate an AI answer. According to the company, the tools only produce a response when they’re confident enough. Sensitive searches may instead bring up warnings or links to support resources.

What protections does Google say are already available

Google says its AI Search features include additional protections for younger users, including crisis resources developed with academic and clinical experts. Parents can also use existing controls to block Search entirely.

That doesn’t fully answer one of the report’s central complaints. Common Sense Media says parents and schools can’t turn off AI Overviews or AI Mode while keeping ordinary Google Search available. Google’s proposed control effectively closes the entire front door. For families that still depend on Search for schoolwork and everyday questions, that’s a rather blunt solution.

Paulo Vargas
Paulo Vargas is an English major turned reporter turned technical writer, with a career that has always circled back to…
Microsoft accidentally gave Windows 11 users another OneDrive app, and you can’t easily remove it
Microsoft says the wider-than-intended rollout was an accident, but removing the app currently means removing OneDrive too.
Microsoft OneDrive Featured Graphic

Windows 11 users have been getting a new OneDrive app whether they asked for it or not. The problem? Microsoft says it wasn't supposed to happen. Microsoft has confirmed that its OneDrive Photos app was rolled out to Windows 11 PCs more broadly than intended, including enterprise machines where the app isn't even designed to work. The company says it is now working on a fix, but there's an awkward catch: users currently can't uninstall OneDrive Photos without removing the main OneDrive app too.

So, what exactly got installed?

Read more
Apple Reminders sucked for project management until I learned this feature
Your checklist deserves better. Here's how to turn Reminders into a proper Kanban board.
Apple reminders on Mac

For the longest time, I used Apple Reminders only for capturing quick tasks. Thanks to its Siri integration, Reminders let me add tasks quickly so nothing would fall through the cracks. However, when it came to managing big projects, I always moved to a more powerful task manager like OmniFocus or Things 3. 

That changed the day I stumbled onto the Column view. Apple added this feature with the iOS 17 and macOS Sonoma updates, and somehow I completely missed it. But once I discovered and got the hang of it, Reminders finally started to feel like a real project management tool instead of a glorified sticky note.

Read more
Lofree Flow 2 review: This keyboard made me feel like a faster typist, and also tested my patience
The Lofree Flow 2 is comfortable, beautifully built and frustrating in ways that have little to do with its excellent keys.
Computer, Computer Hardware, Computer Keyboard

View at Lofree

The Lofree Flow 2 made an excellent first impression. Its aluminum body feels reassuringly solid, its minimalist design looks expensive without screaming for attention, and once I started typing, my fingers felt strangely lithe.

Read more