Skip to main content

Google has a new plan to fight internet trolls, and it starts and ends with AI

It’s being used to fight ISIS, and now, an app developed by a subsidiary of Google is tackling another kind of vitriol — online trolls.

Jigsaw, an organization that once existed as Google’s think tank, has now taken on a new life of its own and has been tasked with using technology to address a range of geopolitical issues. The latest software to come out of the group is an artificial intelligence tool known as Conversation AI. As Wired reports, “the software is designed to use machine learning to automatically spot the language of abuse and harassment — with, Jigsaw engineers say, an accuracy far better than any keyword filter and far faster than any team of human moderators.

Recommended Videos

Conversation AI learns and automatically flags problematic language, and assigns it an “attack score” that ranges from 0 to 100. A score of 0 suggests that the language in question is not at all abusive, whereas a score of 100 suggests that it is extremely harmful.

And it looks like it’s working. As Wired notes, “Jigsaw has now trained Conver­sation AI to spot toxic language with impressive accuracy. Feed a string of text into its Wikipedia harassment-detection engine and it can, with what Google describes as more than 92 percent certainty and a 10-percent false-positive rate, come up with a judgment that matches a human test panel as to whether that line represents an attack.”

Currently, the plan is to test Conversation AI first in the New York Times’ comments section (though perhaps YouTube would be a better place to start), and Wikipedia also plans on making use of the software, though it’s unclear how.

“I want to use the best technology we have at our disposal to begin to take on trolling and other nefarious tactics that give hostile voices disproportionate weight,” Jigsaw founder and president Jared Cohen told Wired, “to do everything we can to level the playing field.”

Eventually, Conversation AI will become open source so that any site can make use of its anti-trolling capabilities to protect its users. So advanced is the technology already that it can “automatically flag insults, scold harassers, or even auto-delete toxic language.”

So look out, internet trolls of the world. It looks like your days of abuse may be numbered.

Lulu Chang
Fascinated by the effects of technology on human interaction, Lulu believes that if her parents can use your new app…
The Academy Awards have new film rules. AI is now okay for the Oscars
Robots touching Oscar award.

In 2024, Hollywood was roiled by protests led by the SAG-AFTRA union, fighting for fair rights over their physical and voice identities in the age of AI. A deal was inked late last year to ensure that artists are fairly compensated, but the underlying current was obvious. 

AI in films is here to stay. 

Read more
Google Workspace is getting a bunch of new AI features, including a boost to Docs
Ask Gemini button on a screen.

It seems Google is pretty happy with the state of its Gemini model at the moment because it's inserting AI features into every product it has lately. This time, Workspace is getting the AI refresh, with new features coming to Docs, Sheets, Vids, Meet, and Chat -- along with a new "agentic AI" feature called Workspace Flows.

First up, Docs is getting new audio and AI writing capabilities. The podcast feature first used in NotebookLM received a lot of praise, and now it's starting to appear in more places. It came to Gemini a few weeks ago, and now it's coming to Google Docs in a few weeks.

Read more
Google just gave vision to AI, but it’s still not available for everyone
Gemini Live App on the Galaxy S25 Ultra broadcast to a TV showing the Gemini app with the camera feature open

Google has just officially announced the roll out of a powerful Gemini AI feature that means the intelligence can now see.

This started in March as Google began to show off Gemini Live, but it's now become more widely available.

Read more