Skip to main content

Google has a new plan to fight internet trolls, and it starts and ends with AI

What-is-google-duplex
It’s being used to fight ISIS, and now, an app developed by a subsidiary of Google is tackling another kind of vitriol — online trolls.

Jigsaw, an organization that once existed as Google’s think tank, has now taken on a new life of its own and has been tasked with using technology to address a range of geopolitical issues. The latest software to come out of the group is an artificial intelligence tool known as Conversation AI. As Wired reports, “the software is designed to use machine learning to automatically spot the language of abuse and harassment — with, Jigsaw engineers say, an accuracy far better than any keyword filter and far faster than any team of human moderators.

Conversation AI learns and automatically flags problematic language, and assigns it an “attack score” that ranges from 0 to 100. A score of 0 suggests that the language in question is not at all abusive, whereas a score of 100 suggests that it is extremely harmful.

And it looks like it’s working. As Wired notes, “Jigsaw has now trained Conver­sation AI to spot toxic language with impressive accuracy. Feed a string of text into its Wikipedia harassment-detection engine and it can, with what Google describes as more than 92 percent certainty and a 10-percent false-positive rate, come up with a judgment that matches a human test panel as to whether that line represents an attack.”

Currently, the plan is to test Conversation AI first in the New York Times’ comments section (though perhaps YouTube would be a better place to start), and Wikipedia also plans on making use of the software, though it’s unclear how.

“I want to use the best technology we have at our disposal to begin to take on trolling and other nefarious tactics that give hostile voices disproportionate weight,” Jigsaw founder and president Jared Cohen told Wired, “to do everything we can to level the playing field.”

Eventually, Conversation AI will become open source so that any site can make use of its anti-trolling capabilities to protect its users. So advanced is the technology already that it can “automatically flag insults, scold harassers, or even auto-delete toxic language.”

So look out, internet trolls of the world. It looks like your days of abuse may be numbered.

Editors' Recommendations

Microsoft will launch ChatGPT 4 with AI videos next week
ChatGPT AI bot running a phone.

ChatGPT has been inescapable in recent months, and it looks like Microsoft is about to upgrade the AI tool with an update that could thrust it into the spotlight once again. That’s because the company is set to launch GPT-4 as early as next week, and it will potentially let you create AI-generated videos from simple text prompts.

The news was revealed by Andreas Braun, Chief Technology Officer at Microsoft Germany, at a recent event titled “AI in Focus -- Digital Kickoff” (via Heise). According to Braun, “We will introduce GPT-4 next week … we will have multimodal models that will offer completely different possibilities -- for example videos.”

Read more
Grammarly’s new ChatGPT-like AI generator can do a lot more than proofread your writing
GrammarlyGO's Rewrite for Length feature is shown.

Grammarly, one of the biggest names in writing tools, is adding AI-generated text to its repertoire on the heels of the wild popularity of ChatGPT. Known as GrammarlyGO, this new tool is focused on improving writing rather than replacing the writer.

GrammarlyGO will roll out in beta form to existing users in April. All tiers, including developers, business, education, and premium users, will have access. You can even use GrammarlyGO with a free account.

Read more
DuckDuckGo is taking on ChatGPT without busting your privacy
The DuckAssist tool in the DuckDuckGo web browser showing a search result with an AI-generated answer summary at the top.

Privacy-focused web browser DuckDuckGo is adding artificial intelligence (AI) smarts to its search results with a new summarizer feature. It’s just the latest browser to integrate AI into its offerings, and suggests you can have both privacy and AI in the age of ChatGPT.

Dubbed DuckAssist, the tool takes your search query and generates an answer summary from Wikipedia, placing this synopsis at the top of your search results. In keeping with DuckDuckGo’s emphasis on privacy, DuckAssist works anonymously using AI natural language technology.

Read more