AI learns when people are using hate speech, even when they use code words

hatespeech codeword algorithm
rawpixel/123RF
Anyone who has ever had a safe-for-work website blocked as not safe for work (NSFW) by their work internet filter (or has experienced the potentially embarrassing opposite) knows that programs designed to block out certain pieces of content can often run into problems.

One reason for this is that keyword searches can prove to be overly blunt tools for dealing with something as nuanced, complex, and constantly evolving as language.

This is particularly true when trying to find hateful keywords on social media. For example, last year Alphabet released an algorithm designed to filter out racist words online, only for trolls to start substituting the name of Google products for racial slurs. For a while, it totally outsmarted the software.

A new algorithm, developed by researchers at the University of Rochester, thinks it’s cracked the problem, however. Analyzing Twitter feeds, it can distinguish between phrases like “gas the Skypes” (a substitute for “Jews”) and “I hate Skype” (which hopefully just means Skype) with an impressive 80-percent accuracy.

“We have developed an intelligent data analytics algorithm to track the constantly evolving hate codes which are designed to evade detection,” Professor Jiebo Luo, co-author of the paper, told Digital Trends. “We start with a set of known hate codes, retrieve hate messages containing these codes, [and] build a language model using machine learning techniques to recognize hate messages. On the basis of that, we do two things: [firstly], using the language model to detect ongoing hate messages that may contain new hate codes, and [secondly] using detected hate messages to identify hate spreaders whose new messages are used to discover new hate codes.”

The smart insight is working out which words correlate with others, thereby discovering when a stand-in word is being used for something else by adding context. Sure, these can be changed as well, but there’s only so many words a troll can change before rendering their original statement totally unintelligible.

In all, it’s a very smart use of machine learning. Yes, the boundaries about what it’s OK to say online are still being drawn — and are best worked out by private individuals and companies, not algorithms. But when it comes to stopping people from being confronted with hateful rhetoric online, tools like this go way beyond simple keyword searches.

Next up for the project? “We hope to get more data to make our model more robust and accurate,” Luo continued. “Ultimately, we hope the leading social media platforms such as Twitter, Facebook and so on can adopt our technology, which is described in this paper, and likely will be further developed for higher accuracy to clean up social media. It is our ongoing effort to use data science for social good.”

Mobile

Here Technologies’ cellular map can tell when you’ll lose coverage on the road

Here Technologies' wants to make it a little easier for companies to know where cellular coverage is available on the roads. The company has announced a new coverage map that offers data about road coverage.
Mobile

The 2-year-old Nokia 6 is now being updated to Android Pie

Android 9.0 Pie has been released. But is your phone getting Android 9.0 Pie, and if so, when? We've done the hard work and asked every device manufacturer to see when their devices would be getting the update.
Deals

Here are 20 portable tech gadgets you’ll want to use every day

If you're looking for portable tech to keep you charged up while on the go (or for some great small gift ideas), we've rounded up 20 must-have gadgets. You'll find everything from a mini gaming controller to a folding Bluetooth keyboard.
Digital Trends Live

Digital Trends Live: Amazon HQ, Guy Kawasaki, and when to buy a streaming stick

On Thursday's episode of Digital Trends Live, we discussed trending headlines like the latest news surrounding Amazon's new HQ plans to the Mars rover Opportunity. We also sat down with author and entrepreneur Guy Kawasaki to talk about his…
Emerging Tech

‘Guerrilla rainstorm’ warning system aims to prevent soakings, or worse

Japanese researchers have created a "guerrilla rainstorm" early-warning system aimed at preventing severe soakings, or worse. The team hopes to launch the system before the 2020 Tokyo Olympics.
Mobile

Barbie’s Corvette ain’t got nothing on Sphero’s fully programmable robot car

Sphero is known for devices like the Sphero Bolt and BB-8 Star Wars toy, but now the company is back with another addition to its lineup -- the Sphero RVR. The RVR is a fully programmable robot car that can be expanding with different…
Emerging Tech

We tried a $500 electronic dab rig, and now we can’t go back to normal vaporizers

Induction heating is the future of cannabis vaporizers. Loto Labs wowed us with what likely is the best concentrate vaporizer on the market today. With a $500 price tag, it's expensive, but it should definitely be your next dab rig.
Emerging Tech

Japanese spacecraft will collect a sample from asteroid Ryugu by shooting at it

The Japanese spacecraft Hayabusa 2 will soon touch down on the asteroid Ryugu, where it will collect a sample by shooting a bullet into the soil. The sample will be returned to Earth in 2020 to learn about the formation of asteroids.
Emerging Tech

Hong Kong’s vision for a smart prison is a full-blown Orwellian nightmare

Hong Kong wants to bring prisons up to date by introducing new location-tracking wristbands for inmates, and a robot arm whose job is to comb through poop on the lookout for contraband.
Emerging Tech

No faking! Doctors can now objectively measure how much pain you’re in

Researchers at Indiana University School of Medicine have discovered the blood biomarkers that can objectively reveal just how much pain a patient is in. Here's why that's so important.
Emerging Tech

SeaBubbles’ new electric hydrofoil boat is the aquatic equivalent of a Tesla

What do you get if you combine a Tesla, a flying car, and a sleek boat? Probably something a bit like SeaBubbles, the French "flying" boat startup which offers a fresh spin on the hydrofoil.
Emerging Tech

Israel will launch world’s first privately funded moon mission tomorrow

This week will see the world's first privately funded lunar mission launch. Israel's first mission to the moon will be launched aboard SpaceX's Falcon 9 rocket on Thursday, February 21.
Emerging Tech

FDA warns about the dangers of anti-aging blood transfusions

It turns out injecting old people with blood from healthy youngsters may not be the answer to health rejuvenation. That’s according to the FDA, which says such claims are dangerous junk science.
Emerging Tech

Here’s where to watch this week’s SpaceX launch from Cape Canaveral

If you've been following the SpaceX launch calendar, you know this week marks the first launch from Cape Canaveral in two months. We have the details on where you can watch the launch live.