Researchers teach computer to understand dialects by reading Twitter

Computers don’t harbor the more problematic prejudices that are unfortunately still found in parts of society, but that isn’t to say they’re without their faults. One task machines frequently prove less adept at is understanding other dialects, such as an English language dialect considered to originate in some African-American communities. (Researchers term the dialect “African-American English,” which we realize may be regarded as inaccurate by African Americans who don’t share it.) Now, researchers are training AI to recognize and use this dialect.

When it comes to why computers are less good at understanding some dialects than others, there is a logical reason: computer scientists who have spent the past 30 years teaching machines to read have frequently used readily available data, such as back issues of the Wall Street Journal, to carry out the training. Such formal written language has rendered many natural language processing (NLP) systems less adept at understanding language which doesn’t conform to a very specific type.

“If you think about traditional media that have existed for a long time — things like books or, more recently, newspapers — you’re seeing a very standardized dialect of language, associated with elite education and the like,” Brendan O’Connor, a natural language processing expert at the University of Massachusetts Amherst, told Digital Trends. “That’s not specific to English: you see it in every language in the world.”

As O’Connor noted, this no longer has to be the case. The internet — and particularly social media — has opened up a rich data-stream of different dialects which can be used to train the next wave of NLP systems. In a new paper, O’Connor and other researchers created the largest dataset for studying African-American English from online communication, composed of 59 million tweets from 2.8 million users.

“The African-American English dialect has … millions of speakers and is different from standard English in several interesting ways,” O’Connor said. “It’s different enough that our artificial intelligence tools — which are designed for standardized English — perform worse with them; they’re less intelligent at understanding that dialect. African-American English is often incorrectly characterized as ‘not English’ by current classifiers.”

For their paper, O’Connor and his colleagues showed that properly fine-tuned NLP systems are capable of understanding African-American English. The authors plan to release their new model in the next year to better identify English written in this dialect.

“The future next step is to make systems that can do deeper analysis of sentences that are written in different types of English dialects,” he said. “Embracing linguistic diversity is certainly something that needs to be focused on. We highlight the importance of engineering systems that are better at handling different forms of dialect.”

Because, ultimately, making AI systems that can understand everyone equally will be the best possible outcome for all.

Emerging Tech

The U.S. Army is building a giant VR battlefield to train soldiers virtually

Imagine if the U.S. Army was able to rehearse battlezone scenarios dozens, or even hundreds, or times before settling foot on actual terrain. Thanks to virtual reality, that's now a possibility.

Nvidia’s A.I. Playground lets you edit photos, experience deep learning research

Nvidia is making it easier to access information on deep learning research. It has launched an online space with three demos for image editing, styling, as well as photorealistic image synthesis. 
Emerging Tech

A.I.-generated text is supercharging fake news. This is how we fight back

A new A.I. tool is reportedly able to spot passages of text written by algorithm. Here's why similar systems might prove essential in a world of fake news created by smart machines.
Movies & TV

Stay inside this winter with the best shows on Hulu, including 'Legion'

It's often overwhelming to navigate Hulu's robust library of TV shows. To help, we put together a list of the best shows on Hulu, whether you're into frenetic cartoons, intelligent dramas, or anything in between.

British Airways’ new Club Suite for business class comes with a door

British Airways is going after a bigger slice of the business class market with the imminent launch of the Club Suite. The plush seating option offers a more private space as well as an easier route to the bathroom.
Smart Home

Sony’s Aibo robot dog can now patrol your home for persons of interest

Sony released the all-new Aibo in the U.S. around nine months ago, and since then the robot dog has (hopefully) been melting owners' hearts with its cute looks and clever tricks. Now it has a new one up its sleeve.
Emerging Tech

Inflating smart pills could be a painless alternative to injections

Could an inflating pill containing hidden microneedles replace painful injections? The creators of the RaniPill robotic capsule think so — and they have the human trials to prove it.
Emerging Tech

A silver bullet is being aimed at the drug-resistant superbugs on the ISS

A bacteria which is benign here on Earth can mutate into a drug-resistant superbug once it enters space. Now this problem is being tackled by a team of microbiologists who have found a way to inhibit the spread of bacteria in the ISS.
Emerging Tech

Tombot is the hyper-realistic dog robot that puts Spot to shame

Forget Boston Dynamics’ Spot! When it comes to robot dogs, the folks behind a new Kickstarter campaign have plans to stake their claim as makers of man’s (and woman’s) newest best friend.
Emerging Tech

Researchers gave alligators headphones and ketamine, and all for a good cause

Researchers in Germany and the United States recently gave ketamine and earphones to alligators to monitor how they process sounds. Here's what it reveals about alligator evolution.
Emerging Tech

Cheese tastes different when it listens to Led Zeppelin, Swiss study finds

A funky new study says that exposing cheese to music changes its aroma and flavor. What’s more, the genre of music matters. Researchers from the Bern University of Arts played music to nine, 22-pound wheels of Emmental cheese.
Emerging Tech

Astronomers plan to beam Earth’s greatest hits into deep space, and you can help

A new project from the SETI Institute (search for extraterrestrial intelligence) will give the public the chance to submit compositions to be beamed into space, with the aim of connecting people around the world through music.
Emerging Tech

Twitter is officially a teenager now. Are we raising a monster?

On March 21, 2006, Jack Dorsey sent the first ever tweet. Thirteen years later, Twitter has fundamentally changed the way we communicate. Here are some of the myriad ways it's done that.
Emerging Tech

Scientists have a way to turn off alcoholism: Blasting the brain with lasers

Researchers from Scripps Research have demonstrated that it is possible to reverse the desire to drink in alcohol-dependent rats by targeting a part of the brain using lasers. Here's how.