Google employs machine learning to boost translation capabilities to near-human level

google ai translate
Malarie Gokey/Digital Trends
No one would accuse Google Translate, the favored tool of unscholarly high school language students everywhere, of being an inaccurate interpreter. The 10-year-old internet interpreter can fluently translate more than 100 tongues, recognize foreign restaurant menus and signage, and differentiate between dialects in real time. But there’s always room for improvement, and in Translate’s case, it’s occurring through machine learning.

The project is called Google Neural Machine Translation, or GNMT, and it isn’t strictly speaking new. It was first employed to improve the efficiency of single-sentence translations, explained Google engineers Quoc V. Le and Mike Schuster, and did so ingesting individual words and phrases before spitting out a translation. But the team discovered that the algorithm was just as effective at handling entire sentences — even reducing errors by as much as 60 percent. And better still, it was able to fine-tune the accuracy over time. “You don’t have to make design choices,” Schuster said. “The system can entirely focus on translation.”

In a whitepaper published on Monday, the Google Brain team detailed the ins and outs of GNMT. Under the hood is long short-term memory, or LSTM, a neural networking technique that works a bit like human memory. Conventional translation algorithms divides a sentence into individual words which are matched to a dictionary, but LSTM-powered systems like Google’s new translation algorithm are able to “remember,” in effect, the beginning of a sentence when they reach the end. Translation is thus tackled bilaterally: GNMT breaks down sequences of words into their syntactical components, and then translates the result into another language.

GNMT’s approach is a boon for translation accuracy, but historically, such methods haven’t been particularly swift. Google, however, has employed a few techniques that dramatically boost interpretation speed.

As Wired explains, neural networks usually involve layered calculations — the results of one feeds into the next — a speed bump which Google’s model mitigates by completing what calculations it can ahead of time. Simultaneously, GNMT leverages the processing boost provided by Google’s specialized, AI-optimized computer chips it began fabricating in May. The end result? The same sentence that once took ten seconds to translate via this LSTM model now takes 300 milliseconds.

And the improvements in translation quality are tangible. In a test of linguistic precision, Google Translate’s old model achieved a score of 3.6 on a scale of 6. GNMT, meanwhile ranked 5.0 — or just below the average human’s score of 5.1.

It’s far from perfect, Schuster wrote. “GNMT can still make significant errors that a human translator would never make, like dropping words … mistranslating proper names or rare terms … and translating sentences in isolation rather than considering the context of the paragraph or page.” And prepping it required a good deal of legwork. Google engineers trained GNMT for about a week on 100 graphics processing units — chips optimized for the sort of parallel computing involved in language translation. But Google is confident the model will improve. “None of this is solved,” Schuster said. “But there is a constant upward tick.”

Google isn’t rolling out GNMT-powered translation broadly, yet — for now, the method will remain relegated to Mandarin Chinese. But the search giant said it’ll begin AI-powered translations of new languages in the coming months.

GNMT may be the newest product of Google’s machine learning experiments, but it’s hardly the first. Earlier this year, AlphaGo, software produced by the company’s DeepMind division, became the first AI in history to beat a human grand master at the ancient game of Go. Earlier this summer, Google debuted DeepDream, a neural network with an uncanny ability to detect faces and patterns in images. And in August, Google partnered with England’s National Health Service and the University College London Hospital to improve treatment techniques for head and neck cancer.

Not all of Google’s artificial intelligence efforts are as high-minded. Google Drive uses machine learning to anticipate the files you’re most likely to need at a given time. Calendar ‘s AI-powered Smart Scheduling suggests meeting times and room preferences based on the calendars of all parties involved. And Docs Explore shows text, images, and other content Google thinks is relevant to the document on which you’re working.

Emerging Tech

A.I.-generated text is supercharging fake news. This is how we fight back

A new A.I. tool is reportedly able to spot passages of text written by algorithm. Here's why similar systems might prove essential in a world of fake news created by smart machines.
Social Media

Your Google+ public content will remain viewable on the web, if you want it to

Google's failed social network — Google+ — will soon be wiped from the internet, but there's a team of volunteers working right now to save its public content for the Internet Archive.

Nintendo Switch controllers will soon be compatible with Google Chrome

Nintendo Switch controllers will soon be supported by Google Chrome, according to a new commit spotted by 9to5Google. The code is likely related to Google's Project Stream game streaming service.

Google Pixel 4 XL: Is this sketch our first look?

The Google Pixel 3 may still be a relatively new device, but already rumors and leaks have started emerging about the Google Pixel 4. Notably, it seems as though Google could add better support for dual SIM cards on the device.

iPad Air vs. iPad Mini: Which new tablet from Apple is best for you?

Apple has unveiled two new iPad models, including a new iPad Air and a new iPad Mini. Both devices have a lot to offer. But which iPad is right for your needs? We put the iPad Air and iPad Mini to the test to find out.

The best Apple AirPods alternatives for Android, Windows, and iOS devices

Apple AirPods, nice as they are, aren't the only game in town. Other makers are offering their own truly wireless earbuds, and if you're looking to buy a pair of high-end in-ear headphones, we've got the best AirPod alternatives on the…

Even older Apple Watches could be effective at spotting heart conditions

The Apple Watch Series 4 is known for detecting heart conditions like atrial fibrillation thanks to having an electrocardiograph feature. It turns out that older Apple Watches could be effective at tracking AFib, too.

The Black Shark 2’s Ludicrous Mode promises the smoothest mobile gaming

Xiaomi-backed Black Shark has a follow-up to last year's Black Shark gaming phone, complete with high specs and a low price. Here's everything we know about the Black Shark 2 gaming phone.

Need a new tablet? Here are the best iPad deals for March 2019

In the wide world of tablets, Apple is still the king. If you're on team Apple and just can't live without iOS, we've curated an up-to-date list of all of the best iPad deals currently available for March 2018.

Amazon drops price on Apple Watch Series 4 with a rare deal

Since Apple first unveiled the Series 4, the price for one has pretty much held fast. This has finally started to change with a nice little $15 discount on Amazon. If you've been wanting the newest Apple Watch, now is a great time.

Sending SMS messages from your PC is easier than you might think

Texting is a fact of life, but what to do when you're in the middle of something on your laptop or just don't have your phone handy? Here's how to send a text message from a computer, whether you prefer to use an email client or Windows 10.

Google's midrange Pixels might be called the Pixel 3a and Pixel 3a XL

The Google Pixel 3 and Pixel 3 XL are considered to be two of the best Android smartphones, but it looks like Google could be prepping a midrange line. Say hello to the Pixel 3a and Pixel 3a XL.

Angry Birds AR: Isle of Pigs brings 3D demolition into your living room

Angry Birds is releasing its next entry in the spring of 2019 - with a new spin. Bringing 3D environments and destruction, Angry Birds AR: Isle of Pigs uses augmented reality to add a new dimension to a classic series.

Whether by the pool or the sea, make a splash with the best waterproof phones

Whether you're looking for a phone you can use in the bath, or you just want that extra peace of mind, waterproof phones are here and they're amazing. Check out our selection of the best ones you can buy.