Skip to main content

I talked to Google Translate in three languages and it knew what I meant

One of the most distressing things about being American is the inability to understand or speak more than one language. Anyone who travels runs into language barriers at every turn. Menus, signs, maps, and food products are all written in the foreign language, and in certain countries, it can be hard to find an English speaker to translate for you. It’s stressful! Luckily, Google has been working to solve this problem. In fact, the latest version of Google Translate makes it easier than ever to be monolingual.

I tested out the latest version of Translate on an Android phone and was amazed with the results. Not only could Google translate photographed text with nearly perfect accuracy, but it also understood me when I spoke to it in three different foreign languages. That’s right — three. I tried Spanish, German, and Swedish on Google Translate, and it not only understood me (slight American accent and all), but translated what I said fairly accurately — most of the time.

Here’s how it works.

Recommended Videos

Snap a picture of a menu to know what you’re eating

Screenshot_2015-01-14-14-43-21
Image used with permission by copyright holder

When you download the latest version of Google Translate, you’ll see the standard option to type text into the field, but you’ll also see a new camera icon and an option to speak as well. You can tap on the photo icon to take pictures of signs, menus, and other texts that are written in a different language. You have to select the language first, though, so if you don’t know if you’re looking at Chinese or Korean characters, you’re out of luck. Regardless, as long as you know the language, you simply select it, take the photo, and Google will scan it for text in that language. Once it’s found the text, you highlight the part you want to translate and Google figures it out.

It’s like magic. I Googled signs in German and Spanish, and threw in a Swedish milk carton for good measure, and Google translated all three effortlessly. Sure, some of the grammar was off — It thought “Atencion, hombres trabajando arriba,” meant “Attention, men working up,” when it really means, “Attention, men working above” — but it sure was close. Google handled the Swedish milk carton really well, and even translated the fat content of the milk.

Google Translate can also handle handwritten text sometimes, if you write in block letters and really, really neatly. Lowercase letters didn’t seem to work, and sometimes Google didn’t register our handwriting as foreign text, so no translation was available.

Talk to Google — It will understand you

The text translation was pretty impressive, as was the voice translation, though it had trouble with longer texts. This is a common failing with translation apps in general, as longer texts follow more complex grammar. Even so, reading a short passage in German to Google resulted in a pretty close translation. Only a few words were wrong, and the expected issues with word order appeared (German word order is quite different from English).

Regardless, you could use the app to ask for directions quite easily. Google will even play back the translated text for the other person to hear. The next time you travel abroad to a country whose language you don’t speak, you can simply whip out your phone and snap a picture of the dessert menu, or press the mic button to record a native speaker’s directions to the Van Gogh Museum.

Google Translate may not have it down perfectly yet, but it’s pretty damn close.

Malarie Gokey
Former Digital Trends Contributor
As DT's Mobile Editor, Malarie runs the Mobile and Wearables sections, which cover smartphones, tablets, smartwatches, and…
Your Google Photos app may soon get a big overhaul. Here’s what it looks like
The Google Photos app running on a Google Pixel 8 Pro.

Google Photos is set to get a long-overdue overhaul that will bring new and improved sharing and notification features to the app. With its automatic backups, easy sorting and search, and album sharing, Google Photos has always been one of the better photo apps, and now it's set to get a whole slew of AI features.

According to an APK teardown done by Android Authority and the leaker AssembleDebug, Google is now set to double down on improving sharing features. Google Photos will get a new social-focused sharing page in version 6.85.0.637477501 for Android devices.

Read more
Google just announced 7 big Android updates. Here’s what’s new
Text editing in Google Messages.

If you have an Android phone or tablet or a Wear OS watch, you should sit up and pay attention. Google has just announced a bundle of new features it's rolling out soon, and from Google Messages updates to a better hotspot experience, there's a lot to dig into.

Earlier this year, Google was spotted testing a new edit feature for its RCS-powered Google Messages app. Well, it has finally made its way to the app with the latest Android feature drop.

Read more
Everything announced at Google I/O 2024
Rose Yao on Google I/O 2024 stage.

Android, Wear OS, and Pixel may be Google's household names, but it was Google Gemini, its emerging AI technology, that stole the limelight at Google I/O 2024. The company's annual software celebration sets the stage for everything the company has planned for the coming year, and this year, CEO Sundar Pichai unambiguously declared that Google is in its "Gemini era." From AI searches in your Google Photos to virtual AI assistants that will work alongside you, Google is baking Gemini into absolutely everything, and the implications are enormous. Here's an overview of everything Google announced this year.
Gemini takeover

Users upload more than 6 billion photos to Google Photos every day, so it's little wonder that we could use a hand sifting through them all. Gemini will be added to Google Photos this summer, adding extra search abilities through the Ask Photos function. For instance, ask it "what's my license plate again" and it'll search through your photos to find the most likely answer, saving you from needing to manually look through your photos to find it yourself.

Read more