Skip to main content

Google Now on Tap gains text translation, bar code scanning features

Android’s Now on Tap feature, Google’s melding of image recognition and machine learning in an app, was, at least at first, a lot more impressive in theory than in practice. Sure, you could use it to pull up showtimes for that movie you saw mentioned on Twitter or summon a list of song titles for that Queen album your friend texted, but that was the extent of it. In the intervening months, though, Now on Tap has become much more capable — and useful.

In December, it gained the ability to track package and flight info. In June, it picked up support for image searches straight from your phone’s camera — you can take a picture of a painting or monument and Google will do its darnedest to identify it. And on Wednesday, Now on Tap received one of its biggest updates to date: instant text translation, a new Discover section, and support for QR code and bar codes.

Recommended Videos

Text translation is perhaps the most welcome addition. After Wednesday’s update, Now on Tap will have the linguistic chops to recognize multiple languages within Chrome, Hangouts, Snapchat, or any other app you might find yourself using, Google Search product manager Aneto Okonkwo said in a blog post. It works a bit like Google Translate’s Tap to Translate feature: Press and tap the home button to summon Now on Tap, and then select the “Translate this screen” option. Unlike Tap to Translate, though, Now on Tap doesn’t require you to highlight text — instead, it automatically parses the words and phrases for you. It supports translation of a handful of languages at launch, including English, French, German, Spanish, Russian, Portuguese, Italian, with more to join down the line.

Now on Tap’s other cool, new trick involves those familiar square graphics you’ve probably spotted on the sides of buildings, billboards, and bus stop banner ads: QR codes. Now on Tap can now extract whatever digital content (i.e., website link or photo) is hiding behind those opaque, monolithic black-and-white boxes. It’s a three-step process: launch your phone’s camera application, and, while centering the QR code in your viewfinder, simultaneously launch Now on Tap.

BlogSpot_v2_garciarobert (1)
Image used with permission by copyright holder

In addition, Now on Tap can now decipher the sorts of everyday bar codes you might encounter in a supermarket or convenience store. Scan a book’s code and you’ll get information about its publisher and author, or scan a bag of chips and you might get nutritional information. It’ll work on “packaged products, books, DVDs, and more,” Okonkwo said.

Finally, Now on Tap has gained a new section, Discover, that is intended to “help you learn more about things that interest you.” Basically, if you find yourself in the mood for internet dumpster diving, Discover will show you content tangentially related to the article, email, or conversation that is on your screen. If you’re reading an article about Jupiter, for instance, you’ll see relevant YouTube videos, photos, and news articles.

If a few of Now on Tap’s features sound a bit familiar, that is because many of them tread old ground. Google’s Goggles app, the search giant’s artificially intelligent camera app for Android and iOS, can also translate text, and recognize bar codes and QR codes. But the app’s unceremonious abandonment — Goggles hasn’t been updated since May 2014 — is perhaps a sign that Now on Tap will pick up the machine learning torch where it left off.

The update is rolling out to all users gradually, Okonkwo said. If you have the latest version of the Google app installed, you should see it shortly.

Kyle Wiggers
Kyle Wiggers is a writer, Web designer, and podcaster with an acute interest in all things tech. When not reviewing gadgets…
Samsung Galaxy Z Flip 7: the upgrade we’ve been waiting for?
Thre Flip 7 models next to each other

I never really thought that I'd want to go down the route of owning a flip phone, ever since I swore off my Nokia in the early 2000s (you know, the one with the weird felt covering and tiny notification window).

Fast forward two decades, and I'm considering rejoining the race, thanks to the Samsung Galaxy Z Flip 7. Coming in at $1,100, it's not cheap, but it's definitely something different compared to the world of black rectangles, and it it feels like Samsung’s Flip family has finally come of age.

Read more
I used the Galaxy Z Fold 7, here’s why I’m completely smitten
The back of the Galaxy Z Fold 7

We’ve waited several years for Samsung to join the party, but it’s finally here: Samsung has followed rivals like Oppo, OnePlus, and Honor in building a thinner, lighter, and sleeker Galaxy Z Fold 7. It’s an impressive feat of engineering and a major upgrade over previous years.

It’s easy to consider the Fold 7 nothing more than an update to the Galaxy Z Fold 6, but in many ways, it feels like a huge step forward, not just for Samsung but for all folding phones. I spent a few hours with the Galaxy Z Fold 7 in an exclusive preview, and here’s why I absolutely love what Samsung has done this year.

Read more
I tried the Samsung Galaxy Watch 8 series – they’re sleek, but with a lot to prove
Watch 8 on a wrist

Trying out the Samsung Galaxy Watch 8 and Watch 8 Classic is a tough gig - not in terms of it being a hardship to try out two high-end models, but that it's impossible to assess them with only 30 minutes’ use.

I can easily talk about the improved design and the fit of the straps etc, but the real changes are within the health ecosystem, and they'll need sustained testing to really understand if they're any good.

Read more