Skip to main content

Google Now on Tap gains text translation, bar code scanning features

google now fantastic beasts googlenow head
Image used with permission by copyright holder
Android’s Now on Tap feature, Google’s melding of image recognition and machine learning in an app, was, at least at first, a lot more impressive in theory than in practice. Sure, you could use it to pull up showtimes for that movie you saw mentioned on Twitter or summon a list of song titles for that Queen album your friend texted, but that was the extent of it. In the intervening months, though, Now on Tap has become much more capable — and useful.

In December, it gained the ability to track package and flight info. In June, it picked up support for image searches straight from your phone’s camera — you can take a picture of a painting or monument and Google will do its darnedest to identify it. And on Wednesday, Now on Tap received one of its biggest updates to date: instant text translation, a new Discover section, and support for QR code and bar codes.

Text translation is perhaps the most welcome addition. After Wednesday’s update, Now on Tap will have the linguistic chops to recognize multiple languages within Chrome, Hangouts, Snapchat, or any other app you might find yourself using, Google Search product manager Aneto Okonkwo said in a blog post. It works a bit like Google Translate’s Tap to Translate feature: Press and tap the home button to summon Now on Tap, and then select the “Translate this screen” option. Unlike Tap to Translate, though, Now on Tap doesn’t require you to highlight text — instead, it automatically parses the words and phrases for you. It supports translation of a handful of languages at launch, including English, French, German, Spanish, Russian, Portuguese, Italian, with more to join down the line.

Now on Tap’s other cool, new trick involves those familiar square graphics you’ve probably spotted on the sides of buildings, billboards, and bus stop banner ads: QR codes. Now on Tap can now extract whatever digital content (i.e., website link or photo) is hiding behind those opaque, monolithic black-and-white boxes. It’s a three-step process: launch your phone’s camera application, and, while centering the QR code in your viewfinder, simultaneously launch Now on Tap.

BlogSpot_v2_garciarobert (1)
Image used with permission by copyright holder

In addition, Now on Tap can now decipher the sorts of everyday bar codes you might encounter in a supermarket or convenience store. Scan a book’s code and you’ll get information about its publisher and author, or scan a bag of chips and you might get nutritional information. It’ll work on “packaged products, books, DVDs, and more,” Okonkwo said.

Finally, Now on Tap has gained a new section, Discover, that is intended to “help you learn more about things that interest you.” Basically, if you find yourself in the mood for internet dumpster diving, Discover will show you content tangentially related to the article, email, or conversation that is on your screen. If you’re reading an article about Jupiter, for instance, you’ll see relevant YouTube videos, photos, and news articles.

If a few of Now on Tap’s features sound a bit familiar, that is because many of them tread old ground. Google’s Goggles app, the search giant’s artificially intelligent camera app for Android and iOS, can also translate text, and recognize bar codes and QR codes. But the app’s unceremonious abandonment — Goggles hasn’t been updated since May 2014 — is perhaps a sign that Now on Tap will pick up the machine learning torch where it left off.

The update is rolling out to all users gradually, Okonkwo said. If you have the latest version of the Google app installed, you should see it shortly.

Editors' Recommendations

Kyle Wiggers
Former Digital Trends Contributor
Kyle Wiggers is a writer, Web designer, and podcaster with an acute interest in all things tech. When not reviewing gadgets…
Visible just made its unlimited 5G plan better than ever
Visible wireless phones and plans featured

Digital wireless service provider Visible has announced upgrades to its premium Visible+ phone plan. The highlight is a new Global Pass feature that allows Visible customers to use their phones in 140 countries worldwide.

The Visible Global Pass offers unlimited talk and text services, along with 2GB of high-speed data, for a flat rate of $10 per day. Visible+ members can also enjoy a free Global Pass usage day every month. The activation process can be done through the Visible app.

Read more
The OnePlus Watch 2 is the Wear OS smartwatch I’ve been waiting for
Person wearing OnePlus Watch 2 with a green strap on their left wrist.

The OnePlus Watch 2 -- the company's first Wear OS watch -- has entered a market that Samsung dominates. However, OnePlus' popularity as a smartphone brand can be expected to bring small, yet meaningful changes that benefit not only OnePlus users, but all of the Wear OS segment in general.

For almost a decade, Samsung and Apple have predominantly been the default options if you want a smartwatch that is actually useful and goes beyond flashy features. With Samsung shifting gears and migrating from its own Tizen OS to the (relatively) more universal Wear OS platform and Google releasing its own Pixel Watch after struggling with an identity crisis in the smartwatch world, the platform has much more traction than it did a few years ago. As OnePlus carves its way into the segment, it has the opportunity to entice people who don't wish to live within Samsung's limitations when using a Galaxy Watch with another brand's phone.

Read more
Buying an iPad Mini today? You need to know about this deal
The Apple Pencil attaches to the iPad mini magnetically.

If you've had an eye on iPad deals for the latest model of the Apple iPad Mini for a while now, this may be the offer that you've been waiting for -- a $100 discount from Best Buy on the tablet's Wi-Fi, 64GB model, slashing its price to $400 from $500. It's still pretty popular years after its release, so we don't expect stocks of the device for this sale to last long. If you're thinking about taking advantage of this bargain, you better push through with your purchase as soon as possible to make sure that you don't miss out on the savings.

Why you should buy the Apple iPad Mini 2021
The latest generation of the Apple iPad Mini was released in 2021, but it's still featured in our roundup of the best iPads because it's the model that you should buy if you want a smaller and more compact version of Apple's tablets. Its 8.3-inch Liquid Retina display is smaller than the screens of its peers, but it's still big enough to enjoy watching streaming shows and browsing websites, while allowing you to use the device with one hand. Unlike its predecessor, there's no Home button, so the Touch ID sensor is instead built into the power button at the side of the Apple iPad Mini 2021.

Read more