Google Now on Tap gains text translation, bar code scanning features

google now fantastic beasts googlenow head
Android’s Now on Tap feature, Google’s melding of image recognition and machine learning in an app, was, at least at first, a lot more impressive in theory than in practice. Sure, you could use it to pull up showtimes for that movie you saw mentioned on Twitter or summon a list of song titles for that Queen album your friend texted, but that was the extent of it. In the intervening months, though, Now on Tap has become much more capable — and useful.

In December, it gained the ability to track package and flight info. In June, it picked up support for image searches straight from your phone’s camera — you can take a picture of a painting or monument and Google will do its darnedest to identify it. And on Wednesday, Now on Tap received one of its biggest updates to date: instant text translation, a new Discover section, and support for QR code and bar codes.

Text translation is perhaps the most welcome addition. After Wednesday’s update, Now on Tap will have the linguistic chops to recognize multiple languages within Chrome, Hangouts, Snapchat, or any other app you might find yourself using, Google Search product manager Aneto Okonkwo said in a blog post. It works a bit like Google Translate’s Tap to Translate feature: Press and tap the home button to summon Now on Tap, and then select the “Translate this screen” option. Unlike Tap to Translate, though, Now on Tap doesn’t require you to highlight text — instead, it automatically parses the words and phrases for you. It supports translation of a handful of languages at launch, including English, French, German, Spanish, Russian, Portuguese, Italian, with more to join down the line.

Now on Tap’s other cool, new trick involves those familiar square graphics you’ve probably spotted on the sides of buildings, billboards, and bus stop banner ads: QR codes. Now on Tap can now extract whatever digital content (i.e., website link or photo) is hiding behind those opaque, monolithic black-and-white boxes. It’s a three-step process: launch your phone’s camera application, and, while centering the QR code in your viewfinder, simultaneously launch Now on Tap.

BlogSpot_v2_garciarobert (1)

In addition, Now on Tap can now decipher the sorts of everyday bar codes you might encounter in a supermarket or convenience store. Scan a book’s code and you’ll get information about its publisher and author, or scan a bag of chips and you might get nutritional information. It’ll work on “packaged products, books, DVDs, and more,” Okonkwo said.

Finally, Now on Tap has gained a new section, Discover, that is intended to “help you learn more about things that interest you.” Basically, if you find yourself in the mood for internet dumpster diving, Discover will show you content tangentially related to the article, email, or conversation that is on your screen. If you’re reading an article about Jupiter, for instance, you’ll see relevant YouTube videos, photos, and news articles.

If a few of Now on Tap’s features sound a bit familiar, that is because many of them tread old ground. Google’s Goggles app, the search giant’s artificially intelligent camera app for Android and iOS, can also translate text, and recognize bar codes and QR codes. But the app’s unceremonious abandonment — Goggles hasn’t been updated since May 2014 — is perhaps a sign that Now on Tap will pick up the machine learning torch where it left off.

The update is rolling out to all users gradually, Okonkwo said. If you have the latest version of the Google app installed, you should see it shortly.

Computing

Hitting ‘Check for updates’ in Windows 10 opts you into beta releases

Users who are careful about keeping their system updated should watch out -- Microsoft revealed this week that clicking the Check for updates button in Windows can opt you in to testing beta code.
Computing

Here’s how to install Windows on a Chromebook

If you want to push the functionality of your new Chromebook to another level, and Linux isn't really your deal, you can try installing Windows on a Chromebook. Here's how to do so, just in case you're looking to nab some Windows-only…
Social Media

GIF almost anywhere with Giphy’s new keyboard and sticker maker

We all love GIFs, but not every app supports them. Fortunately, the new Giphy' keyboard brings GIFs to any iOS app that supports multimedia. The update also comes with a new tool for creating animated stickers.
Social Media

Snapchat facial recognition could soon power a new portrait mode, code suggests

Digging into Snapchat's code suggests a handful of upcoming camera features, including a portrait mode. The feature appears to use facial recognition A.I. to blur the background. The code also suggests an updated camera interface.
Mobile

Quirky smartphone accessories you never knew you needed

Looking for a few accoutrements to make your smartphone even better? If you, or someone you know, is a sucker for accessories, you'll want to check out our collection of quirky smartphone accessories you never knew you needed.
Mobile

Ditch your smartphone for a year and win $100k from Vitaminwater

Vitaminwater is willing to part with $100,000 if you're willing to part with your smartphone partner for a year. Could you last for a year armed with only a 1996-era phone? Here's your chance to find out.
Deals

Walmart drops prices on Apple Watches and other fitness trackers

Smartwatches, fitness trackers, and wearable heart rate monitors from Apple, Samsung, Fitbit, and Garmin are popular gifts. Wearables are smarter and more capable than in earlier years. We found the best wearables deals on Walmart.
Music

Here's our head-to-head comparison of Pandora and Spotify

Which music streaming platform is best for you? We pit Spotify versus Pandora, two mighty streaming services with on-demand music and massive catalogs, comparing every facet of the two services to help you decide which is best.
Wearables

The best Wear OS watches

There are a ton of different Wear OS watches out there, but which one's right for you? No matter what you're looking for from a smartwatch, here are the best Wear OS watches out there.
Emerging Tech

Capture app saves money by 3D scanning objects using iPhone’s TrueDepth camera

Capture is a new iPhone app created by the Y Combinator-backed startup Standard Cyborg. It allows anyone to perform 3D scans of objects and share them with buddies. Here's how it works.
Home Theater

How to master your equalizer settings for the perfect sound

You may know what an EQ is, but do you know how to adjust equalizer settings for the best possible sound? We go through the basics of the modern EQ and lay out some guidelines for how to achieve tip-top sound from your system.
Mobile

How to switch from iPhone to Android: The ultimate guide

If you've decided to bridge the great tech divide and leave Apple's walled garden for the unknown shores of Android, then you'll find all the tips and advice you need to begin switching from an iPhone to an Android device.
Smart Home

This device detects when your pet is at the door and opens it for them

Tired of waiting for your dog to come inside, or running home in the middle of the day to let your four-legged friend out? Wayzn automatically opens sliding doors for your dog and gives you remote control.
Mobile

Apple pushing update to iPhone in China in response to legal troubles

Apple has been facing legal issues in China due to alleged infringements of patents from Qualcomm Inc. On Friday, Apple announced it will push a software update in China in hopes of resolving any potential legal issues around the iPhone.