Google’s ‘Now on Tap’ lets you run searches in real-time via your camera

google now on tap image search
Google’s Now on Tap just got a whole lot more functional — you can now select specific text to search, and the Marshmallow-only feature can provide results on image searches.

If you haven’t heard of Now on Tap before, that may be because Google hasn’t done a great job of marketing the feature. It’s only available on Android 6.0 Marshmallow devices and above, and is triggered when you press and hold the home button in any app, or on any screen. When you press and hold it for the first time, it will say that you have “discovered” Now on Tap — it’s almost as though Google doesn’t want you to use the feature.

Now on Tap analyzes the information on the screen you trigger it on. For example, assuming a friend messages you plans to meet at a restaurant at a specific time, if you press and hold the home button on that conversation, Now on Tap will offer to create a calendar event with the data provided. You can fill in the rest if it doesn’t have enough.

It’s also essentially a hands-free way to run a Google search based on what you’re looking at — if you come across a mention of Sundar Pichai in a news reader app, triggering Now on Tap will offer up more information about the Google CEO, with links to his Twitter, other social networks, and websites. 

And while it was previously difficult to analyze specific text on a page as Now on Tap would just read everything, Google is now letting you trigger Now on Tap after you highlight a specific word so that it offers more precise information. This is reminiscent of Google Goggles, where you could highlight text after taking a picture to run searches — surprisingly, Google hasn’t killed off that app yet, even though it hasn’t been updated since 2014.

“For example, if you’re reading a news article you can select a specific word, like crustacean, and get a definition and links to relevant apps,” writes Aneto Okonkwo, product manager at Google Search.

If you’re looking at images, you can now use Now on Tap to run image searches for more information. Google offers up the example of looking at a sequoia tree, and tapping and holding Now on Tap. This will bring up information about the Sequoia National Park, and General Sherman — the man that particular sequoia was named after.

Arguably the coolest new feature is the ability to run a Now on Tap search in the camera app in real time. Say you’re looking at the George Washington Bridge and you want more information on it — if you point your smartphone’s camera at the bridge and trigger Now on Tap, it will bring up results in the camera app.

“This works for more than just famous structures like the Bay Bridge, you can even point your camera at a movie poster or magazine and get additional info about what you’re looking at,” Okonkwo says.


No updates are necessary to get these feature, thanks to it just being a server-side switch. They’re available now, but word definitions are only available in English at the moment. Google says it will be rolling out to other languages in the coming weeks.

Photography

Photography News: Instagram’s disappearing likes, the best photos of the year

In this week's Photography News, see why Instagram is testing a version that excludes the number of likes a post gets. Also, see the impressive winners from two photography contests and the latest features coming to the Fujifilm X-T3.
Mobile

Bigger isn’t always better: 5 of the smallest smartphones worth buying

Phones are getting larger and larger, but what options exist for the small-of-hand, or people who just want a phone they can use one-handed? In a world of phablets, some of the smallest smartphones can still pack a punch.
Music

YouTube Red is now YouTube Premium. What's changed, and should you subscribe?

Thanks to Google, YouTube Red is now YouTube Premium. We explain what exactly a YouTube Premium subscription gets you, how much it costs, and break down if it's a good choice for you.
Home Theater

From the Roku Ultra to the Fire TV Cube, these are the best streaming devices

There are more options for media streamers than ever, so it’s difficult to pick the best option. But that’s why we're here. Our curated list of the best streaming devices will get you online in no time.
Mobile

On a budget? We found the best affordable smartphones you can buy

Here are the best affordable phones for anyone working with a tight budget, whether you're a fan of stock Android or marathon battery life. Find out what you can get for under $500 or far, far less as we round up the best budget…
Mobile

Which smartphone has the best camera? We found the sharpest shooters

They say that the best camera is always the one you have with you and that makes your smartphone camera very important indeed. Join us for a closer look at the best camera phones available right now.
Mobile

Step into Childish Gambino’s musical universe with the Pharos AR app

Childish Gambino seems to be on a mission to take over everyone's smartphones. Now you can experience his musical and visual universe through his new Pharos AR app, available on Android now and iOS soon.
Mobile

We tried all the latest and greatest smartphones to find the best of 2019

Smartphones are perhaps the most important and personal piece of tech on the planet. That’s why it’s important to pick the best phone for your individual needs. Here are the best smartphones you can buy.
Mobile

Solve a galaxy of problems with a simple reset of your S10

If your Samsung smartphone is acting up, then you may want to try resetting it. We'll show you how to overcome simple issues with a soft reset and also how to tackle bigger problems or prep it for sale with a factory reset.
Mobile

iFixit's teardown might show the reason the Galaxy Fold keeps breaking

The Samsung Galaxy Fold has arrived, and it goes on sale soon. Folding out from a 4.6-inch display to a tablet-sized 7.3-inch display, this unique device has six cameras, two batteries, and special software to help you use multiple apps.
Mobile

Need a minute to yourself? Buy some alone time with the best tablets for kids

Looking to keep those tiny fingers and brains busy? Tablets aren’t just for grown-ups, and many are kid-friendly! Here's our list of the best tablets for kids, with parental controls and plenty of tempting features to satisfy your…
Mobile

Waze vs. Google Maps: Which map app should you be using?

Waze and Google Maps are two of the most popular apps for those looking for turn-by-turn navigation, yet there are some notable differences to point out. Here, we examine both to decide which offers the best feature set.
Wearables

Before buying a Fitbit, check out these Garmin fitness trackers under $100

The Apple Watch is a great fitness tracker, but it's not cheap. Thankfully, there are plenty of fitness trackers under $100, and they offer many of the same features. Here are the best fitness trackers under $100.
Health & Fitness

Google’s redesigned Fit activity tracker is now an iOS app

Google Fit has landed for iOS. The activity tracker offers the same clean design that arrived with the major revamp of the Android version a year ago, with features such as Move Minutes and Heart Points also included.