As AR heads to Google search, Lens learns to translate, add tips, and more

google lens updates io 2019 sn104297
Riley Young/Digital Trends

Computer vision puts the camera to use when you’re at a loss for words — but Google Lens can soon do more than just reverse search for similar items or details about what’s in that photo. During I/O on Tuesday, May 7, Google demonstrated new search capabilities powered by the camera and expanded Lens skills for calculating tips, translating text, and more.

During the keynote, Aparna Chennapragada, Google’s vice president for the camera and augmented reality products, demonstrated how Google’s search results can use AR to bring 3D models into the room with you, without leaving the search results. A new “view in 3D button” pops up in the search results whenever 3D content is available.

Besides allowing users to look around the 3D object from every angle, the update will also bring that 3D item into AR, mixing the model with the content from your camera to see the object in front of you. Chennapragada says the tool will be helpful for tasks such as research along with shopping.

The camera feature for search is expected to arrive later in May. Partners like NASA, New Balance, Samsung, Target, Visible Body, Volvo, Wayfair, and others will be among the first to have their 3D content pop up in the search results.

As search becomes more camera-heavy, Google Lens is moving beyond simply searching with a camera. At a restaurant, Lens can soon scan the menu, highlight the most popular dishes, bring up photos and even highlight reviews from other diners using Google Maps. The camera first has to differentiate between the different menu options before matching the text with relevant results online. At the end of the meal, Lens will calculate the tip or split the bill with friends when pointing the camera at the receipt.

Google Lens is also gaining the ability to verbally translate text. While earlier versions could use Smart Text to highlight text to copy or translate, Lens can soon read the text out loud or overlay the translated text over the original image in more than 100 languages. Alternately, Lens can also use text-to-speech in the original language, a feature that could be helpful for those with vision or reading difficulty.

The text-to-speech feature is launching first inside Google Go, a lightweight app designed for new smartphone users. Chennapragada says that the team managed to fit those languages onto just over 100KB of space, allowing the app to run on budget phones.

“Seeing is often understanding,” Chennapragada said. “With computer vision and AR, the camera is turning into a powerful visual tool to understand the world around you.”

Lens will also gain a handful of new features as part of partnerships. Readers of Bon Appetit, for example, can scan a recipe page to see a video of the dish being created. In June, Lens will uncover hidden details about paintings at San Fransisco’s de Young Museum.

The updates join a growing list of features for Google Lens like the ability to look up the artist behind a piece of artwork, shop for similar styles, or find the name of that flower you spotted. Google Lens, which has now been used more than a billion times, is available inside Google Assistant, Photos, and directly in the native camera app on a number of Android devices.

Mobile

You can't fool us -- this is definitely the Moschino Honor 20 Pro phone

Honor has launched the Honor 20 Pro and the Honor 20 at an event that took place in London. The new smartphone is surprisingly compact, with an impressive four-lens camera for taking stunning shots, day or night.
Mobile

The world can be your oyster with a little help from the best travel apps around

Traveling doesn't need to be a time-consuming nuisance. Our handpicked selection of the best travel apps will keep things simple, whether you need cost comparisons for hotels or directions to renowned eateries.
Mobile

Cardinal red Galaxy S10 doesn't appear destined for the U.S.

Samsung 2019 flagship smartphone lineup is here, and there aren't just two phones as usual — there are four. There's the Galaxy S10, S10 Plus, as well as a new entry called the S10e, as well as the Galaxy S10 5G.
Mobile

Motorola One Vision vs. Nokia 7.1: Which is the best budget phone for you?

If you're trying to decide whether the Motorola One Vision or the Nokia 7.1 would be a better buy, then we've got you covered with this comparison. Find out exactly what sets these Android phones apart and which is best for you.
Photography

The best Nikon cameras, from DSLRs to superzooms

After reviewing dozens of Nikon cameras, we've rounded up the top models from the mighty D850 to the 125x-zoom P1000. These are the best Nikons you can buy right now.
Social Media

Be the master of your own Insta-verse with multiple Instagram accounts

Whether you own a small business or have separate Instagram accounts for your five cats, we'll walk you through the process of switching between your multiple accounts on your Apple or Android devices.
Emerging Tech

Awesome Tech You Can’t Buy Yet: Insect drones and kinetic sculpture robots

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it's fun to gawk!
Mobile

Treat your selfie with one of these 13 apps made to beautify your pics

Selfies might be a phenomenon second only to karaoke, but they're not the easiest thing in the world to create. Thankfully, these awesome selfie apps for Android and iOS will make beautifying your self-portraits easier than capturing them.
Deals

The best budget-friendly GoPro alternatives that won’t leave you broke

Cold weather is here, and a good action camera is the perfect way to record all your adventures. You don't need to shell out the big bucks for a GoPro: Check out these great GoPro alternatives, including some 4K cameras, that won’t leave…
Photography

Peak Design’s Travel Tripod is must-have gear for photographers on the go

Peak Design has returned to Kickstarter to launch its latest product, the Travel Tripod. The company's first tripod, it uses a unique design with a triangular center column to minimize the volume it takes up in your bag.
Photography

What are mirrorless cameras and are they better than DSLR cameras?

What exactly is a mirrorless camera, and what makes them so special? In this article, we break down the specifics of mirrorless cameras, including how they differ from the likes of a DSLR camera, and what kind of pros and cons are.
Photography

What is ISO? A camera's sensitivity to light -- and how to use it -- explained

Curious what ISO is and how it affects your photos? Here's everything you need to know about the fundamental camera setting, including how it impacts exposure and how to properly adjust it for certain scenarios.
Photography

Olympus launches Tough TG-6 waterproof compact, and we’re not entirely sure why

With a spec sheet nearly identical to that of its predecessor, we're having a hard time figuring out what's new about the Olympus Tough TG-6. A new flash diffuser and fisheye adapter were also announced.
Photography

Adobe Premiere Rush now allows Android users to edit video without the laptop

After launching on desktop and iOS, Adobe Premiere Rush, a streamlined video editor, is now available on Android. Premiere Rush is designed for social media projects and non-professional editors.