Pixel 2 owners get the first glimpse of Google Lens computer vision possibilities

Unveiled earlier in 2017 at Google I/O, the first public version of the artificially intelligent computer vision program Google Lens is now part of the new Google Pixel 2. During Wednesday’s October 4 event in San Fransisco, Google shared a preview of Lens that will ship inside the new Pixel 2 smartphone, with integration into both Google Photos and Google Assistant.

Google Lens is the tech giant’s computer vision software that collects information from a photograph to either save some time by skipping the typing or to learn something new about the things that we see around us. The tool effectively mixes Google search with a camera, and while the Pixel 2 only contains a preview of the feature, the platform already creates a few promising shortcuts.

During the event, Google’s Aparna Chennapragada shared how the new feature allows the smartphone’s camera to be used as a sort of keyboard. When taking a photo of something with text, like a flyer, Google Lens allows users to highlight text such as email addresses, phone numbers, websites, and street addresses and copy the information. The shortcut makes it easy to look up a location on Google Maps or call a phone number without typing it into the keyboard.

Besides serving as a visual shortcut to typing in long and unusual email addresses, Google Lens is also designed to help users understand the objects they see — starting with art and entertainment. Snapping a photo of a piece of art will lead to who the artist is and what else they painted. See a movie poster? Lens will tell you if the flick is worth watching or not. Snapping photos of album covers and book covers also lead you to more details on the work.

The preview inside the Pixel 2 is just a start for the computer vision software. When the software was first announced, Google listed a long number of possibilities, including translating text, getting more details on a business, reading Wi-Fi network settings or learning the name of that flower you just spotted.

Google’s computer vision also works with existing photos, powering a number of tools inside the native Google Photos app on the Pixel 2. Searching for specific objects, people and even famous landmarks is possible through the program’s auto-tagging feature.

Google Lens is based on machine learning — Google essentially used those millions of photos in their search results to train the computer to recognize what a specific object looks like. With enough photos, the program can learn to recognize what the Eiffel Tower looks like on a cloudy day, lit up at night or even blurred from camera shake to correctly identify what is in the photo.

Chennapragada said that Google Lens will continue to improve with use. For example, she said, Google’s voice recognition, at first, wouldn’t always recognize speech correctly, particularly with factors like accents. Now, after several years of development, Google voice has a 95 percent accuracy rate.

Google CEO Sudar Pichai said that the object recognition AI built by Google had a 39 percent accuracy rate. Using what’s called AutoML, which is essentially artificial intelligence building more AI programs, that accuracy rate has improved to 43 percent and is continuing to improve.

“This is why we are excited about the shift from mobile first to AI first, it’s radically rethinking how computers work,” Pichai said during the presentation. “Computers should adapt to how people live their life, rather than people adapting to computers.”

Google Lens will first be available in Pixel 2 by tapping the Lens icon inside both Google Photos and Google Assistant.

Emerging Tech

Awesome Tech You Can’t Buy Yet: 1-handed drone control, a pot that stirs itself

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!
Mobile

Get your gaming on the go with this list of the 25 best Android games

The Google Play Store is loaded with both terrific and terrible gaming titles. We vetted the store to bring you some of the best Android games available, whether you're into puzzles, shooters, racing games, or something else.
Smart Home

Google Home Hub vs. Amazon Echo Show

The Google Home Hub vs. Amazon Echo Show: which is better? Both are smart displays that control your smart home, but that's where the similarities end. We compare design, features, price and more to find out which is right for you.
Mobile

Pixel 3's wireless charging has been fixed, but extra notch remains

The Google Pixel 3 and Pixel 3 XL are arguably the best Android phones out there right now -- but they aren't perfect. Users have reported a number of issues and problems related to the Google Pixel 3 and Pixel 3 XL. Here's how to fix them.
Computing

The Pixel Slate is now available for pre-order with a release date of November 22

Google's Slate tablet debuted on October 9. Here's everything you need to know about the Pixel Slate, including important specs, the display, and key features.
Mobile

Our favorite ebook reader is not a Kindle. Here are all the best options

If you're a bookworm, an ebook reader can be an important part of your life, one that allows you to read your books whenever and wherever you like. But which should you get? Here are five of the best ebook readers available.
Product Review

It's so fast it has a clip-on fan. But the Asus ROG phone isn't just for gamers

Is a gaming smartphone only something a mobile gamer should consider buying? In the case of the Asus ROG Phone, the good news is the device is so capable, and a genuinely impressive all-rounder, that everyone should take a closer look…
Mobile

Samsung made a $2,700 flip phone with the brains of a smartphone

The Samsung W2019 is a high-end flip phone that comes with flagship specifications such as 6GB of RAM and Qualcomm's Snapdragon 845. The device features a pair of S-AMOLED displays, a dual rear camera setup, and an eye-popping price tag.
Mobile

Google, Samsung, OnePlus, and Huawei face off in an Android battle royale

The good news is that there are some great options in the Android smartphone market right now. The bad news is that too much choice makes it tough to decide. We compare the Pixel 3 XL, the Galaxy Note 9, the OnePlus 6T, and the Mate 20 Pro.
Mobile

Apple to boost its Amazon presence with listings for iPhones, iPads, and more

Apple is about to start offering more of its kit on Amazon. The tech giant currently only has very limited listings on the shopping site, but the deal will see the arrival of the latest iPhones, iPads, MacBooks, and more.
Mobile

Google’s Gboard now uses A.I. to recommend GIFs based on your conversation

Google is bringing a new feature to Gboard that should make it better for those that regularly use GIFs and stickers. The feature essentially uses A.I. to recommend GIFs and stickers based on your conversation.
Computing

Cloudflare’s privacy-enhancing 1.1.1.1 DNS service comes to iOS and Android

Cloudflare's 1.1.1.1 DNS resolver service has been ported to mobile devices, and now anyone with an Android or iOS device can download it for free to take advantage of its speed and privacy-boosting features.
Deals

The LG V30+ gets a huge price cut on Amazon, today only

Though Amazon early Black Friday deals began at the start of November, the discounts are only just now starting to get good. Today only, Amazon is offering a whopping 40 percent off the unlocked LG V30+.
Mobile

These 100 best iPhone apps will turn your phone into a jack-of-all-trades

The iPhone is the most popular smartphone in the world, and we want to bring out the best in yours. Behold our comprehensive list of the best iPhone apps, from time-saving productivity tools to fun apps you won’t be able to put down.