Skip to main content

In Google’s new world, your phone camera is for way more than taking photos

If you’re like most people, you probably use your phone’s camera to snap vacation photos, brag about your latest kitchen creations, and obsess over your pets and kids. How cute. If Google has its way, you might as well be using a $3,000 commercial gas range to boil water for mac and cheese.

At Google I/O 2021, the company’s annual developer conference, the software behemoth showed off a range of new apps and tools that treat your smartphone camera less as a humble memory maker, and more as a supercharged tool for interacting with the world around you.

Google Lens allows you to shop and make purchases merely by pointing a camera at your surroundings.

Take three quick shots of those weird red bumps that just emerged on your arm, for instance, and Google has a new tool that will search for matching dermatological conditions. It uses machine learning and a few cues from you (how old are you, how long have you had it?) to identify the likely culprit in seconds.

The steadily improving object recognition in Google Lens has allowed Google to recognize what’s in a photo for years, but advances in machine learning now allow you to do much more than simply ask, “What is this?” Taking a photo of your hiking boots and asking Google “Can I hike Mt. Fuji in these?” is now a quick way to answer a search query that doesn’t exactly lend itself to text. And naturally, Google would be happy to help you buy just about anything you can point a camera at. 

Your camera can do everything from help you shop to help you diagnose a skin condition.

Augmented reality is also moving beyond its cutesy phase of adding hats to video chats, and transforming into a must-have tool. Hold your phone up when you’re on the hunt for a restaurant, for instance, and Google Maps Live View will superimpose directions on top of your camera’s viewfinder. Google introduced this feature to Maps in 2019, but expanded it to more than 100 countries this year, turning it from a proof of concept to a legitimate navigational aid. And now it will work indoors, for when you need to find your airport gate or an urgently needed bubble tea at the mall.

Dermatology diagnosis from Google
Google

In Google’s camera-centric new world, you can even use a photo to transform the entire look of your phone’s operating system. A new feature in Android 12 will analyze the colors in your lock-screen image to generate a custom color palette for everything from backgrounds to buttons in your apps.

Not all of these features are new, but the widening scope of what is possible shows Google’s clear trajectory: A world where your camera is every bit as much an input device as the dusty mouse and keyboard next to your desktop. Just as voice assistants have made it second nature to ask Alexa aloud for calculations, cooking tips, and alarms, Google wants you to reach for your phone camera not just when you want to capture a memory, but when you have a question.

Privacy advocates may wince at giving Google yet another pipeline of precious data to poke and prod, slice and dice. And Google even admitted that some of these shopping technologies aim to “turn the world into your personal showroom.” But the next time your flight leaves in seven minutes and you can’t find your gate, you might not care as you whip open Google Maps to get there.

Editors' Recommendations

Nick Mokey
As Digital Trends’ Managing Editor, Nick Mokey oversees an editorial team delivering definitive reviews, enlightening…
Your phone may make a loud sound today — here’s why
Someone holding an iPhone 14 Pro Max and iPhone 14 Pro next to each other.

Those living or vacationing in the United Kingdom should be ready for a nationwide cell phone alert that's going to happen today and will cause your phone to make a loud noise. The alert, scheduled for Sunday, April 23, is a simple test for the government's emergency alert system, so there's no reason to be alarmed. However, make sure you're ready for it. Otherwise, it might catch you off guard.

Nationwide alarms aren't a new thing; we've seen them used over the years, broadcast across TV and radio stations. But as the world has started relying on smartphones more, emergency alarms have needed to catch up with the technology of the time, hence today's test, which will coincide with some big nationwide events including the London Marathon 2023 and Premier League soccer.

Read more
Your next Samsung phone might ditch Google Search for Bing
The screens on the Galaxy A54 and Galaxy S23 Ultra.

When you buy an Android phone, you expect Google Search to be installed out of the box as the default search engine. But that may not be the case when you buy your next Samsung phone. According to a report over the weekend, Samsung might abandon Google Search in favor of Bing as the default search engine for future Samsung Galaxy phones.

The possibility that Samsung is considering replacing Google Search with Bing on its smartphones sent Google into a "panic," according to the New York Times, Why? As the report explains, "An estimated $3 billion in annual revenue is at stake with the Samsung contract." If Samsung doesn't want to keep using Google for the default search engine on its phones, that's $3 billion per year Google will no longer get. And if Samsung decides it wants Bing instead of Google, who knows how many other companies will follow suit and do the same.
Why Samsung wants Bing over Google

Read more
This rare iPhone just sold for more than a new car
Sealed, 2007 iPhone with a red "Lucky You" sticker on it.

The original iPhone is a hugely important part of mobile phone history, and anyone who has one still in its original packaging might just be sitting on a gold mine if they're willing to part ways with it as this recent seller did.

We've seen a handful of original iPhones selling for ridiculously high prices at auction over the last few months, and the most recent sale of a rare variant indicates that the trend is still going strong.

Read more