Skip to main content

You can now augment Google Lens photo searches with text

Google is looking to improve its search results by leveraging both the power of photos, along with additional text for context. The new experience is called multisearch, which will be available on phones and tablets as part of Google Lens inside the Google app.

Google says the feature combines visual and word searches together to deliver the best results possible, even when you can’t describe exactly what it is that you’re trying to search for.

Five screenshots that show how to search in Google using multiple elements.
Image used with permission by copyright holder

“At Google, we’re always dreaming up new ways to help you uncover the information you’re looking for — no matter how tricky it might be to express what you need,” Google explained of the new multisearch feature. “That’s why today, we’re introducing an entirely new way to search: Using text and images at the same time. With multisearch in Lens, you can go beyond the search box and ask questions about what you see.”

A practical example of where multisearch will be useful is online shopping. Fashionistas may like a particular style of dress but may not know what that style is called. In addition, rather than shopping from a catalog with that particular dress available in a specific color, by leveraging the power of multisearch, you can snap a picture of the dress and search for the color green or orange. Google will even suggest similar alternatives in the colors you want.

“All this is made possible by our latest advancements in artificial intelligence.”

In this sense, multisearch extends the Google Lens experience by not only identifying what you see but by entering additional search text — like the color green — your search becomes more meaningful.

“All this is made possible by our latest advancements in artificial intelligence, which is making it easier to understand the world around you in more natural and intuitive ways,” Google explained the technology powering multisearch. “We’re also exploring ways in which this feature might be enhanced by MUM — our latest AI model in Search — to improve results for all the questions you could imagine asking.”

To begin your multisearch experience, you’ll need the Google app, which can be downloaded as a free app on iOS and Android devices. After you download the app, launch it, tap on the Lens icon, which resembles a camera, and snap a picture or upload one from your camera roll to begin your search. Next, you’ll want to swipe up and click on the plus (+) icon to add to your search.

Some ways to use this new multisearch tool include snapping a picture of your dining set and adding the “coffee table” term to your search to find matching tables online, or capturing an image of your rosemary plant and adding the term “care instruction” to your search to find out how to plant and care for rosemary, Google said.

Multisearch is available now as a beta experience within the Google app. Be sure to keep your Google app updated for the best results.

Editors' Recommendations

Chuong Nguyen
Silicon Valley-based technology reporter and Giants baseball fan who splits his time between Northern California and Southern…
The best photo printers you can buy in 2024
Alan compares draft, standard, and high-quality photos from Epson's EcoTank ET-8500.

A comparison of draft, standard, and high-quality photos from Epson's EcoTank ET-8500. Tracey Truly / Digital Trends

If you love sharing photo prints or building physical photo albums, you might want to upgrade to a photo printer. When manufacturers optimize printers for pictures, the results can match or exceed that of the best printers available.

Read more
Google is going to change Pixel phones forever, and I can’t wait
Google Pixel 8 in white and pink.

Google's Pixel lineup has never been better. Right now, you can find the Google Pixel 8 and Pixel 8 Pro available, as well as its first folding phone, the Google Pixel Fold. And for those who want a budget-friendly option, Google also has the Google Pixel 7a. The phones aren't perfect, but they are among the best Google has ever produced under the Pixel name.

While rumors from last year made us think that the Pixel 7a could be the last of the A-series, that may not actually be the case. We are likely getting a Google Pixel 8a in just a few months, which we expect to be revealed during Google’s I/O conference in May. However, there are whispers that Google may shift away from an annual upgrade cycle for the A-series and instead move to a bi-annual cycle, similar to Apple’s iPhone SE.

Read more
Have one of these Google Pixel phones? You’re getting Circle to Search
Someone holding the Google Pixel 6 Pro and Pixel 6a next to each other.

Circle to Search — Google's excellent search tool that debuted on the Samsung Galaxy S24 earlier this year — is about to become available to more people. Specifically, it's coming to a bunch more Pixel devices, giving even more people a chance to use it for themselves.

As the name implies, Circle to Search allows you to circle or scribble anything on your screen to perform a Google Search for it. It's great for those times you see something on your phone and want to know more about it, but aren't sure how to type out a Google Search for it. It launched on the Galaxy S24, S24 Plus, and S24 Ultra in January and then quickly made its way to the Google Pixel 8 and Pixel 8 Pro.

Read more