Skip to main content

You can now augment Google Lens photo searches with text

Google is looking to improve its search results by leveraging both the power of photos, along with additional text for context. The new experience is called multisearch, which will be available on phones and tablets as part of Google Lens inside the Google app.

Google says the feature combines visual and word searches together to deliver the best results possible, even when you can’t describe exactly what it is that you’re trying to search for.

Five screenshots that show how to search in Google using multiple elements.
Image used with permission by copyright holder

“At Google, we’re always dreaming up new ways to help you uncover the information you’re looking for — no matter how tricky it might be to express what you need,” Google explained of the new multisearch feature. “That’s why today, we’re introducing an entirely new way to search: Using text and images at the same time. With multisearch in Lens, you can go beyond the search box and ask questions about what you see.”

Recommended Videos

A practical example of where multisearch will be useful is online shopping. Fashionistas may like a particular style of dress but may not know what that style is called. In addition, rather than shopping from a catalog with that particular dress available in a specific color, by leveraging the power of multisearch, you can snap a picture of the dress and search for the color green or orange. Google will even suggest similar alternatives in the colors you want.

Please enable Javascript to view this content

“All this is made possible by our latest advancements in artificial intelligence.”

In this sense, multisearch extends the Google Lens experience by not only identifying what you see but by entering additional search text — like the color green — your search becomes more meaningful.

“All this is made possible by our latest advancements in artificial intelligence, which is making it easier to understand the world around you in more natural and intuitive ways,” Google explained the technology powering multisearch. “We’re also exploring ways in which this feature might be enhanced by MUM — our latest AI model in Search — to improve results for all the questions you could imagine asking.”

To begin your multisearch experience, you’ll need the Google app, which can be downloaded as a free app on iOS and Android devices. After you download the app, launch it, tap on the Lens icon, which resembles a camera, and snap a picture or upload one from your camera roll to begin your search. Next, you’ll want to swipe up and click on the plus (+) icon to add to your search.

Some ways to use this new multisearch tool include snapping a picture of your dining set and adding the “coffee table” term to your search to find matching tables online, or capturing an image of your rosemary plant and adding the term “care instruction” to your search to find out how to plant and care for rosemary, Google said.

Multisearch is available now as a beta experience within the Google app. Be sure to keep your Google app updated for the best results.

Chuong Nguyen
Silicon Valley-based technology reporter and Giants baseball fan who splits his time between Northern California and Southern…
Google Photos is getting a cool new feature to speed up your photo edits
Google Photos' year in review feature for 2024.

Google Photos for Android is introducing a new feature that simplifies photo editing right before sharing. A tipster from Android Authority first reported this tool.

The new “Quick Edit” tool lets users easily enhance or crop individual photos before sharing them. It features an “Enhance” button, which functions similarly to the “Enhance” effect in the standard photo-editing options. A crop button is also similar to the one in the regular photo editor. When multiple photos are selected before hitting the share button, the typical share sheet appears instead of the new “Quick Edit” screen.

Read more
You can now try out ChatGPT Search for free
The ChatGPT Search icon on the prompt window

As part of its "12 Days of OpenAI" event, OpenAI has yet another update for ChatGPT, this time bringing its Search feature over to the free tier. The Google Search alternative was previously only for paid subscribers in the ChatGPT Plus or Pro tiers.

"We rolled it out for paid users about two months ago," Kevin Weil, OpenAI's chief product officer, said during Monday's livestream. "I can't imagine ChatGPT without Search now. I use it so often. I'm so excited to bring it to all of you for free starting today."

Read more
5 phones you should buy instead of the Google Pixel 9 Pro Fold
A person holding the open Google Pixel 9 Pro Fold.

This was a big year for Google thanks to the arrival of the Pixel 9 lineup. Not only did we get the return of the XL size, but Google also launched the second generation of its foldable, the Pixel 9 Pro Fold.

Though it was late to the foldable game, Google’s second iteration of a folding phone is a huge improvement over the original Google Pixel Fold. It’s thinner, opens flat without issue, is ergonomic, and has a fantastic inner screen and a redesigned camera module. It just feels great overall.

Read more