Skip to main content

Google Lens now works with videos, and it’s super impressive

Google Gemini on smartphone.
Google

Google just showed off a new Google Lens video search feature at Google I/O 2024. With it, you can do a Google search just by recording a video with your phone.

In a stage demo showing off the feature, Google’s Rose Yao is troubleshooting some issues she’s having with a record player she recently bought. She doesn’t know what make or model it is, and the needle won’t stay on the record when it’s playing. She has no idea where to start. With the new Google Lens video search, just taking a short video and uploading it allows her to search for an answer.

Rose Yao on Google I/O 2024 stage.
Google

Previously, Google Lens only captured still images, but now you can ask your question using video and audio. The Google Lens video search uses multimodal input, which is a big focus for Google Search right now. Once the video is uploaded, it is broken down frame by frame.

So, in the record player problem example, Google Search was able to identify the specific record player in question and then combed through the internet to find relevant information on how to fix the issue of the needle not working properly. This information then goes into the AI Overview and gives step-by-step troubleshooting tips.

Google Gemini on iOS and Android.
Google

During the event, Google also showed off Google Astra, which is a generative AI with vision, text, and speech capabilities that uses your smartphone camera to make sense of the world around you. Google AI overviews will be rolling out to everyone in the U.S. starting today.

Editors' Recommendations

Christine Romero-Chan
Christine Romero-Chan has been writing about technology, specifically Apple, for over a decade. She graduated from California…
Wear OS 5 is the future of Android smartwatches. Here’s what’s new
A person wearing the Google Pixel Watch 2.

With the Google I/O 2024 opening keynote having come and gone yesterday, showcasing Google’s various AI initiatives with Gemini AI and more, news about the Wear OS took second fiddle -- until now. After revealing that Wear OS grew its user base by 40% in 2023, Google has just announced Wear OS 5, along with a slew of new watch face updates and health-tracking features.

Here’s what’s new.
Wear OS 5

Read more
The 4 biggest things Google didn’t announce at Google I/O 2024
A photo of Sundar at the Google I/O 2024 keynote.

Google’s big keynote at its I/O 2024 developer conference was mostly focused on Gemini, its AI tool. There are big changes coming to Google Search, Google Photos, Google Workspaces, Android 15, and more, as expected.

If you were expecting more from the Google I/O keynote that didn’t involve Gemini AI, then you may be disappointed. There were no hardware announcements, though there was a possible tease of something in the future.

Read more
Watch Google’s 10-minute recap of its AI-filled I/O keynote
The stage for Google I/O 2024.

Google unveiled a slew of generative-AI goodies at its annual I/O event on Tuesday during a packed keynote that lasted almost two hours.

If you couldn’t watch it at the time, or really don’t want to sit through all 110 minutes of it on Google’s YouTube channel, the web giant has kindly shared a video that compresses the best bits of the event into a mere 10 minutes. You can watch it below:

Read more