Skip to main content

The ‘Look and Talk’ feature means you don’t have to say ‘Hey Google’

How many times do you have to say, “Hey, Google” on a day-to-day basis? During the Google I/O event, the company announced two new features: “Look and Talk” and expanded “Quick Phrases.”

Look and Talk lets you look directly at your Nest device and ask it a question without using the hotword. You can opt in to this feature, and once you do, all processing is done on-device. This means that Google — or anyone else, for that matter — won’t see your face or hear your commands.

Related Videos

So how does it work, exactly? Google uses six different machine learning models to distinguish a passing glance from sustained eye contact. If you’re asking multiple questions, this is a great solution. The example that Google gave was, “Show me beaches near Santa Cruz,” with follow-up questions about specific answers.

Google Nest Hub 2nd Gen on table.
John Velasco / Digital Trends

The next is Quick Phrases, a list of questions that Google can respond to immediately without the hotword. These include common commands like setting a timer, pausing the music, and more.

Powering all of these upgrades are new speech models that run on the device itself to make it faster. More comprehensive neural networks can better understand human speech, even if it’s broken and choppy. In the example, Google Assistant gave the speaker a gentle nudge to finish their question but was able to distinguish what the speaker wanted even with incomplete information. Google says the Tensor Chip is the driving force behind this update, providing the necessary computing power to make on-device speech processing a possibility.

For more news about Google I/O 2022, check here.

Editors' Recommendations

What we want to see from Google’s fall event
google fall event 2022 smart home predictions made by

The next big Google event is slated for October 6, when the Made by Google livestream kicks off at 10 a.m. ET. Much of the hype surrounding the event is for the upcoming Pixel 7 and Pixel 7 Pro, but a few leaks and rumors have given us hope that there’ll be some big smart home announcements mixed in with the litany of smartphone reveals.

From confirmed reveals, early leaks, and everything in between, here are some smart home announcements we hope to see during Google’s October event.
Reworked Nest Doorbell

Read more
Roundup of pets messing with Google and Alexa
A dog and his human companions surrounding the Petcube Bites 2.

Pets are part of our smart homes, too, and it’s no surprise that they can get involved in how our smart tech works. That can lead to surprising results, especially with our voice assistants and smart displays, like those from Google and Amazon. While pets have their own smart devices that are made for special types of interaction, the funniest moments are often when they start noticing controls that are meant for humans. Here’s some of the situations we’re talking about!
Parrots learning how to order from Alexa
@maxtheafricangrey2000♬ original sound - Max Franklin

There are many cases of parrots, especially African Grey parrots, learning to talk to Alexa and experimenting with the responses they get. They even order food and other items. It’s incredible the way they learn to imitate their owners to get a specific result, and Alexa’s predictive algorithms make it all too easy to add items to a shopping list or an Amazon order.

Read more
Can your smart home save you money on homeowners insurance?
Nest devices grouped together on a counter.

Smart home devices provide more than just convenient assistance -- they also help us complete tasks more efficiently and protect our homes. And now, they may actually be able to save you money on your homeowner's insurance.

Homeowners insurance protects or aids you if an incident happens. Yet the best days are when nothing goes wrong, and life is easy for everyone. Smart home devices can be your first line of defense against things that could cause your home harm.

Read more