Skip to main content

Google awarded patent for using eye tracking to detect expressions in VR

Google Glass may not have been the smash hit that Google would have wanted, but that doesn’t mean that the company isn’t working on building better augmented and virtual reality technology. In fact, Google was just awarded a patent for a way to track facial expressions through eye-tracking cameras, something that could be significantly helpful in creating immersive VR experiences.

The patent is called “Classifying Facial Expressions Using Eye-Tracking Cameras,” and essentially has to do with using a machine learning algorithm, coupled with eye-tracking sensors, to infer the expressions that users have on their faces. The patent goes on to describe users being able to interact with each other in a virtual world through avatars, which would look like the user, and, with this tech, have their facial expressions, too.

Recommended Videos

As the patent notes, because of the fact that virtual reality headsets tend to obscure the user’s face, it can be difficult to tell what the user’s facial expression is when they’re wearing one. A machine learning algorithm, however, could be trained to learn expressions related to anger, happiness, surprise, and so on. It could also be trained to identify things like the brow lowering, lip raising, and more.

The tech certainly could make augmented and virtual reality more immersive. Virtual reality has started becoming increasingly common with headsets like the HTC Vive, Oculus Rift, and with platforms like Google Daydream. Virtual reality as a whole, however, is seen as still being in its infancy and is likely to go through a ton of development over the next decade or so. One of its biggest problems is that it’s still not quite as immersive as it could be, whether due to low-resolution graphics, slower performance, or that users still aren’t really visually represented in virtual reality experiences just yet. Google’s new tech could especially help the last issue by ensuring that users are visually represented in games and experiences in a way that’s accurate and detailed.

Of course, just because Google has filed a patent that doesn’t mean that it’ll put it to use. The likes of Google and Apple routinely file patents for tech they never use.

Christian de Looper
Christian de Looper is a long-time freelance writer who has covered every facet of the consumer tech and electric vehicle…
OnePlus makes Apple Watch owners jealous with novel charging cable
Apple owners are having to pay a lot more for the privilage
A OnePlus smartwatch being connected to the POGO pin on the OnePlus 2-in-1 charging cable

Update 07/16: we've now included mention of Nomad's 2-in-1 charger for iPhone and Apple Watch

Look, I get it. Charging cables aren't exactly the sexiest product in the tech world and I'd forgive you for rolling your eyes - but OnePlus has introduced a new cable at a price point which makes it way more accessible than rivals.

Read more
Google Pixel 10 launch date confirmed with multiple devices teased
The Pixel 10 launch is just a few weeks away
The Google Pixel 9 Pro Fold, Pixel 9 Pro, and Pixel 9's screens.

Invites have gone out for the Google Pixel 10 launch event, along with a tease that there will be more than one product announced.

Google will hold its Made by Google event on August 20, with the invite reading "you're invited to an in-person Made by Google show where we'll introduce the latest additions to our Pixel portfolio of devices." The event kicks off at 1pm ET, 10am PT.

Read more
This leaked iPhone 17 Pro color has me excited for the iPhone 17 Pro
A close-up of the cameras on the iPhone 16 Pro.

I've been reporting on technology for almost twenty years, and I vividly recall the early years of the smartphone industry when companies like Nokia pushed the boundaries when it came to smartphone colors. 

Rather than the less exciting neutral colors that have become standard in the industry — gray, white, silver, and gold — Nokia launched phones in bright red, yellow, and other vibrant colors. Yes, there were still the same standardized options, but you also had bright neon colors, such as the yellow Lumia 1020 or the orange Nokia N8. 

Read more