Skip to main content

Microsoft wants to stick a sensor close to your eyes to see where you’re looking

Microsoft HoloLens bottom angle
Matt Smith/Digital Trends
As computers become more integrated with our senses through augmented reality (AR) and virtual reality (VR), methods to better track what we’re sensing — or would be seeing in the real world — are becoming more and more important. This technology will also serve to increase accessibility to anyone regardless of physical abilities.

How well a computer can determine what we’re looking at is a highly important factor both in achieving more accurate AR and VR, and in helping those with physical challenges. Apparently, Microsoft has been working on a solution, as MSPU reports.

According to a Microsoft patent application, the company is working on new technology to better track a user’s eye-gaze direction. The purpose, according to the patent, would be to aid users in interacting with a computer to overcome the inability to use a mouse to move a cursor, and to help whenever a user’s hands are otherwise occupied, such as in connection with industrial control, aviation, and emergency room situations. Of course, such technology would also be of use in AR and VR applications.

As MSPU points out, Microsoft’s current premier AR solution, HoloLens, only detects where a user’s head is facing, with a line extending straight out from between the user’s eyes representing the direction of the user’s gaze. The technology outlined in the patent, however, would use a combination of sensors and processors to ascertain where the user’s eyes are actually gazing, independent of head position.


While other systems serving this purpose currently exist, Microsoft characterizes them as costly, complex, requiring excessive power, and bulky. The patent outlines a system that serves to reduce size, complexity, and power requirements while improving accuracy in determining eye movement and direction.


Basically, the system would determine eye-gaze direction relative to the user’s head direction — such as looking left while the user’s head is facing to the right — and would therefore work better for AR and VR applications than would systems that are fixed in space in front of the user. Capacitive sensors would be used that sit close enough in front of the eye to detect the eye’s bulge and would be specifically configured for a user’s physiology. A contact lens with conductive material could also be placed on the eye to enhance the responsiveness of the capacitive sensor.

As always, patents are filed for all sorts of inventions that never see the light of day. If this one makes it through to actual product development, then Microsoft will have created a cost-effective, accurate, and speedy way to sense where you’re looking. That would pay dividends for future AR and VR applications and would also help anyone who faces challenges in using a computer with a traditional keyboard and mouse.

Editors' Recommendations

Mark Coppock
Mark has been a geek since MS-DOS gave way to Windows and the PalmPilot was a thing. He’s translated his love for…
Patent suggests Microsoft’s next HoloLens could tell where you’re looking
patent suggests microsofts next hololens could tell where youre looking alien image

If a patent filing recently uncovered by MSPoweruser is to be believed, Microsoft is at least considering the possibility of eye-tracking tech for head-mounted displays (HMDs). This technology, which uses "wave guides" to track infrared-lit peepers, is an attempt at mitigating some of the compatibility issues experienced with prescription eyewear.

The most painless way eye-tracking is performed is by affixing a camera to the frame of the HMD. Unfortunately, that requires that at least part of your view is hampered by the rig itself. Otherwise, the only other commonly adopted means of eye-tracking is with the help of a partial reflector bending the camera's line of sight directly to your temple.

Read more
EyeMynd is building a virtual reality system you control with your brain
HTC VIVE Best VR Headset

A bit like current-gen wearable devices, no one is disputing that virtual reality has a whole lot of potential -- but is still searching for the perfect control mechanism.

That is a problem that Dan Cook, a former University of California, San Diego, postgraduate in cognitive neuroscience, is hoping to solve. Cook created a company called EyeMynd with the goal of marketing a new type of VR headset -- one that relies not on handheld controllers, but on user brain activity.

Read more
Tobii wants to bring its eye-tracking tech to mobile devices like smartphones
tobii eye tracker

Tobii, the company behind eye-tracking sensors in gaming laptops, desktops, and computer peripherals, wants to bring its tech to mobile. The Stockholm, Sweden-based company announced on Monday plans to raise $50 million to develop a version of its eye-tracking technology compact and power-efficient enough to fit in a smartphone, tablet, or virtual reality headset.

The new round of fundraising is subject to review by the company's shareholders. If approved, Tobii intends to put it toward "substantial investments in technology and market development," a market which it characterized is experiencing historic growth. "The interest for eye-tracking in various consumer application have developed at a substantially more rapid pace than we anticipated at the time," Tobii CEO Henrik Eskilsson said during an address to investors. "At that point, we believed it would take a longer time for eye-tracking to become current for use in smartphones and VR headsets than what see see today."

Read more