Skip to main content

Microsoft wants to stick a sensor close to your eyes to see where you’re looking

Microsoft HoloLens bottom angle
Matt Smith/Digital Trends
As computers become more integrated with our senses through augmented reality (AR) and virtual reality (VR), methods to better track what we’re sensing — or would be seeing in the real world — are becoming more and more important. This technology will also serve to increase accessibility to anyone regardless of physical abilities.

How well a computer can determine what we’re looking at is a highly important factor both in achieving more accurate AR and VR, and in helping those with physical challenges. Apparently, Microsoft has been working on a solution, as MSPU reports.

According to a Microsoft patent application, the company is working on new technology to better track a user’s eye-gaze direction. The purpose, according to the patent, would be to aid users in interacting with a computer to overcome the inability to use a mouse to move a cursor, and to help whenever a user’s hands are otherwise occupied, such as in connection with industrial control, aviation, and emergency room situations. Of course, such technology would also be of use in AR and VR applications.

As MSPU points out, Microsoft’s current premier AR solution, HoloLens, only detects where a user’s head is facing, with a line extending straight out from between the user’s eyes representing the direction of the user’s gaze. The technology outlined in the patent, however, would use a combination of sensors and processors to ascertain where the user’s eyes are actually gazing, independent of head position.

microsoft-eye-tracking-patent-1
Image used with permission by copyright holder

While other systems serving this purpose currently exist, Microsoft characterizes them as costly, complex, requiring excessive power, and bulky. The patent outlines a system that serves to reduce size, complexity, and power requirements while improving accuracy in determining eye movement and direction.

microsoft-eye-tracking-patent-2
Image used with permission by copyright holder

Basically, the system would determine eye-gaze direction relative to the user’s head direction — such as looking left while the user’s head is facing to the right — and would therefore work better for AR and VR applications than would systems that are fixed in space in front of the user. Capacitive sensors would be used that sit close enough in front of the eye to detect the eye’s bulge and would be specifically configured for a user’s physiology. A contact lens with conductive material could also be placed on the eye to enhance the responsiveness of the capacitive sensor.

As always, patents are filed for all sorts of inventions that never see the light of day. If this one makes it through to actual product development, then Microsoft will have created a cost-effective, accurate, and speedy way to sense where you’re looking. That would pay dividends for future AR and VR applications and would also help anyone who faces challenges in using a computer with a traditional keyboard and mouse.

Mark Coppock
Mark has been a geek since MS-DOS gave way to Windows and the PalmPilot was a thing. He’s translated his love for…
Best Buy deals: Save on laptops, TVs, appliances, and more
best buy shuts down insignia line smart home products store 2 768x768

If you're looking to snag a good deal, Best Buy is probably one of the best retailers to do it, and we often draw from it for some of the best deals we put on these lists. A lot of that has to do with the massive variety of products that best Buy sells, and that includes things like the best TV deals, best laptop deals, and best phone deals, so there is always something to draw from. That said, it can be difficult to navigate all the deals and offers that are available on Best Buy, which is why we've gone out and collected some of our favorite deals across various categories, from headphones to small kitchen appliances.
Best Buy TV deals

There may be no better place to purchase one of the best TVs than Best Buy. There is almost always some huge savings to find on TVs at Best Buy, and that’s certainly the case right now. You’ll find deals top TV brands like Sony, Samsung, and LG, and more budget-friendly brands like TCL and Hisense are in play, too.

Read more
Target is selling Lenovo laptops for $150, with a catch
The Lenovo IdeaPad Slim 3 on a white background.

Considering the back to school shopping season is in full swing, now is one of the best times of the year to look for laptop deals. Of course, you’ll find markdowns on a wide array of models at just about every retailer, so sometimes finding the best discounts can be a little tough. It’s our job to stay on top of all the best sales though, and we recently came across a Target promo we’d like to share:

For a limited time, Target is selling a refurbished version of the Lenovo Ideapad Slim 3 with 4GB of RAM and 64GB of storage for $150. At full price, this model can go for upwards of $270. 

Read more
OpenAI Project Strawberry: here’s everything we know so far
a strawberry

Even as it is reportedly set to spend $7 billion on training and inference costs (with an overall $5 billion shortfall), OpenAI is steadfastly seeking to build the world's first Artificial General Intelligence (AGI). Project Strawberry is the company's next step toward that goal.
What is Project Strawberry?
Project Strawberry is OpenAI's latest (and potentially greatest) large language model, one that is expected to broadly surpass the capabilities of current state-of-the-art systems with its "human-like reasoning skills" when it is released. It might power the next generation of GPTs.
What can Strawberry do?
Project Strawberry will reportedly be a reasoning powerhouse. It will be able to solve math problems it has never seen before and act as a high-level agent, creating marketing strategies and autonomously solving complex word puzzles like the NYT's Connections. It can even "navigate the internet autonomously" to  perform "deep research," according to internal documents viewed by Reuters in July.

The Reuters report also notes that Strawberry's architecture is similar to the Self-Taught Reasoner (STaR) technique. Developed at Stanford in 2022, STaR enables a model to generate training data on which to fine-tune itself, becoming more capable over time.
Why is it called that?
We don't know the exact reason for the name "Strawberry," as that's not something OpenAI has publicly disclosed. It's a code name chosen for internal reference and to maintain secrecy during development.

Read more