Apple patent suggests future Macs could use eye tracking to go hands-free

apple patents hand eye tracking for the mac

Eye tracking is a feature that has been on Windows PCs for a while, but it looks like Apple might also be considering it sometime in the future. A patent called “Gaze detection in a 3D mapping environment” includes mentions which hint that one day you might be able to ditch your mouse and look at your Mac in a completely different way.

The patent was originally filed in September 2017 and initially describes a mixed modality interface for receiving three-dimensional maps of at least one body part of a user, then eventually transmitting the image to a computer. As part of a series of other filings, it also describes how a 3D sensor can pick up a user’s gaze and segment it to extract coordinates, and then have that gaze identified to a movement on the screen.

“There is additionally provided, in accordance with an embodiment of the present invention an apparatus including a sensing device configured to receive an image including an eye of a user, and a computer configured to identify, based the image of the eye, a direction of a gaze performed by the user … to perform an operation on content presented in the region,” explains the patent.

apple patents hand eye tracking for the mac capture

Curiously, the patent dives a bit deeper and explains that a would-be tracking system can also pick up the movements of a user’s other body parts, including the head, torso, and limbs. These can then be inputted to a computer or another device, which can help the user select any icons and other user interface elements (as seen above.)

It is something which Apple wants to address to set itself apart from current interfaces, according to the patent.

“Many different types of user interface devices and methods are currently available. Common tactile interface devices include a computer keyboard, a mouse, and a joystick. Touchscreens detect the presence and location of a touch by a finger or other object within the display area. Infrared remote controls are widely used, and wearable hardware devices have been deployed,” explains the patent.

Any Mac with these tracking features would very much be appreciated. Apple’s latest devices have featured more internal changes, rather than the revolutionary changes seen in the past. As usual, patents don’t usually hold up to be true, but it might be worth dreaming for and go nicely with the future Mac of 2021.

Emerging Tech

CES 2019 recap: All the trends, products, and gadgets you missed

CES 2019 didn’t just give us a taste of the future, it offered a five-course meal. From 8K and Micro LED televisions to smart toilets, the show delivered with all the amazing gadgetry you could ask for. Here’s a look at all the big…
Home Theater

Want to mirror your smartphone or tablet onto your TV? Here's how

A vast arsenal of devices exists to allow sending anything on your mobile device to your TV. Our in-depth guide shows you how to mirror content from your smartphone or tablet to the big screen from virtually any device available.
Gaming

Want to trick out your PlayStation 4? These themes will get you started

Personalize your gaming experience with some of our favorite themes for the PlayStation 4, including free, paid, static, and dynamic options.
Computing

Don't spend hundreds on Pro Tools or Logic. Try one of these free alternatives

Believe it or not, Pro Tools isn't the only digital audio workstation worth your time. Check out our picks for the best free recording software, whether you're looking for a lightweight app or a full-blown audio workstation.
Computing

Our favorite Windows apps will help you get the most out of your new PC

Not sure what apps you should be downloading for your newfangled Windows device? Here are the best Windows apps, whether you need something to speed up your machine or access your Netflix queue. Check out our categories and favorite picks.
Computing

Hackers are scoring with ransomware that attacks its previous victims

Computer viruses are always evolving. In a new one, dubbed "Ryuk," hackers are targeting PCs with ransomware that scours an infected network in order to pinpoint and attack and enterprises with big money.
Computing

An update to Microsoft To-Do will help you keep up with your resolutions

If you're looking to stay productive in 2019, you might want to check out the freshly updated Microsoft To-Do app, now with additional integration with the Windows 10 Start Menu and more.
Computing

Want to save a webpage as a PDF? Just follow these steps

Need to quickly save and share a webpage? The best way is to learn how to save a webpage as a PDF file, as they're fully featured and can handle images and text with ease. Here's how.
Computing

Could the next Microsoft HoloLens be announced at MWC 2019?

After not having a presence at Mobile World Congress for three years, Microsoft is now sending out media invites for a press conference on February 24 during the annual event in Barcelona. Could a next-generation HoloLens be on the way?
Computing

Microsoft to separate Cortana from search with the next version of Windows 10

Changes are on the way for two key features in Windows 10. A separation of Windows 10 search and Cortana will allow Microsoft to more often innovate on each of the features independently.
Computing

Delete tracking cookies from your system by following these quick steps

Cookies are useful when it comes to saving your login credentials and other data, but they can also be used by advertisers to track your browsing habits across multiple sites. Here's how to clear cookies in the major browsers.
Computing

Convert your PDFs into convenient Word documents with Adobe or a free option

PDF files are great, but few document types are as malleable as those specific to Microsoft Word. Here's how to convert a PDF file into a Word document, whether you prefer to use Adobe's software suite or a freemium alternative.
Computing

Nvidia’s next midrange card might be a GTX 1660 Ti, rumors suggest

Nvidia may be working on a non-RTX Turing graphics card called the 1660 Ti. Rumors suggest it will have around 20 percent fewer CUDA cores than the RTX 2060 and will lack ray tracing support.
Deals

From Samsung to HP, here are the best cheap Chromebook deals right now

Whether you want a compact laptop to enjoy some entertainment on the go, or you need a no-nonsense machine for school or work, we've smoked out the best cheap Chromebook deals -- from full-sized laptops to 2-in-1 convertibles -- with most…