Skip to main content

Apple patent suggests future Macs could use eye tracking to go hands-free

Image used with permission by copyright holder

Eye tracking is a feature that has been on Windows PCs for a while, but it looks like Apple might also be considering it sometime in the future. A patent called “Gaze detection in a 3D mapping environment” includes mentions which hint that one day you might be able to ditch your mouse and look at your Mac in a completely different way.

The patent was originally filed in September 2017 and initially describes a mixed modality interface for receiving three-dimensional maps of at least one body part of a user, then eventually transmitting the image to a computer. As part of a series of other filings, it also describes how a 3D sensor can pick up a user’s gaze and segment it to extract coordinates, and then have that gaze identified to a movement on the screen.

“There is additionally provided, in accordance with an embodiment of the present invention an apparatus including a sensing device configured to receive an image including an eye of a user, and a computer configured to identify, based the image of the eye, a direction of a gaze performed by the user … to perform an operation on content presented in the region,” explains the patent.

Image used with permission by copyright holder

Curiously, the patent dives a bit deeper and explains that a would-be tracking system can also pick up the movements of a user’s other body parts, including the head, torso, and limbs. These can then be inputted to a computer or another device, which can help the user select any icons and other user interface elements (as seen above.)

It is something which Apple wants to address to set itself apart from current interfaces, according to the patent.

“Many different types of user interface devices and methods are currently available. Common tactile interface devices include a computer keyboard, a mouse, and a joystick. Touchscreens detect the presence and location of a touch by a finger or other object within the display area. Infrared remote controls are widely used, and wearable hardware devices have been deployed,” explains the patent.

Any Mac with these tracking features would very much be appreciated. Apple’s latest devices have featured more internal changes, rather than the revolutionary changes seen in the past. As usual, patents don’t usually hold up to be true, but it might be worth dreaming for and go nicely with the future Mac of 2021.

Editors' Recommendations

Arif Bacchus
Arif Bacchus is a native New Yorker and a fan of all things technology. Arif works as a freelance writer at Digital Trends…
Why you should buy a MacBook Air instead of a MacBook Pro
The MacBook Air on a table in front of a window.

The MacBook Air has officially caught up. Now with the M3 on board, the MacBook Air has gained the benefits of the new chip, which was previously available just on the MacBook Pro and iMac.

Choosing between the M3 15-inch MacBook Air and the 14-inch MacBook Pro is tough, and requires an in-depth look at differences in ports, displays, speakers, and more. It's a legitimately hard decision to make.

Read more
The MacBook Air 15 vs. MacBook Pro 14: the easy way to decide
Apple's 15-inch MacBook Air placed on a desk with its lid closed.

Picking out a new MacBook isn't as easy as it used to be.

The hardest choice in the lineup might be between the 15-inch MacBook Air and the 14-inch MacBook Pro. Both are now offered with the same M3 chip, despite there being a $300 difference in the base models. But when similarly configured, there's actually only a $100 difference between these two laptops.

Read more
Apple quietly backtracks on the MacBook Air’s biggest issue
The MacBook Air on a white table.

The new MacBook Air with M3 chip not only allows you to use it with two external displays, but it has also reportedly addressed a storage problem that plagued the previous M2 model. The laptop now finally has much faster storage performance since Apple has switched back to using two 128GB NAND modules instead of a single 256GB module on the SSD drive.

This was discovered by the YouTuber Max Tech, who tore down the entry-level model of the MacBook Air M3 with 8GB of RAM and 256GB of storage. In his tests, thanks to the two NAND modules, the M3 MacBook Air is nearly double faster than the M2 MacBook Air. Blackmagic Disk Speed tests show that the older M2 model with the problematic NAND chip had a 1584.3 Mb/s write speed, and the newer M3 model had 2108.9 Mb/s for the M3 model, for a 33% difference. In read speeds, it was 1576.4 Mb/s on the old model and 2880.2 Mb/s on the newer model.

Read more