Skip to main content

Apple patent suggests future Macs could use eye tracking to go hands-free

Image used with permission by copyright holder

Eye tracking is a feature that has been on Windows PCs for a while, but it looks like Apple might also be considering it sometime in the future. A patent called “Gaze detection in a 3D mapping environment” includes mentions which hint that one day you might be able to ditch your mouse and look at your Mac in a completely different way.

The patent was originally filed in September 2017 and initially describes a mixed modality interface for receiving three-dimensional maps of at least one body part of a user, then eventually transmitting the image to a computer. As part of a series of other filings, it also describes how a 3D sensor can pick up a user’s gaze and segment it to extract coordinates, and then have that gaze identified to a movement on the screen.

“There is additionally provided, in accordance with an embodiment of the present invention an apparatus including a sensing device configured to receive an image including an eye of a user, and a computer configured to identify, based the image of the eye, a direction of a gaze performed by the user … to perform an operation on content presented in the region,” explains the patent.

Image used with permission by copyright holder

Curiously, the patent dives a bit deeper and explains that a would-be tracking system can also pick up the movements of a user’s other body parts, including the head, torso, and limbs. These can then be inputted to a computer or another device, which can help the user select any icons and other user interface elements (as seen above.)

It is something which Apple wants to address to set itself apart from current interfaces, according to the patent.

“Many different types of user interface devices and methods are currently available. Common tactile interface devices include a computer keyboard, a mouse, and a joystick. Touchscreens detect the presence and location of a touch by a finger or other object within the display area. Infrared remote controls are widely used, and wearable hardware devices have been deployed,” explains the patent.

Any Mac with these tracking features would very much be appreciated. Apple’s latest devices have featured more internal changes, rather than the revolutionary changes seen in the past. As usual, patents don’t usually hold up to be true, but it might be worth dreaming for and go nicely with the future Mac of 2021.

Editors' Recommendations

Arif Bacchus
Arif Bacchus is a native New Yorker and a fan of all things technology. Arif works as a freelance writer at Digital Trends…
The case for buying the M2 MacBook Air over the M3 model
The screen of the MacBook Air M2.

Apple's MacBook Air M2 recently stood at the top of our list of best laptops, and for good reason. It's incredibly well-built, exuding an elegance that few laptops can match. It's also plenty fast for productivity users, and its GPU is optimized for creators. Its keyboard, touchpad, and display are all top-notch.

Enter the MacBook Air M3, which (hint) took over the MacBook Air's place on that list. The upgraded chipset offers even faster performance, particularly in GPU-intensive apps, and the M3 model supports an additional external display (with the display closed). It's $100 more, but is that uptick in price justified? Let's dig in.
Specs and configurations

Read more
Why you should buy a MacBook Pro instead of a MacBook Air
The 14-inch MacBook Pro on a window sill.

There are plenty of reasons to buy a MacBook Air instead of a MacBook Pro. If you want a MacBook on a budget, you don't necessarily need the goodies that come with upgrading to the MacBook Pro.

That being said, I'm going to argue for spending a little more. In my experience, the MacBook Pro offers several distinct advantages that help justify a higher price, especially with the introduction of the more affordable MacBook Pro 14 with the base M3. If you can stretch your budget a bit, here's why I think you should buy a MacBook Pro instead of a MacBook Air.
Setting the stage: pricing

Read more
Here’s more confirmation that 2024 will be a slow year for Macs
3nm iphone ipad processors apple silicon imgae

There's some extra reason to believe that Apple could already be working on the M4 chip, but it may not be coming for a while. New research from Canalys, a market analytics firm, shows that the next entry in the Apple Silicon family could come in the first part of 2025 to target offerings from Intel, Qualcomm, and AMD.

Lining up with previous reporting from Bloomberg's Mark Gurman, Canalys is estimating that Apple could launch the M4 chip in the first quarter of 2025. It's a vague time frame, but it makes a lot of sense. Gurman previously said that Apple already has the M4 MacBook Pro in "formal development." Although this timing lines up with previous Apple Silicon chip refresh cycles, it would leave 2024 looking fairly light in terms of new Mac releases. Apple usually has some kind of October or November release focused on new Macs, but without new chips to launch, that might not happen this year.

Read more