Apple patent suggests future Macs could use eye tracking to go hands-free

By Arif Bacchus Published November 1, 2018

Image used with permission by copyright holder

Eye tracking is a feature that has been on Windows PCs for a while, but it looks like Apple might also be considering it sometime in the future. A patent called “Gaze detection in a 3D mapping environment” includes mentions which hint that one day you might be able to ditch your mouse and look at your Mac in a completely different way.

Recommended Videos

The patent was originally filed in September 2017 and initially describes a mixed modality interface for receiving three-dimensional maps of at least one body part of a user, then eventually transmitting the image to a computer. As part of a series of other filings, it also describes how a 3D sensor can pick up a user’s gaze and segment it to extract coordinates, and then have that gaze identified to a movement on the screen.

“There is additionally provided, in accordance with an embodiment of the present invention an apparatus including a sensing device configured to receive an image including an eye of a user, and a computer configured to identify, based the image of the eye, a direction of a gaze performed by the user … to perform an operation on content presented in the region,” explains the patent.

Image used with permission by copyright holder

Curiously, the patent dives a bit deeper and explains that a would-be tracking system can also pick up the movements of a user’s other body parts, including the head, torso, and limbs. These can then be inputted to a computer or another device, which can help the user select any icons and other user interface elements (as seen above.)

It is something which Apple wants to address to set itself apart from current interfaces, according to the patent.

“Many different types of user interface devices and methods are currently available. Common tactile interface devices include a computer keyboard, a mouse, and a joystick. Touchscreens detect the presence and location of a touch by a finger or other object within the display area. Infrared remote controls are widely used, and wearable hardware devices have been deployed,” explains the patent.

Any Mac with these tracking features would very much be appreciated. Apple’s latest devices have featured more internal changes, rather than the revolutionary changes seen in the past. As usual, patents don’t usually hold up to be true, but it might be worth dreaming for and go nicely with the future Mac of 2021.

Topics

Former Digital Trends Contributor

Arif Bacchus is a native New Yorker and a fan of all things technology. Arif works as a freelance writer at Digital Trends…

Computing

iPad is the best secondary screen I’ve used with a MacBook

You can extend your MacBook's screen by using an iPad as a secondary monitor.

I spend an unhealthy amount of time lurking in communities where people share aesthetic desktop setups. One of my friends recently set the group chat on fire with a triple monitor setup that had two vertical screens and an ultrawide curved panel at the center. An impulse swipe later, I achieved a similar makeover for my desk at home.

Here’s the problem, though. My $600 workstation overhaul did bring me visual joy, but not much utility. For reporting assignments, I spend the majority of the year away from home, working from deserted cafes or unnaturally uncomfortable bunk beds. I do miss the convenience of large secondary screens. Interestingly, that yearning is addressed by a rather unconventional device —the humble iPad.

Computing

Attention to detail is Apple’s not-so-hidden hardware superpower

Apple Mac Studio 2025 top down view showing desktop.

I've reviewed well over 300 laptops, a handful of displays, and a smattering of accessories. Naturally, I've gained an appreciation for great hardware design and construction, and I can pretty immediately get a sense of where a device stacks up. While several companies make great hardware, one stands apart. I'm talking about Apple, and I'm writing this after having reviewed the new Mac Studio, the MacBook Air 13 (M4), the MacBook Air 15 (M4), and the Apple Studio Display.

At the end of 2023, I wrote extensively about why I made the decision to switch to Mac after decades of Windows loyalty. I made that decision based in part on the outstanding power-performance ratio that Apple Silicon brings to laptops, -- along with a growing frustration with Windows. Apple's software isn't nearly perfect, especially considering the company's flawed rollout of Apple Intelligence. But since I've made the switch -- which included migrating from an Android smartphone to an iPhone and incorporating an Apple Watch -- I've been extremely happy. And reviewing so many Apple products at once just reinforced an impression that's been growing on me for a while: nobody makes hardware that's nearly as great.
It starts with the unboxing

Computing

Mac users are now in danger of a well-known Windows phishing attack

If you're using a Mac, such as the new MacBook Air, you might have to be careful. A phishing attack that previously plagued Windows users has now made its way to macOS, and it's easy to fall for it.

This was spotted by 9to5Mac. Researchers from LayerX have been tracking a well-known phishing attack that caused a lot of grief to those who were tricked by it. Previously, the main target of these hackers was Windows, but Microsoft was able to largely eliminate it -- up to 90% of all attacks on Windows PCs are said to have been fixed thanks to new updates to Edge, Chrome, and Firefox that block scareware.