Skip to main content
  1. Home
  2. Phones
  3. Computing
  4. Emerging Tech
  5. Mobile
  6. Photography
  7. News

MIT researchers develop eye-tracking program for your smartphone

Add as a preferred source on Google

According to a new paper, researchers at the University of Georgia and the Massachusetts Institute of Technology’s Computer Science and Artificial Intelligence Laboratory have developed a piece of software capable of turning almost any smartphone into an eye-tracking device.

Inspired by what MIT graduate student Aditya Khosla calls a “chicken-and-egg loop,” regarding eye-tracking applications for smartphones, researchers teamed up to bring together the information needed to develop such a program. In speaking to MIT News, Khosla said:

Recommended Videos

“Since few people have the external devices, there’s no big incentive to develop applications for them. Since there are no applications, there’s no incentive for people to buy the devices. We thought we should break this circle and try to make an eye tracker that works on a single mobile device, using just your front-facing camera.”

In order to create such a program, the team of engineers and researchers first needed data, the key ingredient in creating the brain of the program, a machine learning algorithm.

To do this, the researchers sought out strength in numbers with a little crowdsourcing from Amazon’s Mechanical Turk program. Previous research in this area was limited to only 50 or so subjects, who were asked to come into a lab to complete the tests.

A collection of the subjects who participated in the data collection stage of development
A collection of the subjects who participated in the data collection stage of development Image used with permission by copyright holder

Khosla and his team far exceeded previous research by sampling the eye movements of 1,500 mobile users, all of whom participated with the help of GazeCapture, a custom iOS application that combined on-screen animations with use of the front-facing camera.

Diagram showing how the data is used to predict eye movement in subjects
Diagram showing how the data is used to predict eye movement in subjects Image used with permission by copyright holder

The data captured from 800 of the 1,500 subjects was used to create iTracker, the first iteration of the eye-tracking system, which had a margin of error of only 1.5 centimeters. Since then, the researchers have analyzed the remaining 700 subjects and further improved the margin of error, shrinking it down to just 1 centimeter.

The team is hopeful that further testing will be able to reduce that even more, down to a margin of error of a half-centimeter, the key number that will make the program commercially viable in the eyes of Khosla.

As for the practical applications for such technology, it can be used for almost anything more conventional eye-tracking methods are used for, from helping doctor’s discover and keep tabs on various illnesses, to market research and analytics. The key difference here is that this new method of tracking is far less invasive and exorbitantly less expensive than alternative options, making it easier than ever to capture larger quantities of data.

Below is the paper in its entirety:

It’ll be interesting to see what the future holds. The team behind it will be presenting the paper on June 28 at the Computer Vision and Pattern Recognition conference in Las Vegas.

Gannon Burgett
Former Editor
Apple’s foldable iPhone may arrive this fall, but good luck getting your hands on one
Apple’s foldable iPhone hype may run straight into a launch shortage
Electronics, Mobile Phone, Phone

Apple’s first foldable iPhone may have a repeat of the iPhone X moment this fall. A new report from industry analyst Ming-Chi Kuo suggests that the rumored iPhone Ultra (foldable iPhone) could be announced alongside the iPhone 18 Pro and iPhone 18 Pro Max, but preorders and sales may arrive later because early production is expected to be extremely limited.

Kuo says Apple may build around 7 million to 8 million foldable iPhones in the second half of 2026. The problem is timing. Only 0.5 million to 1 million units are expected to be ready in the third quarter, which is when Apple usually prepares for its September iPhone launch. The iPhone 18 Pro and Pro Max, by comparison, are expected to have around 20 million to 22 million units ready in the same period.

Read more
The iPhone 18 Pro Max battery upgrade now looks all but confirmed
A new certification listing reveals bigger battery numbers for the iPhone 18 Pro Max
Apple iPhone 17 Pro White

Apple is expected to launch three new iPhones this fall, including the iPhone 18 Pro, iPhone 18 Pro Max, and the rumored foldable iPhone Ultra. The iPhone 18 Pro Max was recently tipped to get a major battery boost, with one leak claiming a 5,235mAh battery for the physical SIM model and a 5,425mAh battery for the eSIM-only version.

Now, China’s 3C certification database (via Digital Chat Station) appears to show the actual battery capacities for both the iPhone 18 Pro and iPhone 18 Pro Max. Interestingly, the Pro Max numbers listed there are even larger than the earlier leak suggested.

Read more
3 Siri AI features that have genuinely improved my day-to-day life
Three years late, but Siri AI might have been worth the wait.
Siri Ai on iPhone

iOS 27 has finally brought the much-improved Siri experience to iPhones that Apple had promised three years back. The new Siri, dubbed Siri AI, actually feels useful now. I can use it to create shortcuts, get answers based on my personal context, perform actions in apps, and so much more. Of all the Siri AI features, three simple ones have genuinely improved my day-to-day experience. Let’s talk about them.

Search has improved across the board

Read more