Skip to main content

An app uses your smartphone camera to tell if you’re alert at work

In the boring old days, our smartphone cameras just took pictures. Then they started letting us confirm our identity, through tools like Apple’s Face ID. Soon, they could help track your alertness as well.

At least, that’s the basis for a new research project coming out of Cornell University. Researchers there have developed a tool which uses a smartphone camera to keep tabs on alertness at work — by measuring the size of your pupils each time you unlock your phone. It can do this because people’s pupils change size over the course of the day. When individuals are alert, the sympathetic nervous system makes their pupils dilate in order that they can take in information more easily. When they’re tired, the parasympathetic nervous system causes the pupils to contract. Since all of us look at our phones at work (don’t pretend this doesn’t include you!), developing an alertness measurement tool for this device makes perfect sense.

“The goal of this technology is to explore a new way in which we can measure people’s level of alertness in an unobtrusiveness and naturalistic way, in particular at the moments when people interact with their mobile devices,” Vincent Tseng, a Ph.D. student in Cornell’s Department of Information Science, told Digital Trends. “Essentially, the app takes a burst of images when people unlock their phone. [It additionally] collects other passive sensor data that also affect people’s alertness or pupil size, such as environmental light intensity. With all these passively collected sensor data, the application uses machine learning to predict how alert the user is, [which helps reveal their] reaction time.”

Sure, the idea of your boss receiving a notification to say your work smartphone has revealed that you’re not paying attention is kind of dystopian. But there are potential applications for this technology that would be genuinely helpful — and maybe even life-saving. For instance, clinicians typically look at devices (hopefully not their personal smartphones) during surgery. A front-facing camera on these devices could help track their alertness throughout procedures, which can take multiple hours to complete in some cases. Should the app detect a surgeon’s level of alertness to be plummeting, it could trigger an intervention that lets another person step in or the operator to take a short break.

“Our ultimate goal is to better understand how our productivity and performance fluctuate throughout the day,” Tseng continued. “By knowing how … different processes change throughout the day, we may have a better picture of when are the optimal times for us to focus and accomplish important tasks.”

A paper describing this project was recently presented at the International Conference on Human-Computer Interaction with Mobile Devices and Services.

Editors' Recommendations

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
No, the Journal app on your iPhone isn’t spying on you
Apple Journal app on an iPhone 15 Pro.

If you've spent any time on Facebook, TikTok, or any other social media site over the last couple of days, there's a chance you've seen people claiming that your iPhone is spying on you — specifically, with a feature called "Journaling Suggestions."

One post I stumbled across on Facebook made it sound rather frightening, warning me that the feature shares my FULL NAME and EXACTLY where I'm located to anyone nearby. The post told me to go and toggle the setting off immediately because it was "Very scary stuff!!"

Read more
Have a Google Pixel phone? You’re about to get these new features
A person holding the Google Pixel 8 Pro.

One of the great things about Google’s Pixel phones is how often the company sweetens the pot with its Pixel Feature Drops. While they’re not always the most exciting updates, every so often, we get some pleasant surprises; this month’s Feature Drop fits into that latter category with some new goodies that will be of particular interest to owners of phones in the recent Google Pixel 7 and Google Pixel 8 lineups (and of course the Google Pixel Fold).

That doesn’t mean older Pixel phones are entirely left out of the party, though. There’s at least one helpful enhancement here for the Pixel 6 and even some smaller improvements that go back to the Pixel 5a. Let's dig into everything that's new.
New features coming to Pixel phones
Circle to Search Andy Boxall / Digital Trends

Read more
Have one of these Samsung phones? You’re getting Galaxy AI features next month
The Galaxy S23 Ultra and Galaxy S24 Ultra's rear panels.

The Samsung Galaxy S23 Ultra (left) and Galaxy S24 Ultra Andy Boxall / Digital Trends

If you bought a Samsung phone within the last year or so, get ready for a big software update heading your way soon. On February 21, Samsung confirmed that a number of its older smartphones are getting Galaxy AI features as part of the One UI 6.1 update in "late March."

Read more