Skip to main content

An app uses your smartphone camera to tell if you’re alert at work

In the boring old days, our smartphone cameras just took pictures. Then they started letting us confirm our identity, through tools like Apple’s Face ID. Soon, they could help track your alertness as well.

At least, that’s the basis for a new research project coming out of Cornell University. Researchers there have developed a tool which uses a smartphone camera to keep tabs on alertness at work — by measuring the size of your pupils each time you unlock your phone. It can do this because people’s pupils change size over the course of the day. When individuals are alert, the sympathetic nervous system makes their pupils dilate in order that they can take in information more easily. When they’re tired, the parasympathetic nervous system causes the pupils to contract. Since all of us look at our phones at work (don’t pretend this doesn’t include you!), developing an alertness measurement tool for this device makes perfect sense.

Recommended Videos

“The goal of this technology is to explore a new way in which we can measure people’s level of alertness in an unobtrusiveness and naturalistic way, in particular at the moments when people interact with their mobile devices,” Vincent Tseng, a Ph.D. student in Cornell’s Department of Information Science, told Digital Trends. “Essentially, the app takes a burst of images when people unlock their phone. [It additionally] collects other passive sensor data that also affect people’s alertness or pupil size, such as environmental light intensity. With all these passively collected sensor data, the application uses machine learning to predict how alert the user is, [which helps reveal their] reaction time.”

Sure, the idea of your boss receiving a notification to say your work smartphone has revealed that you’re not paying attention is kind of dystopian. But there are potential applications for this technology that would be genuinely helpful — and maybe even life-saving. For instance, clinicians typically look at devices (hopefully not their personal smartphones) during surgery. A front-facing camera on these devices could help track their alertness throughout procedures, which can take multiple hours to complete in some cases. Should the app detect a surgeon’s level of alertness to be plummeting, it could trigger an intervention that lets another person step in or the operator to take a short break.

“Our ultimate goal is to better understand how our productivity and performance fluctuate throughout the day,” Tseng continued. “By knowing how … different processes change throughout the day, we may have a better picture of when are the optimal times for us to focus and accomplish important tasks.”

A paper describing this project was recently presented at the International Conference on Human-Computer Interaction with Mobile Devices and Services.

Please enable Javascript to view this content

Luke Dormehl
Former Digital Trends Contributor
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
You no longer need the Twitter/X app to use Grok
Grok app on an iPhone.

Launched in early 2023, X’s generative artificial intelligence (AI) chatbot, Grok, has made a significant leap with its availability as a standalone app for iPhone and iPad users. In its beta phase, Grok for iOS offers free access to xAI’s latest model, Grok 2, which boasts improvements in natural language understanding and generation capabilities.

The Grok app provides an intuitive conversational interface that enables users to engage in dynamic dialogues while creating high-quality images tailored to their specifications. This feature enhances creative expression and leverages real-time data from X and the broader web, making it a powerful tool for information retrieval and creative brainstorming. In addition to its robust functionality, X emphasizes user privacy. The app is designed with secure data interactions in mind.

Read more
This is the worst smartphone camera I used in 2024, and it’s not even close
Promotional image for OuttaFocus. Photo of a collection of smartphone cameras.

I’ve already named my favorite camera phone of 2024, and the crown went to the fantastic Xiaomi 14 Ultra. The versatile Photography Kit makes it really special, and it has even replaced my DSLR several times when taking photos published on Digital Trends.

However, what about my worst camera phone of 2024? It turns out this was a much harder question to answer, but in the end, there could only be one.
So many phones have decent cameras
CMF Phone 1 Andy Boxall / Digital Trends

Read more
I used lots of great smartphone cameras in 2024. The Vivo X200 Pro is my favorite
Man holding Vivo X200 Pro with Zeiss lenses up to his face.

I have fancied cameras on phones for as long as I can remember. My fascination perhaps stems from the fact our phones, despite continued diligence from brands for almost 20 years now, haven't fully replaced actual cameras. Over the years, however, phones have come dangerously close to mimicking actual cameras, and Vivo is among the brands leading this crusade.

Vivo's flagship phone cameras -- primarily its X series -- have always successfully armed me with a sense of confidence in my skills as a photographer. Earlier devices have aced at taking portraits and disregarding any difficulties other phones might face in low lighting. The latest Vivo X200 Pro doubles down on that feeling with better hardware, improved processing capabilities, and a range of new modes to help you seize moments with much more ease.
What makes the Vivo X200 Pro's hardware special

Read more