Skip to main content

Lip reading could be the future of unlocking your smartphone

ZTE ZMax Pro
Julian Chokkattu/Digital Trends
Between fingerprints, face recognition, audio commands, and good old PIN numbers, passwords, and patterns, there is no shortage of ways to unlock your smartphone. Now, a team of researchers at Hong Kong Baptist University have added yet another way: Lip reading.

At first blush, using lip movement to authenticate a device might just seem like another frivolous method to accomplish something we already do on our devices every day easily enough, but there is actually a very strong case to be made for the idea, as the project’s leader Cheung Yiu-ming explained to the South China Morning Post.

Recommended Videos

“You can use English, Cantonese, or Putonghua,” the computer science engineer explained. “You can even mimic a bird chirping.”

Please enable Javascript to view this content

Many forms of authentication rely on language, or numbers, or a complex software interface. What makes lip reading different is that anyone, anywhere can say a word or make a motion with their mouth. What makes it even more ingenious is that no two people will speak or move in exactly the same way.

“An imposter reading the same phrase would still be rejected by the system,” Cheung said, adding that, like other biometrics technologies, the user will have to demonstrate the triggering action multiple times so that the system can build a number of accepted responses on which to base a tolerance.

Right now, Cheung says his team of three has achieved a level of 90 percent accuracy and one of the major roadblocks to wide-scale implementation would be guaranteeing functionality in a variety of different lighting conditions. While the system should be harder to fool with a video recording than the way in which facial recognition prompts can be breached with a photograph, Cheung did not address that potential exploit.

The university has reportedly patented the technology and is exploring options for commercialization. Cheung says he hopes it could be ready for public use with another year of development.

Adam Ismail
Former Digital Trends Contributor
Adam’s obsession with tech began at a young age, with a Sega Dreamcast – and he’s been hooked ever since. Previously…
The anti-smartphone is coming, and it’s for your own good
The Nokia 3210 with an Apple iPhone 15 Pro Max.

HMD is making the anti-smartphone, a device that’s designed to curb screen time and reduce the amount of time spent on social media, and it’s doing so with the help of parents. HMD has been leaning heavily into the concept of “digital detox," and it even recently announced the HMD Skyline, which has a dedicated detox mode built into the software.

But what it has in mind next seems to go far beyond this. It’s called The Better Phone Project, and at the moment, there’s no actual phone to see, but there is some research to consider. Most of us will have read about or even experienced the negative impact social media can have on mental health, and some of us will have, at some point, considered or even acted upon a wish to reduce screen time.

Read more
One of the U.K.’s poshest schools to replace students’ smartphones with a Nokia
A person holding the Nokia 3210.

The Nokia 3210 Andy Boxall / Digital Trends

One of the U.K.’s most elite schools has announced it will ban smartphones use among its next intake of students. But so that they can stay connected, the students will be issued a run-of-the-mill Nokia handset capable only of making calls and sending texts.

Read more
The iPhone 16 Pro Max could redefine smartphone batteries
Insides of an iPhone depicted as a wallpaper.

Apple is reportedly eyeing a major battery upgrade for its next iPhone -- one that will not only boost the per-charge efficiency but also pave the way for easier (and hopefully cheaper) repairs. Ming-Chi Kuo, a well-known industry insider for Apple moves and analyst at Tianfeng International Securities, writes in his latest investor note that Apple is making modifications to the iPhone 16 Pro Max's lithium-ion battery that will increase the energy density.

Battery density is defined as the amount of energy that can be stored per volume, and it is usually measured in watt-hours per liter for an average lithium-based battery, the kind used in smartphones. The benefits of a higher-density battery mean more electrical energy can be put inside a pack, or conversely, the size of the battery can be shrunk without reducing the capacity.

Read more