Skip to main content

Lip reading could be the future of unlocking your smartphone

ZTE ZMax Pro
Julian Chokkattu/Digital Trends
Between fingerprints, face recognition, audio commands, and good old PIN numbers, passwords, and patterns, there is no shortage of ways to unlock your smartphone. Now, a team of researchers at Hong Kong Baptist University have added yet another way: Lip reading.

At first blush, using lip movement to authenticate a device might just seem like another frivolous method to accomplish something we already do on our devices every day easily enough, but there is actually a very strong case to be made for the idea, as the project’s leader Cheung Yiu-ming explained to the South China Morning Post.

“You can use English, Cantonese, or Putonghua,” the computer science engineer explained. “You can even mimic a bird chirping.”

Many forms of authentication rely on language, or numbers, or a complex software interface. What makes lip reading different is that anyone, anywhere can say a word or make a motion with their mouth. What makes it even more ingenious is that no two people will speak or move in exactly the same way.

“An imposter reading the same phrase would still be rejected by the system,” Cheung said, adding that, like other biometrics technologies, the user will have to demonstrate the triggering action multiple times so that the system can build a number of accepted responses on which to base a tolerance.

Right now, Cheung says his team of three has achieved a level of 90 percent accuracy and one of the major roadblocks to wide-scale implementation would be guaranteeing functionality in a variety of different lighting conditions. While the system should be harder to fool with a video recording than the way in which facial recognition prompts can be breached with a photograph, Cheung did not address that potential exploit.

The university has reportedly patented the technology and is exploring options for commercialization. Cheung says he hopes it could be ready for public use with another year of development.

Editors' Recommendations

Adam Ismail
Former Digital Trends Contributor
Adam’s obsession with tech began at a young age, with a Sega Dreamcast – and he’s been hooked ever since. Previously…
The Nothing Phone 1 thinks your smartphone should be a brash, distracting toy
Someone holding the Nothing Phone 1, showing the front of it and its display.

Carl Pei, former founder of OnePlus and now the face of the Nothing brand, has been hyping up the company's Nothing Phone 1 for what feels like ages. You'd think the smartphone world has seen it all, but Nothing has a brilliant plan to bring the fun back to phones. No, it's not with foldables. It's also not mini phones, nor is it the camera-centric madness that has gripped both Western and Eastern smartphone brands.

With the Nothing Phone 1, Pei wants to bring back beeps and bloops to your smartphone in an attempt to make your phone the most distracting thing in your life (more so than it is already), and it's not exactly clear Nothing has something here.
Making your phone the center of attention

Read more
Microsoft quits its creepy, emotion-reading A.I.
blonde woman with an expressionless face looks at camera while laser lights scan her features

Microsoft announced it will stop the development and distribution of controversial emotion-reading software as big tech companies pivot toward privacy and security. The company also says it will heavily restrict its own facial recognition platform.

Microsoft’s shift away from emotional recognition software is another sign of big tech’s growing prioritization of privacy. The company also admits there is little scientific evidence behind the technology.

Read more
How your phone could save your life
A topographical map is displayed on an iPhone app.

Brandon Wilkes was hiking last year in Britain’s Peak District when disaster struck. The mountains were foggy and his friend Ben slipped on the wet trail as they walked along a narrow ridge with steep drops on both sides.

“The scariest thing about the ordeal was not knowing exactly where we were,” Wilkes told Digital Trends in an interview.

Read more