Skip to main content

Lip reading could be the future of unlocking your smartphone

ZTE ZMax Pro
Julian Chokkattu/Digital Trends
Between fingerprints, face recognition, audio commands, and good old PIN numbers, passwords, and patterns, there is no shortage of ways to unlock your smartphone. Now, a team of researchers at Hong Kong Baptist University have added yet another way: Lip reading.

At first blush, using lip movement to authenticate a device might just seem like another frivolous method to accomplish something we already do on our devices every day easily enough, but there is actually a very strong case to be made for the idea, as the project’s leader Cheung Yiu-ming explained to the South China Morning Post.

“You can use English, Cantonese, or Putonghua,” the computer science engineer explained. “You can even mimic a bird chirping.”

Many forms of authentication rely on language, or numbers, or a complex software interface. What makes lip reading different is that anyone, anywhere can say a word or make a motion with their mouth. What makes it even more ingenious is that no two people will speak or move in exactly the same way.

“An imposter reading the same phrase would still be rejected by the system,” Cheung said, adding that, like other biometrics technologies, the user will have to demonstrate the triggering action multiple times so that the system can build a number of accepted responses on which to base a tolerance.

Right now, Cheung says his team of three has achieved a level of 90 percent accuracy and one of the major roadblocks to wide-scale implementation would be guaranteeing functionality in a variety of different lighting conditions. While the system should be harder to fool with a video recording than the way in which facial recognition prompts can be breached with a photograph, Cheung did not address that potential exploit.

The university has reportedly patented the technology and is exploring options for commercialization. Cheung says he hopes it could be ready for public use with another year of development.

Editors' Recommendations

Adam Ismail
Former Digital Trends Contributor
Adam’s obsession with tech began at a young age, with a Sega Dreamcast – and he’s been hooked ever since. Previously…
Your $1,000 smartphone is a bad deal. These cheap phones prove it
White Xiaomi POCO F5 and bluish-green OnePlus Nord 3 held in hand in front of a heap of Android smartphones including OnePlus 11 and Samsung Galaxy Z Flip 4.

Samsung is once again here to entice you with its latest crop of foldable phones. The temptation they pose is easy to give into. You might think, what could go wrong with an almighty, well-stocked $1,000 phone?

Worth noticing, however, is the fact that plenty of other smartphones offer a much higher value for your money and can potentially fill your $1,000 purchase with remorse. That's not my intention, especially if you have already preordered the Samsung Galaxy Z Fold 5 or Galaxy Z Flip 5. But if you are looking for potential alternatives that save you lots of money while bringing you features comparable to phones that cost almost $1,000, here we have some examples.

Read more
Your next iPhone may have no bezels. Here’s why that could be a problem
iPhone 14 Pro Max laying on top of iPad showing always-on display with wallpaper setting off.

Don’t believe everything you see, but there’s a certain joy in imagining products with a futuristic touch to them. One such fantastical element of the smartphone industry is a truly bezel-free all-screen phone. And as implausible as that sounds, it looks like Apple might be the one to achieve it — and at the biggest scale imaginable.

According to South Korean outlet The Elec, Apple has reportedly asked, “Samsung Display and LG Display to develop an OLED that removes all front bezels from the iPhone.” Apple has been painfully slow at eliminating the bezel on iPhones and continues to sell the iPhone SE (2022), which should ideally exist in an era that is half a decade too persistent.

Read more
Your iPhone could steal this Pixel Tablet feature when it gets iOS 17
iPhone 14 Pro with always on display no wallpaper or notifications

With iOS 17 coming in hot for its expected June reveal during Apple's Worldwide Developer Conference, iPhone owners are anxious to hear about any big features coming with the update. According to Bloomberg, a major change is coming in the form of a complete interface overhaul for locked devices that effectively turns your iPhone into a smart display.

The new interface will supposedly display a plethora of information like the weather, push notifications, upcoming significant calendar dates, and more. Per the report, this new interface displays automatically when your iPhone is locked and laying horizontally with its screen facing up.

Read more