Skip to main content

Google can catch shoulder surfers peeking at your phone

google shoulder surfers smartphone alert shopping cafe
Image used with permission by copyright holder
Imagine you’re in town waiting for a friend. With time to kill before they arrive, you do what most people do and get your smartphone out. You might flick through your Twitter timeline, check Facebook, open Instagram, or tap out a message on WhatsApp. You fail to notice the stranger standing right behind you, looking at your display.

Would you like your phone to be able flag such an occurrence with an on-screen message along the lines of, “There’s someone else looking at your display,” or perhaps something more direct, like, “Hey! Stop looking at my phone right now, creep!” though such harsh words may admittedly cause an unwanted public altercation.

It turns out that researchers at Google have been developing such a privacy-focused feature, and have now posted a video demonstrating how it works.

The feature uses the front-facing camera to scan the faces of anyone looking toward the phone. If the software spots someone it doesn’t recognize, it flashes up the message: “Stranger is looking alert!”

In Google’s recently posted demonstration video (below) spotted by Quartz, the researchers have had a bit of fun by adding a stream of Snapchat-inspired rainbow-colored vomit coming from the stranger’s mouth.

NIPS 2017 Accompaniment Demo Video

According to the video’s introduction, it seems like this may be more of an experimental project, or possibly the seed of an idea that could one day be offered as an option on our phones.

The feature is set to be presented at next week’s Neural Information Processing Systems conference in Long Beach, California, by Google researchers Hee Jung Ryu and Florian Schroff.

The technology can work for a range of “lighting conditions and head poses,” according to the researchers’ notes, and recognizes a face in two milliseconds, so you’ll know pretty darn quick if someone is peering over your shoulder.

A feature like this would come in handy if you’re in a busy place and you’re reading or writing personal messages, or if you’d simply prefer to keep your smartphone display to yourself.

It might work better in some situations than others, though. On a crowded train, for example, a fellow passenger may just glance at your screen simply because it’s human nature to do so. That could result in the alert popping up with annoying regularity, in which case it would prove more useful if it showed after a few seconds once the technology determined that the shoulder surfer is taking a long, lingering look rather than a fleeting one.

With facial recognition technology already well developed and front-facing camera technology improving all the time, we imagine such a feature could be added to most smartphones with little effort, though whether shoulder surfing is enough of a problem that users would find it useful is another question entirely.

Editors' Recommendations

Trevor Mogg
Contributing Editor
Not so many moons ago, Trevor moved from one tea-loving island nation that drives on the left (Britain) to another (Japan)…
5 phones you should buy instead of the Google Pixel 8 Pro
Someone holding the Bay blue Google Pixel 8 Pro.

Is the Google Pixel 8 Pro an excellent smartphone? Absolutely! It's quite possibly the best smartphone Google has ever made, and we weren't shy about heaping praise on it in our Google Pixel 8 Pro review. While its battery life isn't anything to write home about, and the temperature sensor is a bit of a whiff, the sheer quality of the camera, gorgeous design, strong specs, and promise of seven years of updates mean it's not a phone to miss out on.

But while the Pixel 8 Pro is a very strong smartphone, it's far from the only choice. In fact, if you're looking at the Pixel 8 Pro right now, there are five other smartphones you should consider buying instead of Google's most expensive flagship.
Google Pixel 8

Read more
Have a Google Pixel phone? You’re about to get these new features
A person holding the Google Pixel 8 Pro.

One of the great things about Google’s Pixel phones is how often the company sweetens the pot with its Pixel Feature Drops. While they’re not always the most exciting updates, every so often, we get some pleasant surprises; this month’s Feature Drop fits into that latter category with some new goodies that will be of particular interest to owners of phones in the recent Google Pixel 7 and Google Pixel 8 lineups (and of course the Google Pixel Fold).

That doesn’t mean older Pixel phones are entirely left out of the party, though. There’s at least one helpful enhancement here for the Pixel 6 and even some smaller improvements that go back to the Pixel 5a. Let's dig into everything that's new.
New features coming to Pixel phones
Circle to Search Andy Boxall / Digital Trends

Read more
Your Google Pixel phone may soon get a lifesaving feature
A person holding the Google Pixel 8 Pro.

Google Pixel 8 Pro Andy Boxall / Digital Trends

If you have a Google Pixel phone or plan on buying one in the future, you could be getting an important safety feature in the very near future. As spotted in an update for Google's Adaptive Connectivity Services app, Google is planning on adding a "Satellite SOS" feature to its Pixel devices.

Read more