Skip to main content

Google can catch shoulder surfers peeking at your phone

google shoulder surfers smartphone alert shopping cafe
Image used with permission by copyright holder
Imagine you’re in town waiting for a friend. With time to kill before they arrive, you do what most people do and get your smartphone out. You might flick through your Twitter timeline, check Facebook, open Instagram, or tap out a message on WhatsApp. You fail to notice the stranger standing right behind you, looking at your display.

Would you like your phone to be able flag such an occurrence with an on-screen message along the lines of, “There’s someone else looking at your display,” or perhaps something more direct, like, “Hey! Stop looking at my phone right now, creep!” though such harsh words may admittedly cause an unwanted public altercation.

It turns out that researchers at Google have been developing such a privacy-focused feature, and have now posted a video demonstrating how it works.

The feature uses the front-facing camera to scan the faces of anyone looking toward the phone. If the software spots someone it doesn’t recognize, it flashes up the message: “Stranger is looking alert!”

In Google’s recently posted demonstration video (below) spotted by Quartz, the researchers have had a bit of fun by adding a stream of Snapchat-inspired rainbow-colored vomit coming from the stranger’s mouth.

NIPS 2017 Accompaniment Demo Video

According to the video’s introduction, it seems like this may be more of an experimental project, or possibly the seed of an idea that could one day be offered as an option on our phones.

The feature is set to be presented at next week’s Neural Information Processing Systems conference in Long Beach, California, by Google researchers Hee Jung Ryu and Florian Schroff.

The technology can work for a range of “lighting conditions and head poses,” according to the researchers’ notes, and recognizes a face in two milliseconds, so you’ll know pretty darn quick if someone is peering over your shoulder.

A feature like this would come in handy if you’re in a busy place and you’re reading or writing personal messages, or if you’d simply prefer to keep your smartphone display to yourself.

It might work better in some situations than others, though. On a crowded train, for example, a fellow passenger may just glance at your screen simply because it’s human nature to do so. That could result in the alert popping up with annoying regularity, in which case it would prove more useful if it showed after a few seconds once the technology determined that the shoulder surfer is taking a long, lingering look rather than a fleeting one.

With facial recognition technology already well developed and front-facing camera technology improving all the time, we imagine such a feature could be added to most smartphones with little effort, though whether shoulder surfing is enough of a problem that users would find it useful is another question entirely.

Editors' Recommendations

Trevor Mogg
Contributing Editor
Not so many moons ago, Trevor moved from one tea-loving island nation that drives on the left (Britain) to another (Japan)…
Google Pixel 8 Pro users are finding weird ways to use the phone
A person holding the Google Pixel 8 Pro in front of their face.

One of the most surprising additions to Google’s Pixel hardware in recent years is temperature sensing. The Google Pixel 8 Pro comes armed with a temperature sensor that can measure the temperature of objects simply by “scanning” them from an optimum distance within the five-centimeter range. Google says the sensor is good for “beverages, cooking pan, water temperature, and more.”

The smartphone community, however, is seemingly hell-bent on relegating it to gimmick status. But average Pixel 8 Pro owners are finding cool ways to use it. As detailed in this Reddit post, one Pixel 8 Pro user was stuck in a stormy situation that took out the power supply for 36 hours, putting them in a quandary regarding the status of food items kept in an out-of-power refrigerator.

Read more
Google is killing your passwords, and security experts are (mostly) happy
Logging into a Google account with passkeys on an iPhone.

Google is inching closer to making passwords obsolete. The solution is called "Passkeys," a unique form of password that is stored locally on your phone or PC, just the way a physical security key works. The passkeys are protected behind a layer of authentication, which can be your fingerprint or face scan — or just an on-screen pattern or PIN.

Passkeys are faster, linked across platforms, and save you the hassle of remembering passwords for websites or services that you have subscribed to. There is a smaller scope for human error, and the risks of 2-factor authentication code interception are also reduced.

Read more
Forget the Google Pixel 8, another new Google phone just leaked
Possible renders showing the Google Pixel 8a.

Technology always has something new on the horizon. For instance, just a few days after the launch of the Google Pixel 8 and Google Pixel 8 Pro, a new leak has emerged about the rumored Google Pixel 8a smartphone that could perhaps be released early next year.

In at least the second leak about the Pixel 8a, Smart Prix has published renderings of the new phone. The renders suggest the Pixel 8a will feature a 6.1-inch flat screen with a hole punch camera cut out. The back shows a visor that contains two camera sensors. Based on the leaked renders, the phone's dimensions will be 152.1 by 72.6 by 8.99mm, compared to the Pixel 7a's 152.4 by 72.9 by 9.0mm.

Read more