Skip to main content

FingerIO's finger-wagging sonar controls may make smartwatches more usable in the future

Many of us associate the use of sonar with warships, submarines, and other sea-faring vessels, or with animals like dolphins or bats. However, students at the University of Washington have taken the technology and applied it to a smartphone and smartwatch as an alternative control system. so they can be controlled without touching the screen at all, or even just using a mid-air swipe.

It’s called FingerIO, and by using an active sonar system, any surface around your phone could be used as an extension of the touchscreen, where gestures and traces drawn on them would register on the display. For example, tracing a word on the table top next to your phone, would see that word appear on the screen, even though you’re not directly touching it.

Recommended Videos

Although any physical surface could be used, the active sonar is strong enough that it could recognize mid-air gestures, and those made through fabric. In a demonstration video, a phone’s volume is raised and lowered using a mid-air gesture when the phone itself is inside a pocket. The same applies for a smartwatch, where gestures made on your arm, or in the air surrounding the device, activate features.

There’s no need for any sensors on your hand, or a special thimble-type finger extension, because FingerIO uses sensors already inside the phone to create the active sonar field. It’s rather simple — the speakers emit inaudible sounds, and echoes are picked up by the dual microphones. Clever modulation then increases the accuracy. The team used a Samsung Galaxy S4 as a test device, and found its audio and microphone setup is good for an average accuracy of 8mm.

Gestures are great, but when they can be made in the general vicinity of a device, there’s a risk of unwanted interaction. To avoid this, FingerIO has a double swipe activation command, made within five centimeters of the device, measuring at least four centimeters for each straight-line swipe. That way, pointing to something in front of you doesn’t suddenly make a call to Uncle Tom.

The group has published a paper on the technology, which points out several drawbacks, including devices requiring a third microphone to enable 3D tracking, and the high power consumption of an always-on sonar system. The test Galaxy S4 lasted for just four hours using the technology. However, it’s early days for FingerIO, and regardless of the current limitations, the active sonar system has been shown to work on an existing smartphone, and a custom-made smartwatch, rather than simply being a concept that may never actually work at all.

Andy Boxall
Andy has written about mobile technology for almost a decade. From 2G to 5G and smartphone to smartwatch, Andy knows tech.
Digital Trends’ Top Tech of CES 2023 Awards
Best of CES 2023 Awards Our Top Tech from the Show Feature

Let there be no doubt: CES isn’t just alive in 2023; it’s thriving. Take one glance at the taxi gridlock outside the Las Vegas Convention Center and it’s evident that two quiet COVID years didn’t kill the world’s desire for an overcrowded in-person tech extravaganza -- they just built up a ravenous demand.

From VR to AI, eVTOLs and QD-OLED, the acronyms were flying and fresh technologies populated every corner of the show floor, and even the parking lot. So naturally, we poked, prodded, and tried on everything we could. They weren’t all revolutionary. But they didn’t have to be. We’ve watched enough waves of “game-changing” technologies that never quite arrive to know that sometimes it’s the little tweaks that really count.

Read more
Digital Trends’ Tech For Change CES 2023 Awards
Digital Trends CES 2023 Tech For Change Award Winners Feature

CES is more than just a neon-drenched show-and-tell session for the world’s biggest tech manufacturers. More and more, it’s also a place where companies showcase innovations that could truly make the world a better place — and at CES 2023, this type of tech was on full display. We saw everything from accessibility-minded PS5 controllers to pedal-powered smart desks. But of all the amazing innovations on display this year, these three impressed us the most:

Samsung's Relumino Mode
Across the globe, roughly 300 million people suffer from moderate to severe vision loss, and generally speaking, most TVs don’t take that into account. So in an effort to make television more accessible and enjoyable for those millions of people suffering from impaired vision, Samsung is adding a new picture mode to many of its new TVs.
[CES 2023] Relumino Mode: Innovation for every need | Samsung
Relumino Mode, as it’s called, works by adding a bunch of different visual filters to the picture simultaneously. Outlines of people and objects on screen are highlighted, the contrast and brightness of the overall picture are cranked up, and extra sharpness is applied to everything. The resulting video would likely look strange to people with normal vision, but for folks with low vision, it should look clearer and closer to "normal" than it otherwise would.
Excitingly, since Relumino Mode is ultimately just a clever software trick, this technology could theoretically be pushed out via a software update and installed on millions of existing Samsung TVs -- not just new and recently purchased ones.

Read more
How does Garmin measure stress, and is it really accurate?
Garmin Vivomove Sport dial close up. Credits: Garmin official.

Garmin watches are known for their robust activity tracking, but that's not all these fitness watches can do. Over the years, the company has been adding wellness features to its lineup of watches. These new health-focused metrics allow people to analyze their fitness and identify outside factors affecting their performance. One such factor is stress, which is something Garmin watches actively measures.
But you may be wondering—exactly how does Garmin measure stress? In this article, we break down how Garmin measures stress and delve into the accuracy of this metric. Should you trust your stress score? Read on to find out.

Is Garmin's stress score accurate?

Read more