Skip to main content

Software upgrade could let smartwatches know exactly what our hands are doing

Sensing Fine-Grained Hand Activity with Smartwatches

Smartwatches are increasingly becoming their own thing, rather than simply accessories which rely on and mirror the functionality of other devices. However, there are some scenarios in which it would be useful for our smartwatches to work more closely with the objects around us — whether that’s knowing what we’re doing on our smartphones, working out when we’re typing on a keyboard, or even something as mundane as understanding when we’re using a cheese grater or washing our hands under a tap.

To solve this problem, researchers from Carnegie Mellon University figured out a way to capture fine-grained hand activity in smartwatch wearers. The results could make the experience of using a smartwatch more powerful and contextually aware.

“For so long, smartwatches have only been able to track whole-body activities, like walking, running, cycling and sleeping,” Chris Harrison, head of Carnegie Mellon’s Future Interfaces Group (FIG), told Digital Trends. “But with smartwatches right there on the wrist, we’ve always suspected it would be possible for them to also track what the hands are doing too, like typing, writing, eating, drinking, scratching, [and more]. This opens up a whole new world of high fidelity activity recognition that wasn’t previously possible.”

In a paper being presented this week at the ACM CHI 2019 conference in Glasgow, Scotland, the researchers describe how they were able to achieve this fine-grained hand activity data by overclocking the smartwatch’s in-built accelerometer to 4kHz. Combining data gathered from volunteers with the right machine learning algorithms, the system is able to determine which one of 25 hand activities is being carried out at any given time — with 95.2% accuracy.

“That’s the best part: [it requires] no extra hardware,” Harrison continues. “Your smartwatch already has everything it needs to unlock this type of tracking. It could be enabled on devices with little more than a software update.”

Harrison and co-author Gierad Laput describe a number of different potential applications. For example, by tracking when you are typing, your smartwatch could recommend regular breaks. It could also track often you drink, thereby reminding you to stay hydrated. Similarly, it could be used to track how often and long a person eats for, something which could be utilized for rudimentary calorie counting. In addition, it could detect when a person fidgets with their hands, and use this as a proxy for anxiousness to build systems that are more responsive to your mood.

“If we can sense what your hands are doing, it could potentially unlock a set of compelling applications that are more assistive, more accommodating, and can lead people to live healthier lives,” Harrison said.

Editors' Recommendations

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
Michael Kors Access Runway smartwatch: Everything you need to know
The Michael Kors Access Runway watch is now available in a range of new colors

Back in August, Michael Kors unveiled its latest smartwatch -- the Michael Kors Access Runway. The device is a full-fledged touchscreen smartwatch with Google Wear OS, and continues the stylish Access Runway name from when we last saw it in 2016, when it was attached to a slim Michael Kors hybrid smartwatch. This watch is less glitzy, and more effortlessly stylish than previous watches from the designer brand, potentially making it more attractive to more people.

Here's everything you need to know.
Design and display

Read more
Citizen-Fossil mash-up could make waves in the hybrid smartwatch market
citizen fossil hybrid smartwatch partnership news watch

Watchmaker Citizen will begin producing hybrid smartwatches using technology from the Fossil Group. The two companies have announced a multifaceted partnership based on hybrid watches, an area where Citizen has yet to make a splash, but Fossil is already highly accomplished.

There are three parts to the agreement. Citizen will produce movements that use Fossil’s hybrid technology, which will be sold as a component or inside complete watches. It’s not clear whether Citizen will sell this hybrid movement to companies outside its own family, nor do we know which of its own brands will use it. But the pair will continue to work together on future smartwatch technology.

Read more
Fossil’s sexy smartwatches let you watch your heart skip a beat
fossil q explorist hr venture news close face

Fossil knows what it’s doing when it comes to smartwatches, a point proven with its newest Q Explorist HR and Q Venture HR models, which combine plenty of technology with strong designs that retain the iconic Fossil look. These new fourth-generation watches fix one of the issues we had with the older Q Explorist, and with other similar smartwatches — they didn’t quite have the tech ability to replace a good fitness tracker.

Before we get to the tech, let’s look at the differences between the Q Explorist HR and Q Venture HR. It’s all in the design and style. The Q Explorist is the larger of the two watches with a 45mm stainless steel case and a 22mm strap size, while the smaller Q Venture HR has a 40mm case and an 18mm strap. There are five different designs for the Q Venture HR, with stainless steel or gold bodies and leather or metal link straps, or four different Q Explorist HR designs to choose from.

Read more