Your smartwatch could soon let you control your PC through hand gestures

Can your smartwatch replace your mouse? This research says yes

By Manisha Priyadarshini Published April 6, 2026

smartwatch-sonar-tech-watch-hand — Doctoral student Chi-Jung Lee demonstrates the WatchHand device, which potentially could allow people to move screens on their computers without a mouse or tracking pad. Jason Koski / Cornell University

Your smartwatch might be more capable than you think. Researchers at Cornell University and KAIST in South Korea have developed a system called WatchHand that turns any regular smartwatch into a hand-tracking device.

The best part is that it doesn’t require any extra hardware to do so. According to the published paper, the technology uses AI-powered micro sonar to read your hand movements and finger positions in real time, and it works using hardware your watch already has.

So, how does WatchHand actually work?

Your smartwatch has a built-in speaker and microphone. WatchHand puts both to work in a way you’d never expect. The speaker emits inaudible sound waves that bounce off your hand and back into the microphone, creating a unique echo pattern.

An AI algorithm running directly on the watch reads that pattern and maps your hand position in 3D. Think of it like the echolocation bats use to navigate, except it fits on your wrist. Because everything is processed on the watch itself, none of your movement data gets sent anywhere else.

What can WatchHand do for you?

The practical applications are genuinely exciting. Double-tapping your fingers could skip a track. Subtle hand gestures could move your cursor without touching your mouse or trackpad.

Recommended Videos

Down the line, WatchHand could potentially track your typing, serve as a controller in augmented or virtual reality, and support people with limited mobility who struggle with traditional input devices.

Researchers also believe a software update alone could bring this capability to millions of existing smartwatches already in people’s hands.

Although there are some limitations worth knowing. WatchHand currently only works on Android, not Apple watches, and it has trouble keeping up when you’re walking. But for a first-of-its-kind system built entirely on hardware you already own, that’s a pretty strong start.

Smartwatches are clearly becoming a lot more ambitious than anyone expected, as researchers are also working on a wrist-worn device that can detect microplastics inside your body.

Manisha Priyadarshini

News Writer

Manisha Priyadarshini is a tech and entertainment writer with over nine years of editorial experience.

Topics

Emerging Tech

Anti-surveillance clothing is getting cheaper, but don’t expect an invisibility cloak

Affordable shirts now claim to confuse facial recognition, although their protection depends heavily on the camera and software watching you

Chart, Plot, Adult

Anti-surveillance clothing is starting to look less like an art-school experiment and more like something you could actually wear outside. Shirts designed to confuse facial recognition systems now cost about as much as ordinary streetwear, although buying one won’t make you disappear.

The Guardian reports that designers are using face-like prints, unusual cuts and infrared lights to interfere with computer vision. These techniques target specific weaknesses, so their success depends on what happens to be watching you.

Emerging Tech

This spinning drone hides in plain sight using a visual illusion

This drone doesn't turn invisible. It tricks your brain into thinking it has.

Phantom Twist

For decades, engineers have chased the dream of an invisible drone. The usual approaches have involved transparent materials, camouflage coatings, or complex optical systems that bend light around an object. Researchers at Northwestern University decided to take a completely different route. Instead of hiding the drone itself, they chose to fool the human eye.

The result is Phantom Twist, an experimental drone that spins so rapidly it almost disappears into the background. It's not technically invisible, but to anyone watching, it looks more like a faint blur than a flying machine.

Emerging Tech

This smart knitted fabric can flip switches, count your steps, and even change shape

Grandma's knitting just entered its Iron Man era

Representative Image

For most of us, knitting brings to mind sweaters, scarves, and perhaps an ambitious grandmother determined to make winter more fashionable. Researchers at Harvard University, however, have a far more futuristic vision. They've transformed ordinary knitted fabric into a programmable material capable of changing shape, acting as an electrical switch, sensing movement, and potentially forming the foundation of tomorrow's wearable technology.

The research, published in Advanced Functional Materials by scientists at the Harvard John A. Paulson School of Engineering and Applied Sciences (SEAS), demonstrates how machine-knitted textiles can "snap" between multiple stable shapes without relying on motors or rigid mechanical parts.