Skip to main content

Smart gloves can recognize American Sign Language and convert to text

gloves american sign language text 30142539 l
Monika Wisniewska/123RF
One of the areas where it’s been truly amazing to watch technology make progress over the past few years is in accessibility. From gadgets that are designed to help blind people to see the world around them, to assistive technology that can help paralyzed people to walk, it’s a pleasure to be able to write about technology that can profoundly transform people’s lives for the better.

The latest potential example? A low-cost smart glove created by researchers at the University of California San Diego, which promises to automatically translate American Sign Language (ASL) into digital text that appears on a corresponding computer or smartphone. To use the glove, the wearer simply signs letters in the ASL alphabet, which are then recognized by way of variances in the electrical resistance. These variances allow an onboard computer to work out which letter is being signed, and then to relay this information via Bluetooth — no cameras required.

“The key innovative element of our device is the use of a conductive polymer composite at the knuckles, which are highly sensitive to bending and stretching,” Dr. Darren Lipomi, head of UC San Diego’s Lipomi Research Group, told Digital Trends. “There are other gesture-recognition gloves out there, but ours is the first to use extremely simple components that can be replicated by other researchers in the field of stretchable, wearable electronics to test their materials.”

The components in the glove add up to less than $100 in cost, making this a potentially affordable solution to a challenging problem.

Image used with permission by copyright holder

“The [biggest] challenge of the project was one of integration,” Lipomi continued. “My research team is made up of chemists, chemical engineers, and materials scientists — me included. We are not specialists in electronics. The key was getting advanced materials to interact with electronic components one might find at a hardware store.”

Lipomi says that “essentially all the credit” goes to his graduate student, Timothy O’Connor, who worked tirelessly for two years to complete the project.

As to what’s next for the project, Lipomi said the next step is to incorporate tactile sensations on the interior of the glove. In addition to signing, he said he thinks there are also commercializable aspects in both virtual and augmented reality, as well as robotic surgery, medical training, and gaming.

A paper describing the work was published in the journal PLOS One.

Editors' Recommendations

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
This AI cloned my voice using just three minutes of audio
acapela group voice cloning ad

There's a scene in Mission Impossible 3 that you might recall. In it, our hero Ethan Hunt (Tom Cruise) tackles the movie's villain, holds him at gunpoint, and forces him to read a bizarre series of sentences aloud.

"The pleasure of Busby's company is what I most enjoy," he reluctantly reads. "He put a tack on Miss Yancy's chair, and she called him a horrible boy. At the end of the month, he was flinging two kittens across the width of the room ..."

Read more
Digital Trends’ Top Tech of CES 2023 Awards
Best of CES 2023 Awards Our Top Tech from the Show Feature

Let there be no doubt: CES isn’t just alive in 2023; it’s thriving. Take one glance at the taxi gridlock outside the Las Vegas Convention Center and it’s evident that two quiet COVID years didn’t kill the world’s desire for an overcrowded in-person tech extravaganza -- they just built up a ravenous demand.

From VR to AI, eVTOLs and QD-OLED, the acronyms were flying and fresh technologies populated every corner of the show floor, and even the parking lot. So naturally, we poked, prodded, and tried on everything we could. They weren’t all revolutionary. But they didn’t have to be. We’ve watched enough waves of “game-changing” technologies that never quite arrive to know that sometimes it’s the little tweaks that really count.

Read more
Digital Trends’ Tech For Change CES 2023 Awards
Digital Trends CES 2023 Tech For Change Award Winners Feature

CES is more than just a neon-drenched show-and-tell session for the world’s biggest tech manufacturers. More and more, it’s also a place where companies showcase innovations that could truly make the world a better place — and at CES 2023, this type of tech was on full display. We saw everything from accessibility-minded PS5 controllers to pedal-powered smart desks. But of all the amazing innovations on display this year, these three impressed us the most:

Samsung's Relumino Mode
Across the globe, roughly 300 million people suffer from moderate to severe vision loss, and generally speaking, most TVs don’t take that into account. So in an effort to make television more accessible and enjoyable for those millions of people suffering from impaired vision, Samsung is adding a new picture mode to many of its new TVs.
[CES 2023] Relumino Mode: Innovation for every need | Samsung
Relumino Mode, as it’s called, works by adding a bunch of different visual filters to the picture simultaneously. Outlines of people and objects on screen are highlighted, the contrast and brightness of the overall picture are cranked up, and extra sharpness is applied to everything. The resulting video would likely look strange to people with normal vision, but for folks with low vision, it should look clearer and closer to "normal" than it otherwise would.
Excitingly, since Relumino Mode is ultimately just a clever software trick, this technology could theoretically be pushed out via a software update and installed on millions of existing Samsung TVs -- not just new and recently purchased ones.

Read more