Skip to main content

Gesture-recognition system can translate sign language into text — and back again

KinTrans Inclusive Communication Inclusive Community
Voice-based dictation tools may be old news from in terms of technology, but not everyone is able to fully take advantage of them. For deaf people who use signing as their primary means of communication, available options are far more limited. That’s even more frustrating when you consider the challenges that may confront a person trying to converse with folks who are not proficient in signing.

A Dallas-based startup is setting out to set things right, though. Called KinTrans, the team has developed smart tech capable of translating sign language into voice and text, and voice taken to text or sign language automatically.

The results allow signers and non-signers to communicate together in their own languages, effectively, effortlessly, and instantaneously.

“What makes this technology exciting is the ability to open up conversations between signers and speakers in the marketplace, workplace, schools, health care, and civic centers,” Catherine Bentley, cofounder and business development officer at KinTrans, told Digital Trends. “Traditionally, communicating in these settings has been difficult; requiring friends or family who sign and interpret, or professional interpreters on-site or off-site through video, and even using pen and paper. None of these dependencies are scalable — plus they lack privacy and independence for the signer.”

KinTrans’ tech relies on a 3D camera which tracks the movement of a signer’s hands and body when they sign out words. When requested, it can then translate the signed words into written English (or, currently, Arabic, although additional languages will follow in the future). Alternatively, voice can be translated into signed words communicated by an animated avatar on the screen. According to its creators, the system is already able to recognize thousands of signed words with an accuracy of around 98 percent.

At present, Bentley said that a beta version has been rolled out, and is being used in a variety of service and point-of-sale environments. This is available in both American Sign Language and Arabic Union Sign Language.

“As KinTrans grows, other uses and applications will be developed so that it becomes a standard deaf communication platform, hosting millions of conversations in a variety of public and private settings, online and offline,” she said.

Sign us up!

Luke Dormehl
Former Digital Trends Contributor
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
The 11 best Father’s Day deals that you can get for Sunday
Data from a workout showing on the screen of the Apple Watch Series 8.

Father's Day is fast approaching and there's still time to buy your beloved Dad a sweet new device to show him how much you love him. That's why we've rounded up the ten best Father's Day tech deals going on right now. There's something for most budgets here, including if you're able to spend a lot on your loved one. Read on while we take you through the highlights and remember to order fast so you don't miss out on the big day.
Samsung Galaxy Tab A8 -- $200, was $230

While it's the Plus version of the Samsung Galaxy Tab A8 that features in our look at the best tablets, the standard variety is still worth checking out. Saving your Dad the need to dig out their laptop or squint at a small phone screen, the Samsung Galaxy Tab A8 offers a large 10.5-inch LCD display and all the useful features you would expect. 128GB of storage means plenty of room for all your Dad's favorite apps as well as games too. A long-lasting battery and fast charging save him the need for a power source too often too.

Read more
The Apollo wearable is proven to help you sleep better (and it’s on sale)
Apollo wearable worn during sleep in bed.

This content was produced in partnership with Apollo Neuro.
Stress, anxiety, and insomnia are all concerning things that just about everyone struggles with at one time or another. Maybe you can sleep, fending off insomnia, but you lack quality sleep and don’t feel rested in the morning. Or, maybe when it’s time to kick back and relax, you just can’t find a way to do so. There are many solutions for these issues, some work, and others don’t, but one unlikely area of support can be found in a modern, smart wearable.

Medicine is the obvious choice, but not everyone prefers to go that route. There is an answer in modern technology or rather a modern wearable device. One such device is the Apollo wearable, which improves sleep and stress relief via touch therapy. According to Apollo Neuro, the company behind the device, which is worn on your ankle, wrist or clipped to your clothing, it sends out waves of vibrations to help your body relax and reduce feelings of stress. It's an interesting new approach to a common problem that has typically been resolved via medicine, therapy, or other more invasive and time-consuming techniques. The way it utilizes those vibrations, uniquely placed and administered, to create a sense of peace, makes us ask, can it really cure what ails us? We’ll dig a little deeper into how it achieves what it does and what methods it’s using to make you feel better.

Read more
What comes after Webb? NASA’s next-generation planet-hunting telescope
An illustration shows how NASA's Habitable Worlds Observatory would measure the atmosphere of distant planets.

When it comes to building enormous, complex space telescopes, agencies like NASA have to plan far in advance. Even though the James Webb Space Telescope only launched recently, astronomers are already busy thinking about what will come after Webb — and they've got ambitious plans.

The big plan for the next decades of astronomy research is to find habitable planets, and maybe even to search for signs of life beyond Earth. That's the lofty goal of the Habitable Worlds Observatory, a space telescope currently in the planning phase that is aimed at discovering 25 Earth-like planets around sun-like stars.

Read more