Skip to main content

Gesture-recognition system can translate sign language into text — and back again

KinTrans Inclusive Communication Inclusive Community
Voice-based dictation tools may be old news from in terms of technology, but not everyone is able to fully take advantage of them. For deaf people who use signing as their primary means of communication, available options are far more limited. That’s even more frustrating when you consider the challenges that may confront a person trying to converse with folks who are not proficient in signing.

A Dallas-based startup is setting out to set things right, though. Called KinTrans, the team has developed smart tech capable of translating sign language into voice and text, and voice taken to text or sign language automatically.

Recommended Videos

The results allow signers and non-signers to communicate together in their own languages, effectively, effortlessly, and instantaneously.

“What makes this technology exciting is the ability to open up conversations between signers and speakers in the marketplace, workplace, schools, health care, and civic centers,” Catherine Bentley, cofounder and business development officer at KinTrans, told Digital Trends. “Traditionally, communicating in these settings has been difficult; requiring friends or family who sign and interpret, or professional interpreters on-site or off-site through video, and even using pen and paper. None of these dependencies are scalable — plus they lack privacy and independence for the signer.”

KinTrans’ tech relies on a 3D camera which tracks the movement of a signer’s hands and body when they sign out words. When requested, it can then translate the signed words into written English (or, currently, Arabic, although additional languages will follow in the future). Alternatively, voice can be translated into signed words communicated by an animated avatar on the screen. According to its creators, the system is already able to recognize thousands of signed words with an accuracy of around 98 percent.

At present, Bentley said that a beta version has been rolled out, and is being used in a variety of service and point-of-sale environments. This is available in both American Sign Language and Arabic Union Sign Language.

“As KinTrans grows, other uses and applications will be developed so that it becomes a standard deaf communication platform, hosting millions of conversations in a variety of public and private settings, online and offline,” she said.

Sign us up!

Luke Dormehl
Former Digital Trends Contributor
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
3DMakerpro’s Seal is a pocket-sized scanner to make next-gen precision 3D prints
3DMakerpro Seal in hand lifestyle image.

This content was produced in partnership with 3DMakerpro.
3D printing truly is amazing, because you can create virtually anything, as long as you have the blueprints or digital 3D models. But while there is an excellent community behind the creation of these 3D models, and always new items, gadgets, and tools to print, you can be somewhat limited in the sense that you can't just take an item and print it without a little bit of extra work. If you don't have the skills to create a digital design -- or digital copy of an object -- you'll have to wait for the community to put something together, and it may not always match what you're wanting to create. What if there was something so much easier than that, however? What if there was a tool or device that could create remarkably accurate scans of an object and then translate that into a digital format -- one you can reprint in a 3D printer? There is, from 3DMakerpro, and it's called the Seal -- or Seal Lite in the alternative model.

Promising the "ease of scan" and combined with the "art of detail," the 3DMakerpro Seal and Seal Lite will effectively scan an item or object with supreme detail and accuracy -- a superior accuracy of 0.01mm, which is a first in the consumer-grade 3D scanner industry. It supports full color and whole texture capture in high-definition, thanks to a 24-bit high-quality color CMOS image sensor and texture camera. For you, it means that your model scans will truly come to life, including all nuanced details from material textures to fine elements. A scan of a toy dragon, for example, will feature all scales, colors, and fine details.

Read more
You can start exploring your family tree on Ancestry for free right now
Woman researching Ancestry and family tree

This content was produced in partnership with Ancestry.com.
Ever felt curious about your genealogy and ancestry? Want to know where you came from, how your family tree stacks up, and if you have any relatives out there that you don't know about? Of course, we're boiling it down to just the basics here because there's so much more you can learn about yourself and your history, but the point is, now's the perfect time to take the leap. Ancestry® is offering a 14-day free trial to help you get started on your personal history journey. In case that wasn't clear, you can try the platform for 14 days, totally free. There's no promotional code needed. Just sign up on Ancestry as a new subscriber, and you'll get your 14 days. You'll get direct and accurate insights from your DNA, including ethnicity, personal traits, family history, and so much more. It's like cracking open an egg to peer inside, only you're taking a look at your entire lineage. It's certainly exhilarating, and if you've ever been curious about where you come from and knowing your origin story, well, here's your chance.

 
Why you should try Ancestry and explore your lineage

Read more
The most innovative tech products of 2023
Digital Trends picked the most innovative products of 2023.

Our team of writers and editors reviews hundreds of products every year, and we routinely update our lists of the very best laptops, TVs, phones, and more to make sure you can find the right one for you. But let’s be honest: Sometimes the best is boring. For instance, the iPhone still makes the best phone for most people in 2023. A product that’s easy to use, affordable and reliable may be the most pragmatic purchase, but it’s not always exciting.

That’s why once a year, we like to recognize the most innovative products. Whether they introduce a few new features or totally try to reinvent a category, these are the products breaking new ground in technology. Sometimes they’re impractical, overpriced, or just don’t work as intended the first time. But we love them anyway for the sheer chutzpah it takes to try something new. And sometimes, they truly are the best, too.

Read more