Skip to main content
  1. Home
  2. Emerging Tech
  3. Health & Fitness
  4. News

Gesture-recognition system can translate sign language into text — and back again

Add as a preferred source on Google

Voice-based dictation tools may be old news from in terms of technology, but not everyone is able to fully take advantage of them. For deaf people who use signing as their primary means of communication, available options are far more limited. That’s even more frustrating when you consider the challenges that may confront a person trying to converse with folks who are not proficient in signing.

A Dallas-based startup is setting out to set things right, though. Called KinTrans, the team has developed smart tech capable of translating sign language into voice and text, and voice taken to text or sign language automatically.

Recommended Videos

The results allow signers and non-signers to communicate together in their own languages, effectively, effortlessly, and instantaneously.

“What makes this technology exciting is the ability to open up conversations between signers and speakers in the marketplace, workplace, schools, health care, and civic centers,” Catherine Bentley, cofounder and business development officer at KinTrans, told Digital Trends. “Traditionally, communicating in these settings has been difficult; requiring friends or family who sign and interpret, or professional interpreters on-site or off-site through video, and even using pen and paper. None of these dependencies are scalable — plus they lack privacy and independence for the signer.”

KinTrans’ tech relies on a 3D camera which tracks the movement of a signer’s hands and body when they sign out words. When requested, it can then translate the signed words into written English (or, currently, Arabic, although additional languages will follow in the future). Alternatively, voice can be translated into signed words communicated by an animated avatar on the screen. According to its creators, the system is already able to recognize thousands of signed words with an accuracy of around 98 percent.

At present, Bentley said that a beta version has been rolled out, and is being used in a variety of service and point-of-sale environments. This is available in both American Sign Language and Arabic Union Sign Language.

“As KinTrans grows, other uses and applications will be developed so that it becomes a standard deaf communication platform, hosting millions of conversations in a variety of public and private settings, online and offline,” she said.

Sign us up!

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
Starlink V5 is here, and it’s lighter, smarter, and far more efficient
The next-generation satellite internet kit promises improved efficiency while maintaining high-speed connectivity.
Starlink V4 vs V5

Not every hardware upgrade needs to be about speed. With Starlink V5, SpaceX is betting that a lighter design and lower power consumption matter just as much. The company has officially introduced its next-generation Starlink V5 kit, featuring a smaller and lighter design with significantly improved power efficiency.

Smaller, lighter, and far more efficient

Read more
Frontier joins the Starlink club with high-speed in-flight internet
The carrier plans to roll out SpaceX's satellite-powered Wi-Fi across its fleet starting in 2027.
Frontier Starlink partnership featured

If there's one thing budget airlines aren't exactly known for, it's great onboard Wi-Fi. In Frontier Airlines' case, it hasn't offered in-flight internet at all. That's about to change. Frontier Airlines has announced a partnership with SpaceX's Starlink to bring high-speed, low-latency internet across its fleet. Installations will begin in early 2027, making Frontier the first ultra-low-cost carrier in the United States to adopt Starlink's satellite-powered connectivity.

Streaming, browsing, and even gaming at 35,000 feet

Read more
OpenAI’s first hardware product sounds more like a companion than a speaker
The AI company is reportedly building a mobile home device that understands context and proactively helps users.
OpenAI press image

For months, rumors have suggested that OpenAI's first hardware product could be a wearable AI device, or perhaps even the beginning of its long-term smartphone ambitions. As it turns out, the company's first gadget may be something far simpler, yet arguably far more ambitious. It will help control smart-home appliances, play media, answer questions, respond to messages, and tap into the range of capabilities offered by OpenAI's ChatGPT, according to people familiar with the matter.

OpenAI's first AI device could end up being a speaker, following plenty of hype that the company is actually working on a wearable AI device and might even launch a smartphone down the road. According to a Bloomberg report, the speaker will serve as a human-like AI companion that will integrate directly with the smart home ecosystem.

Read more