Skip to main content

Google Glass can now add closed captions to real life

google glass can now add closed captions real life
Google Glass has yet to break into the mainstream thanks to a hefty price tag and a geeky appearance, but the gadget is finding all kinds of niche uses that show some of its potential. A new app from Georgia Institute of Technology researchers is a case in point — it offers real-time closed captioning to help those with hearing problems understand what’s being said.

By using his or her smartphone as a microphone, the Glass wearer can see subtitles appear on screen almost instantly. For someone who usually has trouble hearing what’s being said it can make a huge difference. There’s more in the pipeline too: The software developers are working on a tool that that offers two-way translation between different languages.

The software program, called Captioning On Glass, taps into the speech recognition technology that is built into Glass and backed up by Google’s databases on the Web. Any mistakes can be edited retrospectively by the speaker if necessary.

“This system allows wearers like me to focus on the speaker’s lips and facial gestures,” said Professor Jim Foley of the School of Interactive Computing, who has been testing the system. “If hard-of-hearing people understand the speech, the conversation can continue immediately without waiting for the caption. However, if I miss a word, I can glance at the transcription, get the word or two I need and get back into the conversation.”

“Glass has its own microphone, but it’s designed for the wearer,” explained  Professor Thad Starner, who is working on both this app and Google Glass itself. “The mobile phone puts a microphone directly next to the speaker’s mouth, reducing background noise and helping to eliminate errors.”

Even if the general public aren’t picking up Glass in their droves, airport staff, doctors and police officers are some of the groups of people who have been finding the device useful, and perhaps these smaller successes are all Google is hoping for right now. Head to the Captioning On Glass website to learn more about the app and how to install it.

Editors' Recommendations

David Nield
Dave is a freelance journalist from Manchester in the north-west of England. He's been writing about technology since the…
You can now ask Google Assistant to tie your shoes with expanded app actions
Nike Adapt BB

Google Assistant might be most known for its abilities and functionality within the Google Home and Nest series of devices, but Google is now making it possible to use Google Assistant to perform even more actions within your favorite mobile apps. You can now search and open any apps through Google Assistant on an Android device -- a particularly useful feature if you have more apps installed than you know what to do with. We're not just talking about simple actions like opening apps, but other detailed commands to achieve things like asking Google Assistant to tighten the lace on your sneakers.

If you own a pair of Nike Adapt sneakers, for example, you can ask Google Assistant to tighten the laces for you. Saying "Hey, Google, tighten my shoes with Nike Adapt" will make your shoelaces tighten. If that feels a bit too long to say effectively, you can create voice shortcuts to help streamline the process. The previous command can be shortened to, "Hey, Google, tie my shoes."

Read more
You can buy a Pixel 4a now, but Google’s already teasing the Pixel 5
The Google Pixel 4a, front and back.

Google is going phone crazy for the remainder of 2020. It has announced the long-awaited Google Pixel 4a and teased a future 5G version of the phone, while also confirming the Pixel 5 will arrive in the fall. Having started off the year by discontinuing the Pixel 3a, this is great news for fans of smartphones that boast awesome cameras.

Pixel 4a Google

Read more
Google Lens can now copy real-life text and paste it into your computer
google lens copy text to computer

Listen to printed text read out loud with Google Lens

Carrying a smartphone with the Google Lens app is now almost like having a scanner in your pocket, thanks to an update that copies text that you see in real life to paste to your computer.

Read more