Skip to main content

Google Glass can now add closed captions to real life

google glass can now add closed captions real life
Image used with permission by copyright holder
Google Glass has yet to break into the mainstream thanks to a hefty price tag and a geeky appearance, but the gadget is finding all kinds of niche uses that show some of its potential. A new app from Georgia Institute of Technology researchers is a case in point — it offers real-time closed captioning to help those with hearing problems understand what’s being said.

By using his or her smartphone as a microphone, the Glass wearer can see subtitles appear on screen almost instantly. For someone who usually has trouble hearing what’s being said it can make a huge difference. There’s more in the pipeline too: The software developers are working on a tool that that offers two-way translation between different languages.

The software program, called Captioning On Glass, taps into the speech recognition technology that is built into Glass and backed up by Google’s databases on the Web. Any mistakes can be edited retrospectively by the speaker if necessary.

“This system allows wearers like me to focus on the speaker’s lips and facial gestures,” said Professor Jim Foley of the School of Interactive Computing, who has been testing the system. “If hard-of-hearing people understand the speech, the conversation can continue immediately without waiting for the caption. However, if I miss a word, I can glance at the transcription, get the word or two I need and get back into the conversation.”

“Glass has its own microphone, but it’s designed for the wearer,” explained  Professor Thad Starner, who is working on both this app and Google Glass itself. “The mobile phone puts a microphone directly next to the speaker’s mouth, reducing background noise and helping to eliminate errors.”

Even if the general public aren’t picking up Glass in their droves, airport staff, doctors and police officers are some of the groups of people who have been finding the device useful, and perhaps these smaller successes are all Google is hoping for right now. Head to the Captioning On Glass website to learn more about the app and how to install it.

Editors' Recommendations

David Nield
Dave is a freelance journalist from Manchester in the north-west of England. He's been writing about technology since the…
Google Calendar’s ‘Focus Time’ can now deny unwanted meetings for you
google calendar focus time android

Google Calendar is getting a new Focus Time feature that will be useful for people who get a lot of meeting invites and don't have the time to attend all of them. Focus Time will now automatically deny meetings for you in a selected time slot. The feature works by indicating the working status of users, making it easier to block out time for focused individual work.

In a blog post, Google wrote that it hopes to make it easier to create dedicated time for thinking and core work for users. Focus time is said to function a lot like an Out of Office event. You can now set Focus Time on Google Calendar. It is indicated by a small headphones icon, which can be customized in terms of color so each entry looks different from one and another.

Read more
You can now ask Google Assistant to tie your shoes with expanded app actions
Nike Adapt BB

Google Assistant might be most known for its abilities and functionality within the Google Home and Nest series of devices, but Google is now making it possible to use Google Assistant to perform even more actions within your favorite mobile apps. You can now search and open any apps through Google Assistant on an Android device -- a particularly useful feature if you have more apps installed than you know what to do with. We're not just talking about simple actions like opening apps, but other detailed commands to achieve things like asking Google Assistant to tighten the lace on your sneakers.

If you own a pair of Nike Adapt sneakers, for example, you can ask Google Assistant to tighten the laces for you. Saying "Hey, Google, tighten my shoes with Nike Adapt" will make your shoelaces tighten. If that feels a bit too long to say effectively, you can create voice shortcuts to help streamline the process. The previous command can be shortened to, "Hey, Google, tie my shoes."

Read more
You can buy a Pixel 4a now, but Google’s already teasing the Pixel 5
The Google Pixel 4a, front and back.

Google is going phone crazy for the remainder of 2020. It has announced the long-awaited Google Pixel 4a and teased a future 5G version of the phone, while also confirming the Pixel 5 will arrive in the fall. Having started off the year by discontinuing the Pixel 3a, this is great news for fans of smartphones that boast awesome cameras.

Pixel 4a Google

Read more