Skip to main content

This clever headset creates 3D sound maps for the blind, but isn’t as cute as a guide dog

Microsoft has been working on developing a headset which will create a sound map of a city, to help blind and partially sighted people better navigate through their surroundings. It’s part of a project called Cities Unlocked, where Microsoft has teamed up a wide variety of other companies, including the Guide Dogs for the Blind charity in the UK, and wearable tech specialists AfterShokz.

Here’s how it works. The headset doesn’t cover your ears, but uses bone-conducting audio to ensure you’re always aware of your surroundings. Once it is paired with a Windows Phone mobile device, it picks up signals from Bluetooth beacons spread around the city, and creates a 3D audio map using a combination of clicks, beeps, and verbal descriptions.

Recommended Videos

The sound is directional and alters in pitch and tone, so it can be used to lead someone to their destination, much like a digital guide dog. Because some of the audio map is generated using Bing and Google maps, it can provide contextual information along the way, including street names, points of interest, public transport locations, shops, and even details on road works. The headset appears to be a modified version of Aftershokz Bluez headphones, and has GPS, an accelerometer, and a gyroscope inside, so it knows which way the wearer is facing, and if they turn their head.

Currently only a prototype, the headset is being paired with a Lumia 930 and Lumia 1520 for tests, which have been taking place along a specially designed route between London and nearby city Reading. According to research, there are 180,000 people with sight loss in the UK who find it too stressful to leave their homes. The Cities Unlocked project wants to change that using its augmented reality headset, and in these early tests 62 percent of wearers felt safer, and more confident when wearing it. It’s also hoped the headset will increase spontaneity, independence, and mobility.

Microsoft’s tech won’t replace the hard-working guide dog, or even a cane, but it has potential to enrich people’s lives. One volunteer working on the project told a local newspaper, “There are things the technology can’t do, like tell me when there is traffic coming, so I would keep my dog for those purposes, but knowing that there is a post box coming up, or that there is a bank nearby is very helpful.”

It’s still early days for Cities Unlocked, and before the headset can be used widely, our cities need to become smarter. For now, it’s a fascinating glimpse into how wearable technology, Bluetooth beacons, and smartphones can help improve lives when used together.

Andy Boxall
Andy is a Senior Writer at Digital Trends, where he concentrates on mobile technology, a subject he has written about for…
Best Cyber Monday Smartwatch Deals: Apple Watch, Fitbit, Galaxy Watch
Best Cyber Monday Smartwatch Deals

Cyber Monday may be over, but the best Cyber Monday deals have still stuck around. Some of the other deals we've seen  have sold out fast over the weekend, so if you spot something you like below, snap it up fast. We've rounded up some of the best Cyber Monday smartwatch deals on brands like Samsung, Fitbit, and Garmin. We've even collected some Apple deals, but if you want to read about them specifically, be sure to check out our list of the best Cyber Monday Apple Watch deals.
Best Cyber Monday Smartwatch Deals
Apple Watch SE (40mm, GPS) -- $149, was $279

When the first-generation Apple Watch SE was released in 2020, we described it as the best Apple Watch for most people. While a lot of things have changed since then, including the launch of the second-generation Apple Watch SE, the original budget Apple Watch remains a worthwhile purchase in the Cyber Monday smartwatch deals for iPhone owners who want to try what it's like to own a wearable device. The smartwatch offers comprehensive health-tracking features and responsive performance, while also providing you with notifications from your iPhone.

Read more
Digital Trends’ Top Tech of CES 2023 Awards
Best of CES 2023 Awards Our Top Tech from the Show Feature

Let there be no doubt: CES isn’t just alive in 2023; it’s thriving. Take one glance at the taxi gridlock outside the Las Vegas Convention Center and it’s evident that two quiet COVID years didn’t kill the world’s desire for an overcrowded in-person tech extravaganza -- they just built up a ravenous demand.

From VR to AI, eVTOLs and QD-OLED, the acronyms were flying and fresh technologies populated every corner of the show floor, and even the parking lot. So naturally, we poked, prodded, and tried on everything we could. They weren’t all revolutionary. But they didn’t have to be. We’ve watched enough waves of “game-changing” technologies that never quite arrive to know that sometimes it’s the little tweaks that really count.

Read more
Digital Trends’ Tech For Change CES 2023 Awards
Digital Trends CES 2023 Tech For Change Award Winners Feature

CES is more than just a neon-drenched show-and-tell session for the world’s biggest tech manufacturers. More and more, it’s also a place where companies showcase innovations that could truly make the world a better place — and at CES 2023, this type of tech was on full display. We saw everything from accessibility-minded PS5 controllers to pedal-powered smart desks. But of all the amazing innovations on display this year, these three impressed us the most:

Samsung's Relumino Mode
Across the globe, roughly 300 million people suffer from moderate to severe vision loss, and generally speaking, most TVs don’t take that into account. So in an effort to make television more accessible and enjoyable for those millions of people suffering from impaired vision, Samsung is adding a new picture mode to many of its new TVs.
[CES 2023] Relumino Mode: Innovation for every need | Samsung
Relumino Mode, as it’s called, works by adding a bunch of different visual filters to the picture simultaneously. Outlines of people and objects on screen are highlighted, the contrast and brightness of the overall picture are cranked up, and extra sharpness is applied to everything. The resulting video would likely look strange to people with normal vision, but for folks with low vision, it should look clearer and closer to "normal" than it otherwise would.
Excitingly, since Relumino Mode is ultimately just a clever software trick, this technology could theoretically be pushed out via a software update and installed on millions of existing Samsung TVs -- not just new and recently purchased ones.

Read more