Skip to main content

Innovative edge-finding AR eyepiece lets firefighters see through smoke

Nobody is at their best in a fire. Firefighters may be a rare breed in terms of their willingness to venture into a deadly blaze, rather than running away from it. However, no matter how brave firefighters may be, there’s no doubt that a fire represents an incredibly physically tough scenario which severely limits mental and physical capabilities. Could cutting-edge technology be used to lend a helping hand?

“When you’re inside a structured fire, it’s difficult to see because there’s smoke everywhere and your senses are impaired,” Sam Cossman, CEO and co-founder of Qwake Technologies, told Digital Trends. “It’s difficult to think because you’re in such a stressful situation, which can cause cognitive function to decline and lead to bad decision-making. And it’s difficult to communicate. If you’ve ever been in a fire you’ll know that it’s like standing next to a freight train. It’s extremely loud and dynamic.”

Qwake C-Thru AR HUD on a firefighter's helmet
Qwake

To help, Cossman and his colleagues have developed a smart helmet device called C-Thru, a head-up display which fits over one eye within a regular firefighter’s breathing apparatus. This augmented reality feed presents them with a video stream taken from an on-board thermal camera. It then uses some smart artificial intelligence image recognition to show the outlines of objects and people in green; giving the firefighters the ability to see what they’re doing even in the smokiest of rooms. In the process, the team believes that it has created a next-gen first responder tool that harnesses cutting-edge tech to solve a major life-threatening problem.

While firefighters have long carried thermal cameras, these have been handheld devices with small displays that require their users to look away from the scene directly in front of them to be able to use them. That problem would be removed by the use of the hands-free C-Thru device.

Sample footage showing the difference between what firefighters see with and without Qwake's C-Thru HUD Qwake

“We’re taking complex information from an environment that could potentially be hazardous or life-threatening, and extending your natural abilities with the use of sensors,” Cossman said. “We then display that sensor information with brain-friendly intuitive cues that could help you get the information you need right when you need it. That is the core underlying goal of our platform.”

A background in extreme exploration

Thirty-eight year old adventurer Cossman said that the impetus for his work at Qwake started half a decade ago.

“My background is in extreme exploration,” he said. “For many years, I’ve been guiding scientific expeditions into remote locations. [In 2015,] we were working with the government in Nicaragua to develop an early-warning system that leveraged A.I. to predict volcanic activity.”

“We started to wonder what would happen if we … [provided] all of them with it — and then connected them.”

The project involved Cossman and others descending 1,200 feet into Masaya, an active volcano in Nicaragua. There, they installed sensors that would allow researchers to measure information such as temperature, humidity, pressure, and carbon dioxide in real-time.

“We couldn’t see where we were going inside this gas-filled crater,” he continued. “I was looking for a tool that would help myself and my team to navigate more effectively in that environment.”

Online, Cossman discovered a concept developed by a Turkish industrial designer named Omer Haciomeroglu. “It was touting the promise of similar functionality to [what we’re creating in 2020], but it wasn’t yet real,” Cossman said. “He and I started looking at what it would take to make it real.”

Qwake C-Thru AR HUD in a testing environment
Qwake

Today, Qwake has a team comprised of various researchers from different backgrounds. There’s a neuroscientist, a computer vision expert, a NASA rocket scientist-turned-career firefighter, and more. Cossman says that it is the “art of cross-disciplinary thinking” that has led to the project developing to its current point. It has also seen it expand its ambitions far beyond the limited use-case Cossman originally planned to use the technology for.

First responder tech

The C-Thru system isn’t just about providing firefighters with hands-free thermal vision. The headsets will also make it easier for firefighters to communicate with one another on the job, transmitting data to one another in a way which is far more advanced than the simple push-to-talk radio communication they previously used.

“We started to wonder what would happen if we didn’t just provide one firefighter with this augmented reality tool, but all of them with it — and then connected them,” Cossman said. “That’s when we started realizing that what we were building wasn’t just a vision assistant for one person but an entire visual communication platform, where people would be able to use a whole new visual language to transmit directional cues between parties.”

Qwake C-Thru AR HUD on a firefighter's helmet in smoke
Qwake

Qwake isn’t the only high-tech initiative seeking to help out firefighters. Since 2013, engineers at Italy’s IIT-Istituto Italiano di Tecnologia have been working on a robot called Walk-Man, which is designed to serve as a robot emergency responder which could assist human firefighters. Walk-Man can locate the position of fires, walk toward the blaze, and then activate a fire extinguisher. It can also collect images from its environment and send them back to a human emergency team, who can use the data to analyze the situation and guide the robot. Once both this project and Qwake’s C-Thru tech are ready for prime-time, it’s easy to imagine a combination of both being used to transform the way that fires are fought in the 2020s.

When it comes to C-Thru, Sam Cossman said that he is “not at liberty” to yet share all the details about the project, including its exact release date. Nonetheless, he noted that, “We’re looking at 2021 as general availability for this product.” Provided that it lives up to its potential, this could turn out to be a game-changer for the brave men and women firefighters who put their lives at risk on a regular basis.

It won’t come a moment too soon!

Age of Ai Full Episode - C -Thru (Final)

Editors' Recommendations

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
Digital Trends’ Top Tech of CES 2023 Awards
Best of CES 2023 Awards Our Top Tech from the Show Feature

Let there be no doubt: CES isn’t just alive in 2023; it’s thriving. Take one glance at the taxi gridlock outside the Las Vegas Convention Center and it’s evident that two quiet COVID years didn’t kill the world’s desire for an overcrowded in-person tech extravaganza -- they just built up a ravenous demand.

From VR to AI, eVTOLs and QD-OLED, the acronyms were flying and fresh technologies populated every corner of the show floor, and even the parking lot. So naturally, we poked, prodded, and tried on everything we could. They weren’t all revolutionary. But they didn’t have to be. We’ve watched enough waves of “game-changing” technologies that never quite arrive to know that sometimes it’s the little tweaks that really count.

Read more
Digital Trends’ Tech For Change CES 2023 Awards
Digital Trends CES 2023 Tech For Change Award Winners Feature

CES is more than just a neon-drenched show-and-tell session for the world’s biggest tech manufacturers. More and more, it’s also a place where companies showcase innovations that could truly make the world a better place — and at CES 2023, this type of tech was on full display. We saw everything from accessibility-minded PS5 controllers to pedal-powered smart desks. But of all the amazing innovations on display this year, these three impressed us the most:

Samsung's Relumino Mode
Across the globe, roughly 300 million people suffer from moderate to severe vision loss, and generally speaking, most TVs don’t take that into account. So in an effort to make television more accessible and enjoyable for those millions of people suffering from impaired vision, Samsung is adding a new picture mode to many of its new TVs.
[CES 2023] Relumino Mode: Innovation for every need | Samsung
Relumino Mode, as it’s called, works by adding a bunch of different visual filters to the picture simultaneously. Outlines of people and objects on screen are highlighted, the contrast and brightness of the overall picture are cranked up, and extra sharpness is applied to everything. The resulting video would likely look strange to people with normal vision, but for folks with low vision, it should look clearer and closer to "normal" than it otherwise would.
Excitingly, since Relumino Mode is ultimately just a clever software trick, this technology could theoretically be pushed out via a software update and installed on millions of existing Samsung TVs -- not just new and recently purchased ones.

Read more
AI turned Breaking Bad into an anime — and it’s terrifying
Split image of Breaking Bad anime characters.

These days, it seems like there's nothing AI programs can't do. Thanks to advancements in artificial intelligence, deepfakes have done digital "face-offs" with Hollywood celebrities in films and TV shows, VFX artists can de-age actors almost instantly, and ChatGPT has learned how to write big-budget screenplays in the blink of an eye. Pretty soon, AI will probably decide who wins at the Oscars.

Within the past year, AI has also been used to generate beautiful works of art in seconds, creating a viral new trend and causing a boon for fan artists everywhere. TikTok user @cyborgism recently broke the internet by posting a clip featuring many AI-generated pictures of Breaking Bad. The theme here is that the characters are depicted as anime characters straight out of the 1980s, and the result is concerning to say the least. Depending on your viewpoint, Breaking Bad AI (my unofficial name for it) shows how technology can either threaten the integrity of original works of art or nurture artistic expression.
What if AI created Breaking Bad as a 1980s anime?
Playing over Metro Boomin's rap remix of the famous "I am the one who knocks" monologue, the video features images of the cast that range from shockingly realistic to full-on exaggerated. The clip currently has over 65,000 likes on TikTok alone, and many other users have shared their thoughts on the art. One user wrote, "Regardless of the repercussions on the entertainment industry, I can't wait for AI to be advanced enough to animate the whole show like this."

Read more