Augmented-reality headsets could help helicopter rescue pilots fly in dense fog

By Luke Dormehl Published July 1, 2016

Could augmented reality headsets help helicopter rescue pilots to fly more safely in extreme weather conditions — including heavy fog — in which they have poor visibility? That’s the question set out by a group of researchers at Germany’s Technical University of Munich (TUM). Their answer? An overwhelming yes.

Carried out in collaboration with the Institute of Helicopter Technology, the project uses a helicopter-mounted LIDAR (Light Detection and Ranging) system to create virtual images of upcoming hazards and other obstacles. This signal data is then processed onboard the helicopter and transmitted to the transparent head-mounted display worn by pilots.

1 of 5

augmented reality pilots pilot mit helmsichtger t — Image used with permission by copyright holder

augmented reality pilots dcim101gopro — DCIM101GOPRO Image used with permission by copyright holder

augmented reality pilots dsc 0213 — Image used with permission by copyright holder

augmented reality pilots dsc 0201 — Image used with permission by copyright holder

augmented reality pilots blick durch helmsichtger t — Image used with permission by copyright holder

“Databases containing obstacles and terrain data are used together with real-time data from sensors in order to substitute the lost visual cues in degraded visual environment” Franz Viertler, a professor of aeronautical engineering who worked on the project, told Digital Trends. “The other part of the research then deals with how to best visualize the data for the pilot in order to enable a safe flight. The head-mounted display is a perfect means to do this, because the pilots can keep their eyes out of the window, while they get additional information about hazardous obstacles.”

Recommended Videos

As part of the study, sixteen professional helicopter pilots were given the chance to try out the head-mounted display during simulator flights. Pilots were found to fly more quickly and safely when they were using the augmented reality displays — with the most noticeable results coming when they were flying in extremely poor visibility conditions.

Despite these promising results, however, Viertler notes that there is still work to be done before this tech can be rolled out in the real world. Part of this is technological, but a bigger factor will be the legal tests it needs to undergo. “The certification of this technology in the field of aviation requires additional time and effort,” he says. “Thus air rescue providers or other potential operators will have to wait about five to ten years until they can benefit from this technology.”

Hopefully it will be well worth the wait.

Former Contributor

I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…

Topics

Cars

The Apple Car may be dead, but it became the foundation of Apple Intelligence

A decade of work on a canceled car project reportedly laid the groundwork for Apple Intelligence.

Apple Intelligence in Apple Car

The Apple Car may have never left the garage, but it apparently gave birth to Apple's AI ambitions. According to Bloomberg's Mark Gurman, Apple's canceled autonomous vehicle project, one that consumed more than a decade of work and over $10 billion before being scrapped in 2024, ended up laying the technological foundation for Apple Intelligence. In a rather ironic twist, one of Apple's most expensive failures may also become one of its most important long-term investments.

The Apple Car forced Apple to think like an AI company

Emerging Tech

Researchers hid a prompt injection inside a PNG, and AI fell for it

Hacker

AI coding assistants like Claude are becoming every developer's favorite coworker. They can review code, explain confusing functions, and even write entire features with a single prompt. But new research suggests that this growing trust could also become their biggest weakness.

A team of security researchers (professor Sudipta Chattopadhyay and researcher Murali Ediga) has demonstrated an unusual attack that doesn't target the AI model directly. Instead, it targets what the AI doesn't pay enough attention to during code reviews. Rather than hiding malicious instructions in lines of code, the researchers tucked them inside an image file. Since many AI review tools treat images as decorative assets rather than as something worth inspecting, the pull request can appear perfectly harmless and sail through the review.

Emerging Tech

AI has already fallen into the wrong hands and they’re using it to make bombs

Artificial intelligence has quickly become the go-to tool for everything from writing emails and summarizing meetings to helping students study or developers debug code. But the same technology that saves people time can also be misused, and a new report suggests that terrorist organizations are finding ways to do exactly that.

According to a research paper shared with The New York Times ahead of its publication, researchers found evidence that members of Boko Haram have been using popular AI chatbots to support both day-to-day activities and combat-related tasks. Interviews with 27 former members conducted in Nigeria over the past two years suggest that tools such as ChatGPT, Gemini, Claude, Grok, Meta AI, and DeepSeek were used to gather technical information, troubleshoot weapons, and even assist with planning attacks.