Augmented-reality headsets could help helicopter rescue pilots fly in dense fog

By Luke Dormehl July 1, 2016

Helicopter Flight: Visual Augmentation with Head Mounted Display (HMD)

Could augmented reality headsets help helicopter rescue pilots to fly more safely in extreme weather conditions — including heavy fog — in which they have poor visibility? That’s the question set out by a group of researchers at Germany’s Technical University of Munich (TUM). Their answer? An overwhelming yes.

Carried out in collaboration with the Institute of Helicopter Technology, the project uses a helicopter-mounted LIDAR (Light Detection and Ranging) system to create virtual images of upcoming hazards and other obstacles. This signal data is then processed onboard the helicopter and transmitted to the transparent head-mounted display worn by pilots.

1 of 5

augmented reality pilots pilot mit helmsichtger t — Image used with permission by copyright holder

augmented reality pilots dcim101gopro — DCIM101GOPRO Image used with permission by copyright holder

augmented reality pilots dsc 0213 — Image used with permission by copyright holder

augmented reality pilots dsc 0201 — Image used with permission by copyright holder

augmented reality pilots blick durch helmsichtger t — Image used with permission by copyright holder

“Databases containing obstacles and terrain data are used together with real-time data from sensors in order to substitute the lost visual cues in degraded visual environment” Franz Viertler, a professor of aeronautical engineering who worked on the project, told Digital Trends. “The other part of the research then deals with how to best visualize the data for the pilot in order to enable a safe flight. The head-mounted display is a perfect means to do this, because the pilots can keep their eyes out of the window, while they get additional information about hazardous obstacles.”

As part of the study, sixteen professional helicopter pilots were given the chance to try out the head-mounted display during simulator flights. Pilots were found to fly more quickly and safely when they were using the augmented reality displays — with the most noticeable results coming when they were flying in extremely poor visibility conditions.

Despite these promising results, however, Viertler notes that there is still work to be done before this tech can be rolled out in the real world. Part of this is technological, but a bigger factor will be the legal tests it needs to undergo. “The certification of this technology in the field of aviation requires additional time and effort,” he says. “Thus air rescue providers or other potential operators will have to wait about five to ten years until they can benefit from this technology.”

Hopefully it will be well worth the wait.

Editors' Recommendations

Topics

Contributor

I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…

Photography

Adobe Aero let me walk through my own photos in augmented reality

adobe aero hands on impressions 7445

The best views make the camera slung around my neck seem insufficient to capture the breadth of the scene. A flat image is simply insufficient to capture the full awe of walking through a jungle dotted with capuchin monkeys, gator spotting on an airboat through the Everglades, or seeing my baby’s first smile.

That’s why I was intrigued by Adobe Aero, the new app in the Creative Cloud family that turns Photoshop files into augmented reality. The free iOS app aims to allow creatives to build AR experiences without any coding. Essentially, Aero brings Photoshop files into a 3D space, placing them in the world around you using your device's camera. With a few intuitive tools to animate and add depth, it makes for a whole new way to enjoy your photographs or build new scenes from scratch.
Aero planes
Lacking the graphic design savvy to actually create my own 3D objects, I decided to use Adobe Aero to take a walk through my own photographs, reliving moments of my travels from my snow-encrusted backyard.

Mobile

The Qualcomm XR2 augmented reality chipset will power next-gen headsets with 5G

qualcomm snapdragon xr2 augmented reality news

There's a new AR in town: Qualcomm unveiled the Snapdragon XR2 chipset for a new generation of augmented reality devices at its annual Snapdragon Summit -- promising to marry the power of AR with the promise of 5G. The XR2 is a follow-up to Qualcomm's Snapdragon XR1 and brings a range of new features to next-gen AR headsets. The announcement came alongside news of the new Snapdragon 865 platform, which is set to power the majority of flagship Android phones in 2020.

Perhaps the most notable new feature on offer by the XR2 platform is the fact that it’s the first AR chipset to support 5G connectivity. That means it will be perfect for things like streaming video or accessing large amounts of data on the go.

Mobile

Oppo steps into augmented reality with its HoloLens-like AR Glass headset

oppo ar glass headset news

Microsoft’s HoloLens 2 may have a new challenger next year. Smartphone maker Oppo has announced a pair of augmented reality glasses, and stated they will be released during the first three months of 2020. Oppo’s AR Glass headset is part of an effort to expand beyond only making smartphones, and was revealed alongside plans for a smartwatch and an Oppo-produced mobile processor.

Oppo's AR Glass is similar in design to HoloLens. A visor stretches across the front of the headset, attached to a band which holds it on your head, plus there is a forehead rest to keep it in position. This is not something designed for everyday wear, but more for home and industrial use. At home, Oppo says the AR Glass will be used for augmented reality content and games, while in the workplace, and somewhat less specifically, Oppo sees it being used for augmented reality services. These could include 3D modeling, planning, and design.