Augmented-reality headsets could help helicopter rescue pilots fly in dense fog

By Luke Dormehl Published July 1, 2016

Could augmented reality headsets help helicopter rescue pilots to fly more safely in extreme weather conditions — including heavy fog — in which they have poor visibility? That’s the question set out by a group of researchers at Germany’s Technical University of Munich (TUM). Their answer? An overwhelming yes.

Carried out in collaboration with the Institute of Helicopter Technology, the project uses a helicopter-mounted LIDAR (Light Detection and Ranging) system to create virtual images of upcoming hazards and other obstacles. This signal data is then processed onboard the helicopter and transmitted to the transparent head-mounted display worn by pilots.

1 of 5

augmented reality pilots pilot mit helmsichtger t — Image used with permission by copyright holder

augmented reality pilots dcim101gopro — DCIM101GOPRO Image used with permission by copyright holder

augmented reality pilots dsc 0213 — Image used with permission by copyright holder

augmented reality pilots dsc 0201 — Image used with permission by copyright holder

augmented reality pilots blick durch helmsichtger t — Image used with permission by copyright holder

“Databases containing obstacles and terrain data are used together with real-time data from sensors in order to substitute the lost visual cues in degraded visual environment” Franz Viertler, a professor of aeronautical engineering who worked on the project, told Digital Trends. “The other part of the research then deals with how to best visualize the data for the pilot in order to enable a safe flight. The head-mounted display is a perfect means to do this, because the pilots can keep their eyes out of the window, while they get additional information about hazardous obstacles.”

Recommended Videos

As part of the study, sixteen professional helicopter pilots were given the chance to try out the head-mounted display during simulator flights. Pilots were found to fly more quickly and safely when they were using the augmented reality displays — with the most noticeable results coming when they were flying in extremely poor visibility conditions.

Despite these promising results, however, Viertler notes that there is still work to be done before this tech can be rolled out in the real world. Part of this is technological, but a bigger factor will be the legal tests it needs to undergo. “The certification of this technology in the field of aviation requires additional time and effort,” he says. “Thus air rescue providers or other potential operators will have to wait about five to ten years until they can benefit from this technology.”

Hopefully it will be well worth the wait.

Topics

Former Digital Trends Contributor

I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…

Cars

Rivian set to unlock unmapped roads for Gen2 vehicles

rivian unmapped roads gen2 r1t gallery image 0

Rivian fans rejoice! Just a few weeks ago, Rivian rolled out automated, hands-off driving for its second-gen R1 vehicles with a game-changing software update. Yet, the new feature, which is only operational on mapped highways, had left many fans craving for more.
Now the company, which prides itself on listening to - and delivering on - what its customers want, didn’t wait long to signal a ‘map-free’ upgrade will be available later this year.
“One feedback we’ve heard loud and clear is that customers love [Highway Assist] but they want to use it in more places,” James Philbin, Rivian VP of autonomy, said on the podcast RivianTrackr Hangouts. “So that’s something kind of exciting we’re working on, we’re calling it internally ‘Map Free’, that we’re targeting for later this year.”
The lag between the release of Highway Assist (HWA) and Map Free automated driving gives time for the fleet of Rivian vehicles to gather ‘unique events’. These events are used to train Rivian’s offline model in the cloud before data is distilled back to individual vehicles.
As Rivian founder and CEO RJ Scaringe explained in early March, HWA marked the very beginning of an expanding automated-driving feature set, “going from highways to surface roads, to turn-by-turn.”
For now, HWA still requires drivers to keep their eyes on the road. The system will send alerts if you drift too long without paying attention. But stay tuned—eyes-off driving is set for 2026.
It’s also part of what Rivian calls its “Giving you your time back” philosophy, the first of three pillars supporting Rivian’s vision over the next three to five years. Philbin says that philosophy is focused on “meeting drivers where they are”, as opposed to chasing full automation in the way other automakers, such as Tesla’s robotaxi, might be doing.
“We recognize a lot of people buy Rivians to go on these adventures, to have these amazing trips. They want to drive, and we want to let them drive,” Philbin says. “But there’s a lot of other driving that’s very monotonous, very boring, like on the highway. There, giving you your time back is how we can give the best experience.”
This will also eventually lead to the third pillar of Rivian’s vision, which is delivering Level 4, or high-automation vehicles: Those will offer features such as auto park or auto valet, where you can get out of your Rivian at the office, or at the airport, and it goes off and parks itself.
While not promising anything, Philbin says he believes the current Gen 2 hardware and platforms should be able to support these upcoming features.
The second pillar for Rivian is its focus on active safety features, as the EV-maker rewrote its entire autonomous vehicle (AV) system for its Gen2 models. This focus allowed Rivian’s R1T to be the only large truck in North America to get a Top Safety Pick+ from the Insurance Institute for Highway Safety.
“I believe there’s a lot of innovation in the active safety space, in terms of making those features more capable and preventing more accidents,” Philbin says. “Really the goal, the north star goal, would be to have Rivian be one of the safest vehicles on the road, not only for the occupants but also for other road users.”

Cars

Jaguar Land Rover, Nissan hit the brake on shipments to U.S. over tariffs

Range Rover Sport P400e

Jaguar Land Rover (JLR) has announced it will pause shipments of its UK-made cars to the United States this month, while it figures out how to respond to President Donald Trump's 25% tariff on imported cars.

"As we work to address the new trading terms with our business partners, we are taking some short-term actions, including a shipment pause in April, as we develop our mid- to longer-term plans," JLR said in a statement sent to various media.

Computing

DeepSeek readies the next AI disruption with self-improving models

DeepSeek AI chatbot running on an iPhone.

Barely a few months ago, Wall Street’s big bet on generative AI had a moment of reckoning when DeepSeek arrived on the scene. Despite its heavily censored nature, the open source DeepSeek proved that a frontier reasoning AI model doesn’t necessarily require billions of dollars and can be pulled off on modest resources.

It quickly found commercial adoption by giants such as Huawei, Oppo, and Vivo, while the likes of Microsoft, Alibaba, and Tencent quickly gave it a spot on their platforms. Now, the buzzy Chinese company’s next target is self-improving AI models that use a looping judge-reward approach to improve themselves.