Could thermal-imaging sensors help make self-driving cars safer?

flir systems thermal imaging tech 5205a931 4ab5 4ab8 b0b7 aa7db51e9406
FLIR Systems

Recently we published a story about the history of notable car accidents involving self-driving and semi-self-driving vehicles. While a significant number of these do involve human error, there are still multiple examples of crashes in which the vehicle was unable to properly read its surroundings. Thermal imaging company FLIR Systems thinks one way to make autonomous vehicles safer would be to give them the ability to use thermal reading tech to better deal with challenging lighting and weather conditions.

To help with adoption of these sensors, the company has made available an open-source dataset of 10,000 labelled infrared light images showcasing how pedestrians, animals, bicycles and other vehicles can be classified using the tech in difficult conditions, ranging from total darkness to fog and smoke to haze and glare from the sun. Using thermal cameras, combined with the dataset, it’s possible to recognize objects more than 200 meters away, the equivalent of 4 times the distance of typical car headlights.

“Navigation is limited by the perception accuracy provided by the vehicle sensor suite,” Mike Walters, vice president of micro-camera product management at FLIR Systems, told Digital Trends. “Visible cameras do not work well in a number of challenging lighting situations such as absolute darkness, driving into the sun, and in many types of fog — while thermal cameras, which principally see heat and not visible light, are unaffected by these adverse conditions. Therefore, thermal cameras provide more accurate situational awareness and perception under these conditions, which, in turn, improves safety and navigation.”

At present, thermal cameras are found in a number of luxury passenger cars. Some high-end automakers, such as Porsche and BMW, already fit vehicles with thermal imaging sensors made by FLIR. However, they are not part of the standard suite of sensors helping power today’s most prominent self-driving vehicles. That may sound like an obvious oversight, but current self-driving cars don’t rely on only one imaging system by which to see.

The self-driving cars being tested on the road right now figure out their surroundings using a combination of regular cameras, ultrasound, radar, lidar and more. Information from all of these sensors helps inform the decisions the car makes. In some cases, this array of sensors may lead to redundancy — but few people, either passengers or pedestrians, are ever going to complain about being too safe.

As a result of this, it’s difficult to calculate how much of an improvement using technology like FLIR’s thermal long-wave infrared (LWIR) cameras could offer. Still, hopefully datasets such as the one newly released this week will give carmakers the opportunity to more easily build the algorithms that will let them find out.

Product Review

The 2019 Porsche Macan S is a luxurious and quick SUV, but it's no road tripper

The roster of models challenging the Porsche Macan grows annually. The German firm updated its smallest, most affordable SUV with a new engine, more tech features, and subtle design tweaks to keep it looking fresh.
Cars

Bosch’s CES-bound shuttle concept takes us on a trip to a not-too-distant future

Bosch envisions a future in which driverless shuttles occupy their own market segment. The German firm won't build the shuttles, but it wants to provide everything else, ranging from the drive system to the apps used to hail them.
Cars

Thinking of opting for a car with a diesel engine? Here's what you need to know

Modern diesel-powered models prove that it is possible to build a clean, efficient diesel engine without sacrificing performance. Here's what you need to know about diesel cars, and how they differ from gasoline-powered models.
Movies & TV

'Prime'-time TV: Here are the best shows on Amazon Prime right now

There's more to Amazon Prime than free two-day shipping, including access to a number of phenomenal shows at no extra cost. To make the sifting easier, here are our favorite shows currently streaming on Amazon Prime.
Emerging Tech

With this robotic garage, retrieving your car is like using a vending machine

Remembering where we parked our cars can be a real pain. But what if our cars came to find us, rather than the other way around? A new automated robot parking valet system aims to help.
Cars

Best Products of 2018

Our reception desk has so many brown boxes stacked up, it looks like a loading dock. We’re on a first-name basis with the UPS guy. We get new dishwashers more frequently than most people get new shoes. What we’re trying to say is: We…
Emerging Tech

A lidar-equipped truck knows exactly how much de-icer to apply on roads

Lidar is best known as the laser-based technology that helps self-driving cars sense their surroundings. But the city of Knoxville has another, more seasonal use for it: De-icing roads.
Emerging Tech

This unusual nature-inspired robot is equally at home on land or in the water

This intriguing, nature-inspired robot may look unusual, but it's impressively capable of moving on both land and water without problem. Heck, it can even travel on ice if necessary.
Emerging Tech

This cryptocurrency wallet for kids isn’t nearly as stupid as it sounds

So you’ve taught your 6-year-old child to read, write, and play nice with others. What’s next? Give them a base understanding of cryptocurrency, of course. This Kickstarter aims to help.
Emerging Tech

Light, speed: Lighting kit for DJI Mavic 2 lets you fly and film in the dark

Lume Cube, maker of small battery-powered LED lights for mobile photography, has announced a new lighting kit built specifically for the DJI Mavic 2 -- the first of its kind. Already our favorite drone, this makes the Mavic 2 even better.
Emerging Tech

Prepare for liftoff: Here are all the important upcoming SpaceX rocket launches

From ISS resupply missions to a host of communication and scientific satellite launches, SpaceX has a busy year ahead. Here's a rundown of some of the company's most important missions slated for the next year.
Emerging Tech

Virgin Galactic’s latest test flight takes it to the edge of space

Sir Richard Branson's Virgin Galactic has successfully carried out its fourth powered flight in Mojave, California. It was the company's most ambitious test flight yet -- and bodes well for the future.
Emerging Tech

We’re going to the Red Planet! All the past, present, and future missions to Mars

SpaceX isn't the only organization pining to visit the Red Planet. Here's a detailed list of all operational and planned missions to Mars, along with explanations of their objectives, spacecraft details, and mission proposals.
Emerging Tech

There’s a giant EMP blaster in New Mexico. Don’t worry, it’s here to protect us

An electromagnetic pulse has the potential to disable virtually all electronics within a large area. To help protect against such a threat is a new, friendly EMP emitter. Here's how it works.