Could thermal-imaging sensors help make self-driving cars safer?

flir systems thermal imaging tech 5205a931 4ab5 4ab8 b0b7 aa7db51e9406
FLIR Systems

Recently we published a story about the history of notable car accidents involving self-driving and semi-self-driving vehicles. While a significant number of these do involve human error, there are still multiple examples of crashes in which the vehicle was unable to properly read its surroundings. Thermal imaging company FLIR Systems thinks one way to make autonomous vehicles safer would be to give them the ability to use thermal reading tech to better deal with challenging lighting and weather conditions.

To help with adoption of these sensors, the company has made available an open-source dataset of 10,000 labelled infrared light images showcasing how pedestrians, animals, bicycles and other vehicles can be classified using the tech in difficult conditions, ranging from total darkness to fog and smoke to haze and glare from the sun. Using thermal cameras, combined with the dataset, it’s possible to recognize objects more than 200 meters away, the equivalent of 4 times the distance of typical car headlights.

“Navigation is limited by the perception accuracy provided by the vehicle sensor suite,” Mike Walters, vice president of micro-camera product management at FLIR Systems, told Digital Trends. “Visible cameras do not work well in a number of challenging lighting situations such as absolute darkness, driving into the sun, and in many types of fog — while thermal cameras, which principally see heat and not visible light, are unaffected by these adverse conditions. Therefore, thermal cameras provide more accurate situational awareness and perception under these conditions, which, in turn, improves safety and navigation.”

At present, thermal cameras are found in a number of luxury passenger cars. Some high-end automakers, such as Porsche and BMW, already fit vehicles with thermal imaging sensors made by FLIR. However, they are not part of the standard suite of sensors helping power today’s most prominent self-driving vehicles. That may sound like an obvious oversight, but current self-driving cars don’t rely on only one imaging system by which to see.

The self-driving cars being tested on the road right now figure out their surroundings using a combination of regular cameras, ultrasound, radar, lidar and more. Information from all of these sensors helps inform the decisions the car makes. In some cases, this array of sensors may lead to redundancy — but few people, either passengers or pedestrians, are ever going to complain about being too safe.

As a result of this, it’s difficult to calculate how much of an improvement using technology like FLIR’s thermal long-wave infrared (LWIR) cameras could offer. Still, hopefully datasets such as the one newly released this week will give carmakers the opportunity to more easily build the algorithms that will let them find out.

Emerging Tech

Light-swallowing room promises Call of Duty fans the blackest of ops

What's it like to be in a room fully painted with the world's darkest material, Vantablack? The makers of one of the year's top video games teamed up with Vantablack scientists to find out.
Product Review

Audi's new A8 is so sophisticated and serene, it practically deletes potholes

The 2019 Audi A8’s outline looks promising: Level 3 autonomous driving capability, haptic-feedback infotainment screens, rear-wheel steering, Matrix LED headlights and OLED taillights, plus a predictive suspension.
Cars

'4WD' or 'AWD'? Which setup is right for you?

Although four-wheel drive (4WD) and all-wheel drive (AWD) are related, they are actually quite different in how they operate. Here, we talk about the fundamental differences between the two systems, and what it means for you as a driver.
Emerging Tech

Shrimp eyes inspire new camera focused on helping self-driving cars see better

By mimicking the vision of mantis shrimp, researchers were able to make significant improvements on today’s commercial cameras. They hope their technology can help mitigate accidents by letting self-driving vehicles see more clearly.
Movies & TV

'Prime'-time TV: Here are the best shows on Amazon Prime right now

There's more to Amazon Prime than free two-day shipping, including access to a number of phenomenal shows at no extra cost. To make the sifting easier, here are our favorite shows currently streaming on Amazon Prime.
Wearables

Skydio’s self-flying drone now has an Apple Watch app for flight prep

Skydio's clever R1 autonomous drone now has its own Apple Watch app, making flight preparations simpler than ever. The $2,000 flying machine is now also selling at its first retail outlet — Apple Stores in North America.
Emerging Tech

Scientists created a condom that self-lubricates during sex. You’re welcome

Researchers from Boston University have invented a special coating for condoms which make them respond to bodily fluids by becoming more slippery. Here's how their new breakthrough works.
Emerging Tech

Are e-cigarettes safe? Here’s what the most recent science says

Ecigarettes are widely regarded and advertised as a healthier alternative to cigarettes for people who are trying to kick the smoking habit. How safe are these cigarette alternatives? We went deep into the recent scientific literature to…
Emerging Tech

You’re so vein: Palm-based biometric system could help confirm your identity

Move over, Face ID! The next biometric security systems could rely on analyzing the unique vein patterns in your palm print. Here are some of the ways the technology could prove useful.
Emerging Tech

For only $4,950, you can get jetpack lessons from the world’s only instructor

Have you ever dreamed of flying using a jetpack? JetPack Aviation founder -- and the world's only qualified jetpack teacher -- David Mayman is now offering a day of flight instruction.
Emerging Tech

Biologists have found a hormone that could make space farming possible

Researchers have shown how space farming may be possible. By encouraging plants to excrete a certain hormone, they’ve demonstrated that crops can thrive despite challenging conditions, such as low-nutrient soil and microgravity.
Emerging Tech

Keep your holiday gift list high tech and under budget with these gadgets

Modern technology doesn't always come cheap, but there plenty of premium devices that don't carry a premium price. Whether you're looking for a streaming device or a means of capturing photos from above, our list of the best tech under $50…
Emerging Tech

When tech goes wrong: Banksy’s shredder was meant to totally destroy his artwork

Banksy's recent auction stunt was meant to totally destroy one of his most famous pieces of work, but a fault with the shredder has left the buyer with something almost certainly worth far more than the $1 million she bid for it.
Emerging Tech

The best drone photos from around the world

Most of today's drones come equipped with high-end cameras, which are quickly revolutionizing the world of aerial photography as we know it. Here are some of the best drone photos from around the world.