Skip to main content

Could thermal-imaging sensors help make self-driving cars safer?

FLIR Systems

Recently we published a story about the history of notable car accidents involving self-driving and semi-self-driving vehicles. While a significant number of these do involve human error, there are still multiple examples of crashes in which the vehicle was unable to properly read its surroundings. Thermal imaging company FLIR Systems thinks one way to make autonomous vehicles safer would be to give them the ability to use thermal reading tech to better deal with challenging lighting and weather conditions.

To help with adoption of these sensors, the company has made available an open-source dataset of 10,000 labelled infrared light images showcasing how pedestrians, animals, bicycles and other vehicles can be classified using the tech in difficult conditions, ranging from total darkness to fog and smoke to haze and glare from the sun. Using thermal cameras, combined with the dataset, it’s possible to recognize objects more than 200 meters away, the equivalent of 4 times the distance of typical car headlights.

Recommended Videos

“Navigation is limited by the perception accuracy provided by the vehicle sensor suite,” Mike Walters, vice president of micro-camera product management at FLIR Systems, told Digital Trends. “Visible cameras do not work well in a number of challenging lighting situations such as absolute darkness, driving into the sun, and in many types of fog — while thermal cameras, which principally see heat and not visible light, are unaffected by these adverse conditions. Therefore, thermal cameras provide more accurate situational awareness and perception under these conditions, which, in turn, improves safety and navigation.”

Please enable Javascript to view this content

At present, thermal cameras are found in a number of luxury passenger cars. Some high-end automakers, such as Porsche and BMW, already fit vehicles with thermal imaging sensors made by FLIR. However, they are not part of the standard suite of sensors helping power today’s most prominent self-driving vehicles. That may sound like an obvious oversight, but current self-driving cars don’t rely on only one imaging system by which to see.

The self-driving cars being tested on the road right now figure out their surroundings using a combination of regular cameras, ultrasound, radar, lidar and more. Information from all of these sensors helps inform the decisions the car makes. In some cases, this array of sensors may lead to redundancy — but few people, either passengers or pedestrians, are ever going to complain about being too safe.

As a result of this, it’s difficult to calculate how much of an improvement using technology like FLIR’s thermal long-wave infrared (LWIR) cameras could offer. Still, hopefully datasets such as the one newly released this week will give carmakers the opportunity to more easily build the algorithms that will let them find out.

Luke Dormehl
Former Digital Trends Contributor
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
Cruise woes prompt production halt of fully driverless van
Interior of Cruise's Origin vehicle.

General Motors-owned  Cruise has halted production of its fully driverless vehicle -- the Origin -- just over a week after it suspended robotaxi operations nationwide following a number of troubling incidents involving its cars.

The news was announced by Cruise CEO Kyle Vogt during a meeting with staff on Monday, according to Forbes, which obtained audio of the gathering.

Read more
Cruise’s robotaxi service suspended by California regulator
A Cruise autonomous car.

Autonomous car startup Cruise has run into trouble in California after the state’s Department of Motor Vehicles (DMV) said Tuesday it was suspending its deployment and driverless permits with immediate effect.

The dramatic intervention comes just a couple of months after General Motors-owned Cruise was given permission to operate robotaxi services around the clock, but also follows a number of troubling incidents involving self-driving Cruise cars on the streets of San Francisco, where it’s been carrying out tests on public roads in recent years.

Read more
Dubai Police to deploy driverless patrol cars with AI smarts
Dubai's autonomous patrol car.

While U.S. firms like Waymo and Cruise focus on ridesharing services with their autonomous vehicles, the United Arab Emirates' coastal city of Dubai is aiming to take the technology to another level by deploying it in police patrol cars.

Dubai Police recently announced plans to use fully electric, self-driving patrol cars in residential areas, local media reported this week.

Read more