Skip to main content

Researchers create artificially intelligent ears for cars to improve road safety

For drivers, there are times when it feels as if that fast-approaching emergency vehicle, with its siren blaring, has come from nowhere. On a packed multi-lane street or at a busy junction, its sudden appearance can confuse a driver into making the wrong move when trying to clear the way, making matters worse for the response vehicle as it tries to reach its destination.

In such cases, an earlier warning about the vehicle’s approach, including where it’s coming from, would allow the driver to make better and safer decisions.

The scenario is one of several that inspired researchers at the Fraunhofer Institute for Digital Media Technology (IDMT) in Oldenburg, Germany, to create an A.I.-based solution that allows cars to listen, and respond to, their surroundings.

The technology uses a microphone placed inside a modified roof fin. This links to a control unit containing software that powers the system. The software uses a library of different noises and computer algorithms that enable it to recognize the acoustic signature of specific sounds while discarding irrelevant background noise. The team used a wide range of archived noises to train the algorithms that power the platform.

Fraunhofer IDMT also designed its own so-called “beamforming algorithms” that allow the technology to dynamically locate moving sound sources such as a siren on an approaching emergency vehicle.

With today’s vehicles built to keep external noise out, and booming sound systems that ensure you hear nothing but the audio you’re listening to, the technology would offer an efficient way to alert drivers to important events nearby, including anything from approaching emergency vehicles to children playing in the street.

The researchers point out that the system could be made to be so sensitive that it would even be able to pick up the sound of a nail in a tire tapping on the road surface, enabling it to alert the driver to the potential danger. Other unusual noises from the vehicle could also be recognized, allowing the system to keep tabs on the car’s condition.

Autonomous vehicles

The researchers point out that the technology would also be useful for autonomous vehicles.

“Despite the huge potential of such applications, no autonomous vehicle has yet been equipped with a system capable of perceiving external noises,” Danilo Hollosi, head of the Acoustic Event Recognition group at Fraunhofer IDMT, said in a release.

The equipment is still under development but the team hopes to have something ready for commercialization within the next five years.

Editors' Recommendations

Trevor Mogg
Contributing Editor
Not so many moons ago, Trevor moved from one tea-loving island nation that drives on the left (Britain) to another (Japan)…
Cruise says it’s nearing approval for mass production of futuristic robotaxi
Interior of Cruise's Origin vehicle.

Robotaxi company Cruise is “just days away” from getting regulatory approval that would pave the way for mass production of its purpose-built driverless vehicle, CEO Kyle Vogt said on Thursday in comments reported by the Detroit Free Press.

General Motors-backed Cruise unveiled the vehicle -- called Origin -- in early 2020, presenting the kind of driverless car that we all dreamed of when R&D in the sector kicked off years ago; a vehicle without a steering wheel and without pedals. A vehicle with passenger seats only.

Read more
Robotaxi firm Cruise ordered to halve fleet following incidents
A Cruise autonomous car.

Autonomous car company Cruise has been told by regulators to halve its robotaxi fleet in San Francisco following a crash with a fire truck on Thursday in which the driverless car's passenger suffered minor injuries.

The regulator -- the California Department of Motor Vehicles (DMV) -- said that it’s looking into “recent concerning incidents” involving self-driving Cruise cars operating on the city’s public roads.

Read more
An autonomous car in San Francisco got stuck in wet concrete
A Cruise autonomous car.

A self-driving car operated by General Motors-backed Cruise got stuck on Tuesday when it drove into a patch of wet concrete.

The incident happened in San Francisco and occurred just days after California's Public Utilities Commission made a landmark decision when it voted to allow autonomous-car companies Cruise and Waymo to expand their paid ridesharing services in the city to all hours of the day instead of just quieter periods.

Read more