Skip to main content

MIT’s shadow-watching tech could let autonomous cars see around corners

Whether it’s cyclists about to lurch into the wrong lane or a pedestrian getting ready to cross the street, self-driving cars need to be hyperaware of what is going on around them at all times. But one thing they can’t do is to see around corners. Or can they? In a paper presented at this week’s International Conference on Intelligent Robots and Systems (IROS), Massachusetts Institute of Technology researchers have shown off technology which could allow autonomous vehicles or other kinds of robots to do exactly that — by looking for changes in shadows on the ground to reveal if a moving object is headed their way.

“ShadowCam operates by detecting small differences in shadows and using this information to detect possible static and dynamic objects that are otherwise out of your line of sight,” Alexander Amini and Igor Gilitschenski, two MIT Computer Science and Artificial Intelligence Laboratory (CSAIL) researchers who worked on the project, told Digital Trends via email. “First of all, we need to focus on the same region of interest as we move, which we achieve by integrating a visual motion estimation technique into ShadowCam. Based on this stabilized image of the region of interest, we [then] use color amplification combined with a dynamic threshold on the intensity changes.”

Recommended Videos

In tests, the system has shown that it could increase the stopping ability of automated vehicles by more than 0.5 of a second compared to regular Lidar technology. While half a second sounds like only the most incremental of improvements, these kind of hair-trigger reactions could potentially mean the difference between colliding with another vehicle and stopping in time.

Please enable Javascript to view this content

So far, the technology has only been tested in indoor settings. As with any robot-based system, lab conditions can be deceptive since they make it easier to control variables. In this case, it means more consistent lighting, which helps the system to better analyze shadows. Nonetheless, as with self-driving cars themselves (which, not too long ago, seemed like they would remain research projects only), tech continues to advance at an astonishing rate. With that in mind, we wouldn’t bet against technology like ShadowCam popping up as an assistive driving staple before too much longer.

Luke Dormehl
Former Digital Trends Contributor
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
Dubai Police to deploy driverless patrol cars with AI smarts
Dubai's autonomous patrol car.

While U.S. firms like Waymo and Cruise focus on ridesharing services with their autonomous vehicles, the United Arab Emirates' coastal city of Dubai is aiming to take the technology to another level by deploying it in police patrol cars.

Dubai Police recently announced plans to use fully electric, self-driving patrol cars in residential areas, local media reported this week.

Read more
Waymo expands robotaxi service area in San Francisco
The upcoming Zeekr vehicle from Geely.

Robotaxi leader Waymo is expanding its ridesharing service area in San Francisco.

The Alphabet-owned company announced move on Monday in a message on X, the social media platform formerly known as Twitter. It means that more riders can now take trips in Waymo’s driverless vehicles within a 47-square-mile area of the city.

Read more
Cruise autonomous vehicle drives over woman just after she was hit by another car
A Cruise autonomous car.

An autonomous vehicle (AV) operated by Cruise ran over a pedestrian in San Francisco on Monday night just after she’d been hit by another car, the San Francisco Chronicle reported.

According to witnesses, the force of the initial impact knocked the woman into the path of the Cruise robotaxi, leaving her pinned under one of its wheels. The driver in the other car reportedly fled the scene.

Read more