Skip to main content

MIT’s shadow-watching tech could let autonomous cars see around corners

Whether it’s cyclists about to lurch into the wrong lane or a pedestrian getting ready to cross the street, self-driving cars need to be hyperaware of what is going on around them at all times. But one thing they can’t do is to see around corners. Or can they? In a paper presented at this week’s International Conference on Intelligent Robots and Systems (IROS), Massachusetts Institute of Technology researchers have shown off technology which could allow autonomous vehicles or other kinds of robots to do exactly that — by looking for changes in shadows on the ground to reveal if a moving object is headed their way.

“ShadowCam operates by detecting small differences in shadows and using this information to detect possible static and dynamic objects that are otherwise out of your line of sight,” Alexander Amini and Igor Gilitschenski, two MIT Computer Science and Artificial Intelligence Laboratory (CSAIL) researchers who worked on the project, told Digital Trends via email. “First of all, we need to focus on the same region of interest as we move, which we achieve by integrating a visual motion estimation technique into ShadowCam. Based on this stabilized image of the region of interest, we [then] use color amplification combined with a dynamic threshold on the intensity changes.”

In tests, the system has shown that it could increase the stopping ability of automated vehicles by more than 0.5 of a second compared to regular Lidar technology. While half a second sounds like only the most incremental of improvements, these kind of hair-trigger reactions could potentially mean the difference between colliding with another vehicle and stopping in time.

So far, the technology has only been tested in indoor settings. As with any robot-based system, lab conditions can be deceptive since they make it easier to control variables. In this case, it means more consistent lighting, which helps the system to better analyze shadows. Nonetheless, as with self-driving cars themselves (which, not too long ago, seemed like they would remain research projects only), tech continues to advance at an astonishing rate. With that in mind, we wouldn’t bet against technology like ShadowCam popping up as an assistive driving staple before too much longer.

Editors' Recommendations

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
Elon Musk eyes 2024 for Tesla robotaxi sans steering wheel, pedals
Elon Musk - Tesla CEO

Tesla is aiming to mass produce a robotaxi by 2024, CEO Elon Musk revealed during an earnings call with investors on Wednesday as the company reported better-than-expected quarterly figures.

The dedicated robotaxi will feature a “futuristic” design and come without a steering wheel or pedals, Musk said, adding that the vehicle, which would build on the automaker’s current self-driving technology, could be “a massive driver of Tesla’s growth.”

Read more
Officers confused as they pull over an empty self-driving car
Cruise

In what appears to be the first incident of its kind, police officers recently pulled over a self-driving car with no one inside it.

The incident, which took place on a street in San Francisco earlier this month, was caught on video by a passing pedestrian. It shows several traffic cops pondering about how to handle the incident after stopping the vehicle for failing to have its front lights on while driving at night.

Read more
How a big blue van from 1986 paved the way for self-driving cars
Lineup of all 5 Navlab autonomous vehicles.

In 1986, a blue Chevy van often cruised around the streets of Pittsburgh, Pennsylvania near Carnegie Mellon University. To the casual observer, nothing about it appeared out of the ordinary. Most people would pass by it without noticing the camcorder peeking out from its roof, or the fact that there were no hands on the steering wheel.

But if any passerby had stopped to inspect the van and peer into its interior, they would have realized it was no ordinary car. This was the world's first self-driving automobile: A pioneering work of computer science and engineering somehow built in a world where fax machines were still the predominant way to send documents, and most phones still had cords. But despite being stuck in an era where technology hadn't caught up to humanity's imagination quite yet, the van -- and the researchers crammed into it -- helped to lay the groundwork for all the Teslas, Waymos, and self-driving Uber prototypes cruising around our streets in 2022.

Read more