Skip to main content

MIT camera can ‘see’ around corners by analyzing nearly invisible shadows

Using Cameras to See Around Corners
If you drive, chances are that you’ve picked up the ability to “see around corners” by looking for visual clues such as another car’s headlights on the road when you’re coming up to a turn. Researchers at the Massachusetts Institute of Technology Computer Science and Artificial Intelligence Laboratory (CSAIL) have been attempting to solve that same problem for autonomous cars, courtesy of a new camera system which uses almost invisible information about light reflections to detect objects or people that are otherwise hidden in a scene, and measure their speed and trajectory — all in real time.

“Our system uses video of how light reflects on the ground to be able to detect moving objects around the corner from the camera,” Katie Bouman, a PhD from MIT CSAIL who worked on the project, told Digital Trends. “For example, imagine walking down an L-shaped hallway, and there’s a wall between you and some objects around the corner. Those objects reflect a very small amount of light on the ground in front of you, which is referred to as the ‘penumbra.’ Because different slices of the hidden scene are being reflected from different points on the ground, you can recover and interpret how light is changing in the hidden scene over time.”

MIT CSAIL
MIT CSAIL
Recommended Videos

MIT’s system uses video of that penumbra to create a series of one-dimensional images which cumulatively reveal information about things that are moving around the corner. To be clear: The technology isn’t able to see identifying details of particular objects, just the fact that there are moving objects. However, it could still be extraordinarily useful.

Please enable Javascript to view this content

“The ability to see around obstructions would be valuable for many tasks, including emergency response and self-driving cars,” Bouman continued. “For instance, someday we could use this sort of technology to alert drivers to pedestrians who are about to dart out into the road. There’s also the possibility of using it in hostage situations [or] in search-and-rescue, like when firefighters are trying to find people in burning buildings.”

Next up, the lab hopes to get this technology working for cameras that are attached to moving objects (kind of a vital step when you’re dealing with car technology!), as well as making it sufficiently robust to account for light conditions that are constantly changing. The tech is unlikely to be ready for commercialization any time soon, but there’s no reason why CornerCameras — as MIT is calling the technology — couldn’t one day be as integral a part of our cars as parking sensors.

Luke Dormehl
Former Digital Trends Contributor
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
Hyundai Ioniq 5 sets world record for greatest altitude change
hyundai ioniq 5 world record altitude change mk02 detail kv

When the Guinness World Records (GWR) book was launched in 1955, the idea was to compile facts and figures that could finally settle often endless arguments in the U.K.’s many pubs.

It quickly evolved into a yearly compilation of world records, big and small, including last year's largest grilled cheese sandwich in the world.

Read more
Global EV sales expected to rise 30% in 2025, S&P Global says
ev sales up 30 percent 2025 byd sealion 7 1stbanner l

While trade wars, tariffs, and wavering subsidies are very much in the cards for the auto industry in 2025, global sales of electric vehicles (EVs) are still expected to rise substantially next year, according to S&P Global Mobility.

"2025 is shaping up to be ultra-challenging for the auto industry, as key regional demand factors limit demand potential and the new U.S. administration adds fresh uncertainty from day one," says Colin Couchman, executive director of global light vehicle forecasting for S&P Global Mobility.

Read more
Faraday Future could unveil lowest-priced EV yet at CES 2025
Faraday Future FF 91

Given existing tariffs and what’s in store from the Trump administration, you’d be forgiven for thinking the global race toward lower electric vehicle (EV) prices will not reach U.S. shores in 2025.

After all, Chinese manufacturers, who sell the least expensive EVs globally, have shelved plans to enter the U.S. market after 100% tariffs were imposed on China-made EVs in September.

Read more