MIT camera can ‘see’ around corners by analyzing nearly invisible shadows

If you drive, chances are that you’ve picked up the ability to “see around corners” by looking for visual clues such as another car’s headlights on the road when you’re coming up to a turn. Researchers at the Massachusetts Institute of Technology Computer Science and Artificial Intelligence Laboratory (CSAIL) have been attempting to solve that same problem for autonomous cars, courtesy of a new camera system which uses almost invisible information about light reflections to detect objects or people that are otherwise hidden in a scene, and measure their speed and trajectory — all in real time.

“Our system uses video of how light reflects on the ground to be able to detect moving objects around the corner from the camera,” Katie Bouman, a PhD from MIT CSAIL who worked on the project, told Digital Trends. “For example, imagine walking down an L-shaped hallway, and there’s a wall between you and some objects around the corner. Those objects reflect a very small amount of light on the ground in front of you, which is referred to as the ‘penumbra.’ Because different slices of the hidden scene are being reflected from different points on the ground, you can recover and interpret how light is changing in the hidden scene over time.”

mit camera see round corners penumbra diagram with more detail  credit csail
MIT CSAIL
MIT CSAIL

MIT’s system uses video of that penumbra to create a series of one-dimensional images which cumulatively reveal information about things that are moving around the corner. To be clear: The technology isn’t able to see identifying details of particular objects, just the fact that there are moving objects. However, it could still be extraordinarily useful.

“The ability to see around obstructions would be valuable for many tasks, including emergency response and self-driving cars,” Bouman continued. “For instance, someday we could use this sort of technology to alert drivers to pedestrians who are about to dart out into the road. There’s also the possibility of using it in hostage situations [or] in search-and-rescue, like when firefighters are trying to find people in burning buildings.”

Next up, the lab hopes to get this technology working for cameras that are attached to moving objects (kind of a vital step when you’re dealing with car technology!), as well as making it sufficiently robust to account for light conditions that are constantly changing. The tech is unlikely to be ready for commercialization any time soon, but there’s no reason why CornerCameras — as MIT is calling the technology — couldn’t one day be as integral a part of our cars as parking sensors.

Emerging Tech

How emotion-tracking A.I. will change computing as we know it

Affectiva is just one of the startups working to create emotion-tracking A.I. that can work out how you're feeling. Here's why this could change the face of computing as we know it.
Cars

From rugged wagons to hot sports cars, the 2019 NY Auto Show brought it all

From city cars to supercars, anything goes at the New York Auto Show. Automakers from all over the globe traveled to the 2019 show to unveil their newest concept cars and production models.
Gaming

The hottest Nintendo Switch games you can get right now

The Nintendo Switch's lineup started off small, but games have steadily released as the console continues through its second year. Here are the best Nintendo Switch games available now.
Gaming

This list of PlayStation 4 exclusives puts its competitors to shame

The PlayStation 4's game library and incredible selection of exclusive games could make anyone with an Xbox One or Nintendo Switch think twice. Here's our list of the latest and greatest PS4 exclusives.
Emerging Tech

Feast your eyes on the wildest, most elaborate Rube Goldberg machines ever built

Want to see something totally mesmerizing? Check out several of the best Rube Goldberg machines from across the internet, including one that serves cake and others that do ... nothing particularly useful.
Emerging Tech

Watch a pack of SpotMini robot dogs perform a terrifying feat of strength

Boston Dynamics' SpotMini robotic dog is now going around in packs, and the results are somewhat concerning. Check out the video to see what kind of shenanigans 10 of them got up to recently ...
Emerging Tech

Notre Dame fire: How drones and a robot called Colossus helped limit the damage

The fire that devastated the iconic Notre Dame Cathedral on Monday shocked many around the world. In a bid to prevent even worse damage to the structure, Paris firefighters opted to deploy drones and a robot called Colossus.
Emerging Tech

New gunfire-detection system alerts police of shooters in seconds, not minutes

The Safe Zone Gunfire Detector is a fast gunfire-detection system that could help avert potential tragedies in public places like schools, malls, or anywhere a mass shooting might occur.
Emerging Tech

NASA chooses a special spot for its next crewed moon landing

Following the U.S. government's announcement last month of a desire to see American astronauts set foot on the moon again in the next five years, NASA has revealed a location on the lunar surface where it would most like to land.
Emerging Tech

Adidas has created a running shoe that’s made to be remade

Adidas has unveiled the Futurecraft Loop running shoe that it claims is the first performance footwear to be 100% recyclable. The shoe is the latest green initiative by the sportswear company and will go on sale in 2021.
Emerging Tech

Yale scientists restore cellular activity in a pig’s brain hours after its death

In what some may view as a porcine version of Frankenstein, Yale University scientists have restored circulation and cellular activity in a pig’s brain four hours after its death. The study is likely to be used to study brain function
Emerging Tech

Russia’s robot news anchor gives human TV presenters hope

Human news anchors anxious about robots taking their jobs will be feeling reassured this week after the appearance on Russian TV of a news-reading android that clearly needs a bit of work.
Smart Home

I have seen the future, and it’s full of salad-making robots

Think that robots bussing tables, tossing salads and baking bread is a futuristic concept? It's actually not as far away as you might think. Robots took center stage at a food robotics summit in San Francisco this week, where they showed…
Emerging Tech

NASA is building an inflatable space robot named King Louie

NASA is funding an inflatable robot called King Louie which could travel to the stars in deflated form and then be blown up when and where required. Here is why that's so exciting.