Skip to main content

DARPA wants a camera that can see around corners, and it’s coming soon

darpa camera see around corners cornar corner velten mit media lab
MIT Media Lab
A camera that can see around corners and reveal hidden objects could be put to real-world use in as little as four years, according to the Morgridge Institute for Research. The technology was first developed at the Massachusetts Institute of Technology and demonstrated back in 2012. Apparently, it caught the interest of the U.S. Defense Department Advanced Research Projects Agency (DARPA), which just provided a $4.4 million grant to fast-track research and development of the camera.

Andreas Velten pioneered the technology at MIT, and now leads a team of researchers at Morgridge and the University of Wisconsin-Madison, where both institutions are working together to optimize it. The DARPA grant will allow them to explore the limitations of the technology and hopefully develop fully-functional hardware that can be used in the field. UW-Madison is one of eight universities to receive 2016 DAPRA grants to investigate different forms and applications of non-line-of-sight imaging.

The camera works by shining a rapid pulse of laser light into a room. When the laser hits a wall or ceiling, the light scatters, bouncing off of other surfaces and objects. Many photons eventually make it back to the camera, arriving at different times depending on how far they’ve traveled. The camera can then use that information to digitally reconstruct an image of the room, including any people that may be inside of it.

Recording the photons that bounce back requires highly specialized equipment, so don’t expect this technology to come to a cameraphone near you. The sensor must be extremely sensitive, especially if the camera is to be able to see around multiple walls, a goal the team is currently working toward.

“The more times you can bounce this light within a scene, the more possible data you can collect,” Velten said. “Since the first light is the strongest, and each proceeding bounce gets weaker and weaker, the sensor has to be sensitive enough to capture even a few photons of light.”

The DARPA grant will fund four years of research, with the first two dedicated to investigating the full potential of the technology. The second two years will be spent developing the hardware, making it viable for production and implementation.

Non-line-of-sight imaging has numerous applications, from search and rescue, to exploring shipwrecks, and potentially even mapping moon caves. It won’t, however, have any effect on standard photography. “We are interested in capturing exactly what a traditional camera doesn’t capture,” Velten said.

Editors' Recommendations

Daven Mathies
Former Digital Trends Contributor
Daven is a contributing writer to the photography section. He has been with Digital Trends since 2016 and has been writing…
This AI cloned my voice using just three minutes of audio
acapela group voice cloning ad

There's a scene in Mission Impossible 3 that you might recall. In it, our hero Ethan Hunt (Tom Cruise) tackles the movie's villain, holds him at gunpoint, and forces him to read a bizarre series of sentences aloud.

"The pleasure of Busby's company is what I most enjoy," he reluctantly reads. "He put a tack on Miss Yancy's chair, and she called him a horrible boy. At the end of the month, he was flinging two kittens across the width of the room ..."

Read more
Digital Trends’ Top Tech of CES 2023 Awards
Best of CES 2023 Awards Our Top Tech from the Show Feature

Let there be no doubt: CES isn’t just alive in 2023; it’s thriving. Take one glance at the taxi gridlock outside the Las Vegas Convention Center and it’s evident that two quiet COVID years didn’t kill the world’s desire for an overcrowded in-person tech extravaganza -- they just built up a ravenous demand.

From VR to AI, eVTOLs and QD-OLED, the acronyms were flying and fresh technologies populated every corner of the show floor, and even the parking lot. So naturally, we poked, prodded, and tried on everything we could. They weren’t all revolutionary. But they didn’t have to be. We’ve watched enough waves of “game-changing” technologies that never quite arrive to know that sometimes it’s the little tweaks that really count.

Read more
Digital Trends’ Tech For Change CES 2023 Awards
Digital Trends CES 2023 Tech For Change Award Winners Feature

CES is more than just a neon-drenched show-and-tell session for the world’s biggest tech manufacturers. More and more, it’s also a place where companies showcase innovations that could truly make the world a better place — and at CES 2023, this type of tech was on full display. We saw everything from accessibility-minded PS5 controllers to pedal-powered smart desks. But of all the amazing innovations on display this year, these three impressed us the most:

Samsung's Relumino Mode
Across the globe, roughly 300 million people suffer from moderate to severe vision loss, and generally speaking, most TVs don’t take that into account. So in an effort to make television more accessible and enjoyable for those millions of people suffering from impaired vision, Samsung is adding a new picture mode to many of its new TVs.
[CES 2023] Relumino Mode: Innovation for every need | Samsung
Relumino Mode, as it’s called, works by adding a bunch of different visual filters to the picture simultaneously. Outlines of people and objects on screen are highlighted, the contrast and brightness of the overall picture are cranked up, and extra sharpness is applied to everything. The resulting video would likely look strange to people with normal vision, but for folks with low vision, it should look clearer and closer to "normal" than it otherwise would.
Excitingly, since Relumino Mode is ultimately just a clever software trick, this technology could theoretically be pushed out via a software update and installed on millions of existing Samsung TVs -- not just new and recently purchased ones.

Read more