Skip to main content

This camera that sees in real time could mean safer driverless cars and drones

ntu celex real time camera image 1 asst prof chen shoushun 729
Nanyang Technological University Singapore
Driverless cars, drones, and other unmanned vehicles can only react to potential hazards if they “see” them fast enough. A team from Nanyang Technological University in Singapore recently developed a camera called Celex with enough of a speed boost to see in real time.

Conventional video cameras record as many as a few hundred images per second, strung together to create a video. While cameras are getting faster, current options are limited based on how quickly the computer can make sense of all that data and process that many large files. Essentially, the camera sees the information, but the computer inside cannot process it fast enough.

Related Videos

The research group from NTU developed a camera that records those changes in light in nanoseconds, instead of traditional frames, allowing the system to adjust to light changes faster than a typical camera. Instead of taking a large number of photos per second to create a video feed, Celex instead doesn’t concentrate on an entire image, but only reads the changes between the previous view at each pixel. Since the camera is only processing changes instead of an entire image, the speed of the camera is dramatically increased.

The camera also uses a built-in computer to analyze what is in the foreground, or what is close to the camera, and what is in the background. This optical flow computation helps the system determine what is part of the moving scenery and what is actually moving on its own toward a potential collision path.

The research team, led by assistant professor Chen Shoushun, says the camera system is also better than traditional options for night driving, as well as driving in bad weather, because of the onboard circuit that processes all the data. “Our new camera can be a great safety tool for autonomous vehicles, since it can see very far ahead like optical cameras but without the time lag needed to analyze and process the video feed,” Shoushun said. “With its continuous tracking feature and instant analysis of a scene, it complements existing optical and laser cameras and can help self-driving vehicles and drones avoid unexpected collisions that usually happen within seconds.”

Of course, since the camera focuses only on changes to keep file sizes small, the technology isn’t something that will eventually wind up in consumer cameras. But the enhanced speed could help increase safety in applications where the camera serves as a pair of eyes and not as an artistic tool, like in driverless cars and drones.

Work on Celex started in 2009 and the group launched a startup based on the technology. According to the researchers, the system, now in its final prototype stage, could hit the market before the end of 2017.

Editors' Recommendations

Apple’s rumored car could cost the same as a Tesla Model S
Apple Car rendering from Vanarama.

Rumors have been swirling around for years regarding Apple’s plans for an electric, self-driving car.

The latest report, which arrived on Tuesday via a usually reliable source, suggests Apple has scaled back its plan for an autonomous car, with some elements yet to be agreed upon.

Read more
The most innovative tech products of 2022
Most innovative products of 2022

We spend a lot of time here at Digital Trends fussing over the best tech products on the market, but just because something is the best doesn't necessarily mean it pushes the envelope or drives the world of technology forward in any way. So rather than recapping the best products of 2022, we wanted to take a moment to shine a spotlight on the ones that did something interesting, unusual, and potentially transformative in their respective category. With that in mind, here are our picks for the most innovative tech products of 2022.
Most innovative laptop: Asus ROG Flow Z13

The ROG Flow Z13 shouldn't be possible. By category, it's a 2-in-1 gaming laptop -- that is, a Surface Pro with some RGB lighting and a discrete GPU inside. It's the first of its kind, but as a concept, I wasn't sure I understood the premise. A gaming device this compact is going to be seriously held back by how small it is. But once I got the thing in my hands, I realized how genius the design really was.

Read more
Old tech sounds preserved as part of huge audio project
Cassette tapes.

Play the sound of a typewriter to a child and they’ll have little idea what it is they’re listening to. Play it to an older adult and they might break into a smile at some of the memories that it instantly evokes. Ditto the sound of an old cassette recorder, rotary telephone, or Super 8 camera.

Keen to preserve these and other sounds for generations to come, Stuart Fowkes has been building the Cities and Memory archive, with old tech sounds forming part of its growing database of recordings.

Read more