This camera that sees in real time could mean safer driverless cars and drones

ntu celex real time camera image 1 asst prof chen shoushun 729
Nanyang Technological University Singapore
Driverless cars, drones, and other unmanned vehicles can only react to potential hazards if they “see” them fast enough. A team from Nanyang Technological University in Singapore recently developed a camera called Celex with enough of a speed boost to see in real time.

Conventional video cameras record as many as a few hundred images per second, strung together to create a video. While cameras are getting faster, current options are limited based on how quickly the computer can make sense of all that data and process that many large files. Essentially, the camera sees the information, but the computer inside cannot process it fast enough.

The research group from NTU developed a camera that records those changes in light in nanoseconds, instead of traditional frames, allowing the system to adjust to light changes faster than a typical camera. Instead of taking a large number of photos per second to create a video feed, Celex instead doesn’t concentrate on an entire image, but only reads the changes between the previous view at each pixel. Since the camera is only processing changes instead of an entire image, the speed of the camera is dramatically increased.

The camera also uses a built-in computer to analyze what is in the foreground, or what is close to the camera, and what is in the background. This optical flow computation helps the system determine what is part of the moving scenery and what is actually moving on its own toward a potential collision path.

The research team, led by assistant professor Chen Shoushun, says the camera system is also better than traditional options for night driving, as well as driving in bad weather, because of the onboard circuit that processes all the data. “Our new camera can be a great safety tool for autonomous vehicles, since it can see very far ahead like optical cameras but without the time lag needed to analyze and process the video feed,” Shoushun said. “With its continuous tracking feature and instant analysis of a scene, it complements existing optical and laser cameras and can help self-driving vehicles and drones avoid unexpected collisions that usually happen within seconds.”

Of course, since the camera focuses only on changes to keep file sizes small, the technology isn’t something that will eventually wind up in consumer cameras. But the enhanced speed could help increase safety in applications where the camera serves as a pair of eyes and not as an artistic tool, like in driverless cars and drones.

Work on Celex started in 2009 and the group launched a startup based on the technology. According to the researchers, the system, now in its final prototype stage, could hit the market before the end of 2017.


Midrange phones can’t do A.I., but MediaTek’s P90 chip aims to change that

MediaTek has announced the Helio P90 mobile processor, which it says will bring the best A.I. features we see on high-end smartphones, to the mid-range. We spoke to the company about the chip.

5G’s arrival is transforming tech. Here’s everything you need to know to keep up

It has been years in the making, but 5G is finally becoming a reality. While 5G coverage is still extremely limited, expect to see it expand in 2019. Not sure what 5G even is? Here's everything you need to know.

Want to make one hard drive act like two? Here's how to partition in Windows

If you don't want all of your files stored in one place but only have one drive to work with, partitioning is your best way forward. Here's how to partition a hard drive in Windows 10, step by step.
Emerging Tech

We’re going to the Red Planet! All the past, present, and future missions to Mars

SpaceX isn't the only organization pining to visit the Red Planet. Here's a detailed list of all operational and planned missions to Mars, along with explanations of their objectives, spacecraft details, and mission proposals.

Aston Martin’s 1,000-hp Valkyrie will boast the Mona Lisa of the engine world

Aston Martin has released new details about its F1-inspired Valkyrie hypercar. Co-developed with Red Bull Racing, the Valkyrie will be one of the most aerodynamic production cars ever made.

The redesigned 2020 Passat shows Volkswagen still believes in sedans

The sedan segment in America is shrinking, but Volkswagen still believes in it. The German firm has released a teaser sketch to preview the redesigned 2020 Passat it will introduce during the 2019 Detroit Auto Show.
Emerging Tech

Awesome Tech You Can’t Buy Yet: Booze-filled ski poles and crypto piggy banks

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!

Infiniti previews its leap into one of the hottest industry segments

Infiniti has released a teaser image to preview a concept it will unveil at the 2019 Detroit Auto Show. The yet-unnamed design study is an electric crossover shaped by Infiniti's newest design language.

What’s next for in-car entertainment? Audi believes it knows

Audi is bringing two technologies to CES 2019. The first turns a car -- a luxury sedan, in this case -- into a drive-in movie theater. The second is presented as a new entertainment format that turns the journey into the destination.
Product Review

The all-new 3 Series proves BMW can still build a compelling sport sedan

Seat time in the entry-level BMW 330i ($41,425) and M340i xDrive ($54,995) will test the German automaker’s commitment to driving dynamics, powertrain refinement, and cutting edge technology.

California wants all-electric public bus fleet on its roads by 2040

California approved a regulation that targets an all-electric public bus fleet for the whole state by 2040. The effect of the full implementation of the regulation is equivalent to taking 4 million cars off the road.

1,000-mph Bloodhound supersonic car project finds a last-minute savior

The Bloodhound supersonic car (SSC) project has found a buyer. The project was going to be disbanded after running out of funds, but its assets were purchased by British businessman Ian Warhurst.

Ford’s prototype Quiet Kennel uses noise-canceling tech to keep dogs stress-free

Ford is ending 2018 by venturing into the doghouse market. The company's European division has built a kennel equipped with active noise-canceling technology and soundproof walls that help dogs sleep through fireworks.

Car-branded phones need to make a U-turn if they ever want to impress

Your car and your smartphone are becoming one, yet smartphones branded or co-created by car companies are a problem. We look at the history, some examples of the best and worst, then share hopes for the future.