Skip to main content

This self-driving car camera can literally see the light at the end of a tunnel

Sony’s CMOS image sensor IMX390CQV: Simultaneous LED Flicker Mitigation and HDR shooting
The first high-sensitivity camera sensor could be coming to cars as early as 2018. On Wednesday, Sony announced the commercialization of the industry’s first high-sensitivity CMOS sensor that is capable of seeing in only moonlight.

The IMX390CQV is a 2.45-megapixel camera designed specifically for driving. The minimal megapixel design allows each pixel to gather more light, which means the sensor can perform in as low as 0.1 lux, which is about equal to moonlight. The sensor, which measures 1/2.7 inches, also adjusts the circuitry for enhanced light sensitivity, providing a 1.5 times boost in low-light visibility compared to other automotive cameras.

The sensor is also the first that can shoot high dynamic range while simultaneously mitigating or reducing the flicker from LED light. The HDR capability allows the camera to see more details in the highlights and shadows, improving the accuracy of the camera when driving through a tunnel, for example.

With many lights from streetlights to headlights and brake lights using LEDs, the flicker reduction capabilities allow the camera to more precisely recognize objects in the environment, Sony says. LED lights flash at very fast rates, which means if the camera’s timing records in between one of those flashes, those lights will appear to be off. To solve the problem, Sony increased the exposure time so each frame records long enough to miss the blinks.

Sony says the camera is ready to be used at the front of the car for advanced driver assistance systems as well as camera monitoring systems designed to recognize obstacles. The sensor will be available for sampling next month, while it is expected to enter automotive production as early as March 2018.

Recent studies suggest that automotive uses will drive the struggling camera industry forward, indicating future vehicles will have at least three cameras, giving companies manufacturing their own sensors, including Sony, another avenue for profitability.

Editors' Recommendations

Hillary K. Grigonis
Hillary never planned on becoming a photographer—and then she was handed a camera at her first writing job and she's been…
Watch San Franciscans take a ride in Waymo’s self-driving car
Waymo Jaguar I-Pace

Waymo is inviting San Francisco residents to hop inside its self-driving vehicles for a drive around the city.

Welcoming our first riders in San Francisco

Read more
Tesla issues stark warning to drivers using its Full Self-Driving mode
A Telsa Model 3 drives along a road.

Tesla in recent days rolled out a long-awaited update to its Full Self-Driving (FSD) mode that gives its vehicles a slew of driver-assist features.

But in a stark warning to owners who’ve forked out for the premium FSD feature, Tesla said that the software is still in beta and therefore “may do the wrong thing at the worst time.” It insisted that drivers should keep their "hands on the wheel and pay extra attention to the road.”

Read more
The future of transportation: Self-driving cars? Try self-driving everything
GM electric flying taxi

Technology is reshaping every aspect of our lives. Once a week in The Future Of, we examine innovations in important fields, from farming to transportation, and what they will mean in the years and decades to come. 

Stroll around any CES (virtual or otherwise) in the last decade and it’s impossible to miss all the feels the tech industry has for transportation, self-driving cars in particular. Every major technology company has its fingers in cars, from the infotainment systems powered by Google and Apple to the operating systems driven by Blackberry and Linux to the components and circuits that make up the car itself, built by Qualcomm and Nvidia and NXP and a dozen more. (And don't get me started about this Apple Car nonsense.)

Read more