Skip to main content

CMOS camera sensor inventor returns with an extreme-low-light follow-up

quanta image sensor low light camera 46492036  close up
The same engineer that created the CMOS sensor (above) is developing a low light quanta image sensor. Muhammad Amal Farial Khalid / 123RF
The engineer that developed the CMOS sensor now found in a majority of cameras and smartphones may have just discovered the next generation of camera sensors. Eric R. Fossum and the Dartmouth College Thayer School of Engineering published research in the December 20 issue of Optica detailing the Quanta Image Sensor (QIS), a digital camera sensor capable of capturing images even in the smallest amount of light possible.

What makes the QIS unique is that the sensor only needs a single photon of light to capture an image, which opens up possibilities for extreme low-light photography in a number of fields, including both artistic and scientific applications. Earlier attempts to design a sensor capable of performing in such low light conditions required large pixel sites, which creates a low-resolution image, or cooling mechanisms because the hardware couldn’t perform at room temperature.

The first QIS sensor is a 1-megapixel sensor with a frame rate numbering in the thousands — and the researchers say the technology could easily be upscaled to create higher resolution devices. Because the sensor is so sensitive to light, in the scientific community, the technology could allow scientists to capture images of stars previously too distant to capture, according to The project, which was partially funded by the Defense Advanced Research Projects Agency (DARPA), would also have implications for security applications because of the low-light capability.

While the scientific — and even medical — possibilities are intriguing, the low-light sensor could also eventually make its way into the field of cinematography and photography. The greater sensitivity to light would allow the digital sensor to record with a look closer to film, while maintaining the characteristics of a digital file, like easy editing with software.

While the initial QIS sensor has only a million pixels, the sensor is made up of billions of what the researchers call “jots.” These jots function like tiny pixels, and in the most extreme low-light conditions, each jot can collect just one photon, enabling that low-light capability. The QIS sensor uses a layered or stacked design, which has already been introduced in CMOS sensors, using a layer of jots and then a layer of circuits and drivers, allowing the data from those jots to be read at those frame rates in the thousands. That’s how the QIS sensor works in the simplest form, but as the academic research details, there’s much more involved, including techniques to reduce noise.

Of course, the technology won’t ever reach consumer level if the QIS sensor can’t reach the same resolution of today’s CMOS cameras or if it isn’t affordable enough to manufacture. Thankfully, the researchers kept both in mind while developing the first QIS. The jots are arranged in clusters, which allows that first 1-megapixel sensor to be scaled for higher resolution applications. The research team also designed the QIS so that the hardware could be developed using some of the same machines used to develop CMOS, lowering the production costs by using existing equipment.

The QIS sensor has some more work to be done before entering the consumer world — it is currently only monochrome, for example — but if the tech makes its way past medical, scientific and security applications, QIS could mean some serious low-light capabilities for videographers and photographers. Fossum, the inventor of the CMOS and a Dartmouth professor, worked with Jiaju Ma, Saleh Masoodian and Dakota A. Starkey on the project.

Editors' Recommendations

Hillary K. Grigonis
Hillary never planned on becoming a photographer—and then she was handed a camera at her first writing job and she's been…
Samsung’s new sensor mixes hardware and software, enabling cheaper dual cameras

The bokeh effects and low light capabilities of dual camera smartphones will soon be easier to find — and without spending so much. On Tuesday, February 6, Samsung announced an Isocell Dual image sensor designed specifically for midrange and budget smartphones.

Dual camera designs are typically included in the pricier smartphones because two cameras means twice as much to implement into not just hardware, but the software as well. Samsung explains that, in order to implement dual cameras, the manufacturer of the device needs to optimize not just the cameras, but the software, and also must work with different vendors in order to make those two cameras a reality.

Read more
Autonomous drones can now fly in low light thanks to a new type of camera

For a drone to navigate autonomously requires it to have an extremely good sense of its own location. That’s especially tricky indoors, where GPS -- the technology used by all commercial drones -- doesn’t work. One way around this is to use onboard sensors, such as lasers or cameras. However, lasers are expensive and consume a lot of power, while cameras also have limitations in low-light situations. In such low-light scenarios, drone motion has to be slowed or else the image will blur.

So what’s the answer? According to researchers at the University of Zurich, the solution lies in their specially developed high tech “event camera,” which works very differently to regular cameras.

Read more
Panasonic is researching a sensor that captures HDR in one shot
quanta image sensor low light camera 46492036  close up

The high dynamic range technique captures more detail and a wider range of light, but the process that requires merging multiple images together limits the method to stationary subjects. Panasonic, however, is researching a sensor that can create images similar to processed HDR photos in a single shot. The research was recently published in Panasonic’s Technical Journal.

The tech is based on organic photoconductive film (OPF) sensors, a type of imaging sensor currently being researched by a number of different companies including Fujifilm as well as Panasonic. Organic sensors use two separate layers, one that’s the light-sensitive “film” and another layer of circuits to transform that light layer into electrical currents to create a digital image. OPF sensors are said to be better in low light because of that multilayer design.

Read more