CMOS camera sensor inventor returns with an extreme-low-light follow-up

quanta image sensor low light camera 46492036  close up
The same engineer that created the CMOS sensor (above) is developing a low light quanta image sensor. Muhammad Amal Farial Khalid / 123RF
The engineer that developed the CMOS sensor now found in a majority of cameras and smartphones may have just discovered the next generation of camera sensors. Eric R. Fossum and the Dartmouth College Thayer School of Engineering published research in the December 20 issue of Optica detailing the Quanta Image Sensor (QIS), a digital camera sensor capable of capturing images even in the smallest amount of light possible.

What makes the QIS unique is that the sensor only needs a single photon of light to capture an image, which opens up possibilities for extreme low-light photography in a number of fields, including both artistic and scientific applications. Earlier attempts to design a sensor capable of performing in such low light conditions required large pixel sites, which creates a low-resolution image, or cooling mechanisms because the hardware couldn’t perform at room temperature.

The first QIS sensor is a 1-megapixel sensor with a frame rate numbering in the thousands — and the researchers say the technology could easily be upscaled to create higher resolution devices. Because the sensor is so sensitive to light, in the scientific community, the technology could allow scientists to capture images of stars previously too distant to capture, according to The project, which was partially funded by the Defense Advanced Research Projects Agency (DARPA), would also have implications for security applications because of the low-light capability.

While the scientific — and even medical — possibilities are intriguing, the low-light sensor could also eventually make its way into the field of cinematography and photography. The greater sensitivity to light would allow the digital sensor to record with a look closer to film, while maintaining the characteristics of a digital file, like easy editing with software.

While the initial QIS sensor has only a million pixels, the sensor is made up of billions of what the researchers call “jots.” These jots function like tiny pixels, and in the most extreme low-light conditions, each jot can collect just one photon, enabling that low-light capability. The QIS sensor uses a layered or stacked design, which has already been introduced in CMOS sensors, using a layer of jots and then a layer of circuits and drivers, allowing the data from those jots to be read at those frame rates in the thousands. That’s how the QIS sensor works in the simplest form, but as the academic research details, there’s much more involved, including techniques to reduce noise.

Of course, the technology won’t ever reach consumer level if the QIS sensor can’t reach the same resolution of today’s CMOS cameras or if it isn’t affordable enough to manufacture. Thankfully, the researchers kept both in mind while developing the first QIS. The jots are arranged in clusters, which allows that first 1-megapixel sensor to be scaled for higher resolution applications. The research team also designed the QIS so that the hardware could be developed using some of the same machines used to develop CMOS, lowering the production costs by using existing equipment.

The QIS sensor has some more work to be done before entering the consumer world — it is currently only monochrome, for example — but if the tech makes its way past medical, scientific and security applications, QIS could mean some serious low-light capabilities for videographers and photographers. Fossum, the inventor of the CMOS and a Dartmouth professor, worked with Jiaju Ma, Saleh Masoodian and Dakota A. Starkey on the project.

Emerging Tech

Light, speed: Lighting kit for DJI Mavic 2 lets you fly and film in the dark

Lume Cube, maker of small battery-powered LED lights for mobile photography, has announced a new lighting kit built specifically for the DJI Mavic 2 -- the first of its kind. Already our favorite drone, this makes the Mavic 2 even better.

Razer’s classic DeathAdder Elite gaming mouse drops to $40 on Amazon

If you're looking to pick up a new gaming mouse for the holidays, Amazon has you covered with this great deal on the classic Razer DeathAdder Elite gaming mouse with customizable buttons, RGB lighting, and a 16,000 DPI optical sensor.

From DSLRs to mirrorless, these are the best cameras you can buy right now

From entry-level models to full-frame flagships, many cameras take great photos and video. The best digital cameras, however, push the industry forward with innovative sensors and improved usability, among other things. Here are our…

Xiaomi is preparing to set records with 48-megapixel phone camera

Bigger doesn't always mean better, but it certainly makes headlines. Chinese mobile giant Xiaomi is set to release a phone camera with a staggeringly large 48 megapixels on a single sensor.

Photographers can now customize the layout of Lightroom Classic controls

Tired of scrolling past Lightroom tools that you don't use? Adobe Lightroom Classic now allows users to reorganize the Develop panel. The update comes along with new sharing options in Lightroom CC, and updates to the mobile Lightroom app.
Social Media

Instagram could be making a special type of account for influencers

Instagram influencers fall somewhere between a business profile and a typical Instagram, so the company is working on developing a type of account just for creators. The new account type would give creators more access to analytical data.

Leave the laptop at home, the iPad Pro is the travel buddy to take on vacay

The iPad Pro is a powerful tablet that's perfect for creatives and professionals. How does it fare when traveling with it as a laptop replacement? We took it on a two week trek in Japan to find out.

Best Products of 2018

Our reception desk has so many brown boxes stacked up, it looks like a loading dock. We’re on a first-name basis with the UPS guy. We get new dishwashers more frequently than most people get new shoes. What we’re trying to say is: We…

These are the best action cameras money can buy

Action cameras are great tools for capturing videos of your everyday activities, whether it's a birthday party or the steepest slope you've ever descended on your snowboard. These are the best money can buy.

Canon holiday sale features the Rebel T6 2-lens kit for just $449

If you have a budding photographer in your life in need of a real camera, the Canon EOS Rebel T6 could make the perfect gift. Canon is currently offering the camera in a two-lens bundle for just $449 through December 29.
Social Media

Instagram’s 2018 year in review shines a light on where our hearts are

What did Instagram users share the most in 2018? A lot of heart emojis, heart face filters, and heart GIFs. The platform recently shared the year's top trends, including hashtags like #fortnite and #metoo along with a few surprises.

Want a fun, affordable instant camera? The Fujifilm Instax Mini 7S is just $49

Instant cameras have had a surprising resurgence of late, and no brand is better recognized in the instant photo space today than Fujifilm Instax. Walmart is currently offering the Instax Mini 7S for just $49.

Not just for Lightroom anymore, Loupedeck+ now works with Photoshop

Loupedeck+ can now help photographers edit in Photoshop too, thanks to physical controls for swapping tools, running actions, and more. The photo-editing console expanded to include Photoshop in the list of compatible editing programs.
Emerging Tech

The best drone photos from around the world

Most of today's drones come equipped with high-end cameras, which are quickly revolutionizing the world of aerial photography as we know it. Here are some of the best drone photos from around the world.