Skip to main content

New storage solutions could support high-res, high-speed video

canon patent details stacked sensors with autofocus layer 47498039 l
Missisya/123rf
Camera manufacturers make resolution look easy with upward of 50 megapixels in a number of the latest high-end cameras, but as the resolution climbs, another challenge emerges — how do you store all of that data quickly enough to support video at high frame rates? Turns out, the answer may involve giving each pixel it’s own storage bank for that data. The idea comes from three different groups that presented their research at the Institute of Electrical and Electronics Engineers (IEEE) International Electron Devices meeting earlier this month, including two high speed camera developers and Canon.

Global image shutters are generally considered the best option for video because they expose the entire sensor at once, eliminating the distortion in fast-moving subjects caused by the rolling shutter usually associated with CMOS sensors. CCDs, by design, use a global shutter — but they also overheat when used at fast shutter speeds.

However, a CMOS sensor can be given a global shutter if each pixel stores data in its own set of separate memory cells, instead of storing all of the image data in one memory bank. That allows for high-resolution video at fast frame rates, but that’s also why those high-resolution cameras are often limited to only short clips — those small, individual memory cells don’t have the capacity to store enough data for long videos.

Kuroda presented a partial version of a CMOS sensor that expands each pixel’s memory capacity. While the sensor presented was only a 96 x 128 pixel sensor built for testing, the team was able to capture one million frames per second for longer than other laboratory-level high-speed cameras, about 480 microseconds, since each pixel has a whopping 480 memory cells.

A research group from Tohoku had a similar goal but a different approach. Instead of spreading all those memory cells across the sensor, the team built the memory deeper into the camera — discovering that the deeper design meant less current loss. The design allows for increasing the recording length of those same high-speed laboratory cameras in a smaller space.

But for the photographers who don’t have access to those high-end laboratory cameras used in engineering and science, Canon could be bringing a new memory cell design to consumer cameras in the future. During the meeting, representatives from Canon illustrated a work-around that allows each memory unit to receive data four times during a single exposure, instead of just once. Canon says that by emptying the data from each pixel multiple times instead of just once, the photograph’s saturation and dynamic range improves.

While the early research shows promise for enhancing laboratory cameras, it’s not yet clear if (or when) that same concept would trickle down to expand the often short maximum clip length for 4K video from DSLRs, or if Canon’s research will eventually bring that enhanced dynamic range to market.

Editors' Recommendations

Hillary K. Grigonis
Hillary never planned on becoming a photographer—and then she was handed a camera at her first writing job and she's been…
Fujifilm’s most-hyped camera has just started shipping
Fujifilm's X100VI camera, released in 2024.

The latest iteration of Fujifilm’s X100 camera started shipping on Wednesday.

The X100VI is -- as the name cleverly suggests -- the sixth in the series. Early reviews have been mostly positive as the camera builds on the successes of the already impressive earlier models going all the way back to the original X100, which launched in 2011.

Read more
How to resize an image on Mac, Windows, and a Chromebook
Windows 11 set up on a computer.

Resizing an image is something we’re all going to have to do at some point in our digital lives. And whether you’re using Windows, macOS, or you’re rocking a Chromebook, there are ways to scale images up and down on each PC. Fortunately, these are all relatively simple methods too.

Read more
Watch an acclaimed director use the iPhone 15 Pro to shoot a movie
acclaimed director uses iphone 15 to shoot movie shot on pro midnight

Shot on iPhone 15 Pro | Midnight | Apple

As part of its long-running Shot on iPhone series, Apple recently handed acclaimed Japanese director Takashi Miike (Audition, 13 Assassins, The Happiness of the Katakuris) an iPhone 15 Pro to shoot a short film.

Read more