This flexible camera takes crazy images

Dr. Shree Nayar, Director of Columbia University’s Computer Vision Lab, studies the science behind photography. “Wouldn’t it be nice if we had cameras we can wrap around things?” he wondered one day.

So his team went and made one.

Researchers at the lab — including research engineer Daniel Sims and postdoctoral researcher Yonghao Yue — explored this question with their Flexible Sheet Camera study. The team made a flexible lens array that can wrap around everyday objects, capturing unique images and mounting in ways never possible before.

Nayar, one of the study leaders, put this project in the perspective of our current limitations. “Cameras today capture the world from essentially a single point in space,” he said in a release. “We are exploring a radically different approach to imaging.”

The problem with flexing a lens is that it produces gaps in the image. “Imagine you have a sheet and you have lots of pixels on the sheet, and you have little lenses that are attached to each pixel,” Nayar told Digital Trends. “Now you have the directions in which you are looking, and when you bend it, the directions just fan out. When they do fan out, it’s very easy to see that you’re going to miss information between the pixels; there are going to be gaps.”

The initial thought was to attach a little lens to individual pixels. But Nayar pointed out that this would never work. “When you have millions of pixels, that would be impossible to control.” This lens avoids that problem by using the native properties of the material.

The camera lens looks vaguely like a flexible solar tile. When bent, it captures an image that may appear altered but is still a high quality full picture. The team used silicone for the prototype sheet camera that lets the focal length of each lens vary with the curvature of the sheet, meaning there is no missing information as the lens deforms.

The key was in the material. Nayar told DT, “if you choose the right materials and the right shape, the material itself deforms in a way that you want, that gives it the right optical properties without adding any additional engineering.” He makes it sound easier that it was, of course. This silicone lens is the result of much testing and experimentation.

To test it, the team positioned a Nikon D90 under a vice that flexed the sheet camera. Photos captured showed that the field of view increased the more it flexed.

“We believe there are numerous applications for cameras that are large in format but very thin and highly flexible,” Nayar said. “The adaptive lens array we have developed is an important step towards making the concept of flexible sheet cameras viable.”

This means that the rubber bumper strip surrounding your car could one day be a 360-degree camera lens. Or that one day, a photographer’s newest dream toy could be a camera the size and shape of a credit card that flexes to adjust the field of view. This study could be the first accurate use of the term “flex-cam.”

Still, we’re a very long way from seeing it on store shelves. Such a system would need to be manufactured relatively inexpensively for broad use, something that will take time and money. This study is simply a step in the right direction. The team will eventually seek a partnership to develop a sensor, but the immediate next step is to share the advancement with the scientific community. The first author of the paper, Daniel Sims will present the prototype at the International Conference on Computational Photography at Northwestern, May 13 to 15.

Product Review

Canon democratizes full-frame with the EOS RP, but keep your expectations low

At just $1,300, the RP is Canon's least expensive full-frame camera yet, but it was born into a world of high-end, high-cost lenses where it doesn't yet feel at home.

The best Samsung Galaxy S9 Plus cases to keep your titanic phone safe

The new Samsung Galaxy S9 Plus is a gorgeous device, with one of the best dual-lens cameras we've ever seen. Keep your titanic device safe and scratch-free with the best Samsung Galaxy S9 Plus cases.

From DSLRs to mirrorless, these are the best cameras you can buy right now

From entry-level models to full-frame flagships, many cameras take great photos and video. The best digital cameras, however, push the industry forward with innovative sensors and improved usability, among other things. Here are our…

Love Playmoji pack adds animated Valentine’s stickers to your Pixel photos

Valentine's Day is here, and to celebrate, Google has added the "Love Playmoji" pack to the Playground feature on its Google Pixel camera. The new feature will add cute AR-driven extras to your Pixel photos.

Using A.I., Lightroom can now boost the resolution of RAW photos

Need to eek a bit more resolution out of a RAW file? Adobe Lightroom and Camera Raw can help with a new feature called Detail Enhance. The tool uses A.I. in the demosaicing process to enhance details and reduce artifacts.

Tight on space? Here’s how to transfer photos from an iPhone to a computer

Never lose any of your cherished selfies or family vacation photos from your iPhone again by learning how to transfer photos from your iPhone to a computer, whether you want to use a cable or wireless transfer.

Corel VideoStudio adds tools for customizing color in simple video edits

VideoStudio is Corel's more consumer-oriented video editor but the software recently gained advanced color correction tools. The update adds custom transitions, along with speeding up performance, and adding new shortcuts.

500px reveals almost 15 million users are caught up in security breach

Almost 15 million members of portfolio website 500px have been caught up in a security breach. The hack occurred in 2018 but was only discovered last week. Users are being told to change their 500px password as soon as possible.

Olympus packs an enormous zoom ability in its latest interchangeable lens

The Olympus Digital ED M.Zuiko 12-200mm F/3.5-6.3 has the widest zoom range of any interchangeable lens with a 16.6x zoom. The lens, which covers a 24-400mm equivalent, is also weather sealed.

Nikon brings a classic workhorse lens to the Z series with new 24-70mm f/2.8 S

The Nikon Z series finally has a bright zoom available without an adapter. The Nikkor Z 24-70mm F/2.8 S offers new coatings and more customizable controls in a smaller, lighter body than the comparable F-mount lens.

Nikon will bring eye-detection autofocus to the Z6 and Z7 in May

An upcoming firmware update will bring Eye AF to the Nikon Z6 and Z7 -- along with improved autofocus performance in low light. The update will also give the cameras support for the CFexpress format.

Fujifilm’s X-T30 is a semi-pro, feature-rich camera that’s affordable to boot

Fujifilm's newest mirrorless camera delivers the premium features of the X-T3 without the premium price, giving aspiring enthusiasts a lower-cost option that can still match the image quality of Fuji's flagship.

Fujifilm XP140 squeezes more durability, low-light ability into a waterproof cam

Fujifilm's waterproof compact can now head even further underwater. The Fujifilm XP140 features several upgrades, including a more durable body, a wider ISO range for low light, and expanded auto modes.

From f/1.2 primes to the mysterious DS, here are Canon’s upcoming RF lenses

Canon's EOS R mirrorless series will gain six new lenses this year. Canon just shared a list of six lenses under development, including four zooms and two prime lenses. One has a mysterious new feature called Defocus Smoothing.