New software in development at Cornell easily alters lighting conditions in post-edit

cornell user assisted image compositing for photographic lighting computational design research 1

Ever stumbled on a listing for a dream apartment on Craigslist, only to be disappointed when you looked through the photos that are either heavily overexposed or underexposed? If so, then you know how important good lighting is, as it can make or break a sale. These photos are often taken by the broker or landlord who’s using a point-and-shoot or cell phone, and using whatever light is at their disposal. Unless you’re a multimillion-dollar real estate company, chances are you don’t have the budget to hire a pro photographer who has the equipment to control the lighting. But new software developed by researchers at Cornell University with support from Adobe could one day help us change the lighting conditions of a photo after it’s been shot.

The Cornell software's "basis lights and modifiers."
The Cornell software’s “basis lights and modifiers.”

The software is an enhancement to “computational lighting design,” a technique that’s currently used by photographers in architecture and advertising to adjust lighting after a scene had been shot using minimal equipment. How it currently works is: a camera on a tripod takes many shots at various exposures while someone walks around a room and repositions a flash to expose different areas of the scene. All these shots are then fed into Photoshop as layers, which can then be used to change the conditions to whatever suits the mood or assignment.

Using Cornell's software to change the lighting conditions of a room.
Using Cornell’s software to change the lighting conditions of a room.

The problem with this technique is that the post-editing process takes a long time, but the Cornell software streamlines that process by sorting and combining layers into three composite images that the researchers call “basis lights,” according to Cornell University’s Cornell Chronicle. “Edge Lighting, which emphasizes the shapes of objects and their shadows; Fill Lighting, which illuminates everything uniformly; and Diffuse Color Light, which brings out the color and texture of every object,” the Chronicle wrote, explaining the three basis lights. “The user can select areas of the image in which to apply varying amounts of each. Adding more Fill Light, for example, lightens shadows.”

Another example of how the software can be used to changed the lighting after it’s been shot, using composites of multiple images that were taken (shown up top).

“We also introduce modifiers that capture standard photographic tasks, e.g., to alter the lights to soften highlights and shadows, akin to umbrellas and soft boxes,” according to the research paper abstract.

During the research, pro photographers who work with computational lighting design were asked to compare the Cornell software and traditional method, and they found the basis lights gave them a good starting point while reducing time spent. What’s more interesting is that seven novices with limited photography experience were able to produce professional quality results in an average of 15 minutes, the Chronicle wrote.

Kavita Bala, the Cornell associate professor of computer science who’s leading the project along with graduate student Ivaylo Boyadzhiev and Sylvain Paris of Adobe Research, said the software is not ready for primetime, but she hopes a prototype will be available. Bala said the final product would probably become part of Photoshop or Lightroom. 

Let’s hope this comes soon, as those real estate brokers and landlords would finally have an easy tool that’ll turn apartments from crappy-looking slums into luxury condos – in photos, at least.

Check out the video below for a demo.

(Images via PetaPixel via Cornell Chronicle/Cornell University)

Product Review

Equal parts fresh and familiar, Canon's EOS R gives pros the best of both

While the EOS R is Canon’s first foray into full-frame mirrorless cameras, the EOS R feels like anything but a first-generation product.

Adobe’s Premiere Rush is a video-editing app designed for social media projects

At Adobe MAX 2018, Adobe unveiled updates across the board for all of its Creative Cloud apps, from the release of Premiere Rush CC, a social-focused video editor, to Project Gemini, a digital drawing and painting tool.
Smart Home

How to create spooky Halloween effects with smart home lighting and sound

This Halloween, bathe your home with eerie smart home lighting and audio effects guaranteed to spook your neighbors. Use colored light and eerie sounds to create eerie Halloween effects.

When you're ready to shoot seriously, these are the best DSLRs you can buy

For many photographers the DSLR is the go-to camera. With large selection of lenses, great low-light performance, and battery endurance, these DSLRs deliver terrific image quality for stills and videos.

Google is revolutionizing smartphone photos with computing, not lenses

The new Google Pixel 3 phones are here, and the most intriguing features are cameras that leverage computational photography to deliver great photos. Can we say bye to crappy zoom and poor low-light images?

Incredible images reveal the eye of a weevil and other microscopic wonders

You can't see it, but that doesn't mean it's not stunning. The winners of the 2018 Nikon Small World competition are a mix of science and art. The winning entry captures the eye of a weevil and the jewelry-like scales surrounding the eye.

Luminar (re)touches the sky with a simple A.I.-powered slider

Tired of making complex masks to bring out the sky in a photograph? A.I. can do some of that enhancement for you with a new A.I. Sky Enhancer inside Skylum Luminar. The tool uses A.I. to apply the adjustment to only the sky.
Social Media

3D Facebook photos jump out of the newsfeed, no glasses needed

You're not seeing things -- that photo in your Facebook newsfeed is 3D. Launching today, 3D Facebook Photos use the depth maps from dual-lens smartphones to add dimension to an image as you move your phone.

These point-and-shoot cameras make your smartphone pics look like cave paintings

If your smartphone camera just isn't giving you the results you're looking for, maybe it's time to step up your game. The latest and greatest point-and-shoot cameras offer large sensors, tough bodies, and long lenses - something no phone…
Social Media

Instagram is testing a new way for you to look through your feed

Instagram is constantly tweaking its app to help give its users the best experience possible, so how do you like the sound of tapping — instead of swiping — to look through your feed?

Photography News: Raw edits on iPad and an A.I. research lab for PicsArt

In this week's photography news, Canon launched an iPad app that allows for RAW edits on the go. Popular mobile editing app PicsArt now has a research lab dedicated entirely to A.I.-powered tools.

Adobe's "creativity conference" begins October 15. Here's what we hope to see

Each year, Adobe uses its Adobe MAX conference to show off its latest apps, technologies, and tools to help simplify and improve the workflow of creatives the world over. Here's what you should expect from this year's conference.
Emerging Tech

Awesome Tech You Can’t Buy Yet: DIY smartphones and zip-on bike tires

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!
Emerging Tech

Here’s all the best gear and gadgetry you can snag for $100 or less

A $100 bill can get you further than you might think -- so long as you know where to look. Check out our picks for the best tech under $100, whether you're in the market for headphones or a virtual-reality headset.