Skip to main content

In sneak preview, Adobe shows off tech for automatically colorizing old photos

In what has become a popular tradition at the annual Adobe MAX show, Adobe showed off several sneak previews of in-development technologies that may make their way to future versions of Photoshop, Premiere Pro, Illustrator, and more. For example, Character Animator, which recently came out of beta, was unveiled during a previous MAX show. While all of the projects are interesting in their own right as examples of cutting-edge software tech, a few stand out for photographers and video editors.

Powered by the Adobe Sensei AI engine, Project Scribbler can take a black and white photograph and automatically colorize it with surprisingly realistic results. The program was trained on tens of thousands of images to be able to recognize facial features of a monochrome image and appropriately apply correct colors to different regions of a face, from the hair to the skin to the lips and teeth.

Although Project Scribbler is currently limited to faces — it can’t colorize full-body portraits — it is not limited to photos; it can colorize sketches, as well. In a live demonstration, Adobe showed how it can help an artist ideate a character or do a quick mockup to show a client before diving in and finishing the color by hand.

Sensei was definitely a running theme at MAX this year, and two additional projects are using it to provide a much more robust alternative to Photoshop’s Content Aware Fill option for removing and replacing objects in a scene. Project Scene Stitch draws on deep learning and semantic cues to replace a photo’s foreground with one built from Adobe Stock images, while Project Deep Fill applies similar technology to replace smaller objects within an image. Deep Fill can also reshape objects based on user input, which Adobe demonstrated by sketching a heart line beneath a rock arch which caused the arch to conform to the shape of the sketch.

For video editors, Project Cloak is essentially Content Aware Fill applied to video. It automatically removes objects from a video shot without the user needing to clone out the object on a frame-by-frame basis, and it does it in a way that is much more accurate that per-frame editing.

In a series of examples, Adobe demonstrated the impressive range Project cloak offers, from removing a lamppost to erasing two people from a shot where both the people and the camera were moving. If this technology makes it way into a shipping product (our guess is it would end up in After Effects), it would undoubtedly be a game changer for many editors.

For immersive video creators, Adobe also showed off two projects for working in 360-degree space. Project Sidewinder builds a depth map from stereoscopic 360 video which then creates a convincingly real three-dimensional effect and allows the viewer to change perspective beyond simply rotating, moving from side to side or up and down. When it comes to audio, Project SonicScape  offers a visual way to see and reposition audio sources with the spherical space.

Adobe showed off 11 development projects in total that ran the gamut from photography and video to design and 3D modeling and even data visualization. As with past Adobe sneaks, none of the technology demonstrated at MAX is guaranteed to be incorporated into a commercially available product, but the projects do offer a very real look at what Adobe is looking into and the types of tools we can expect to see in the not-too-distant future.

Editors' Recommendations

Daven Mathies
Former Digital Trends Contributor
Daven is a contributing writer to the photography section. He has been with Digital Trends since 2016 and has been writing…
Adobe releases Photoshop from desktop cage with new iPad app — and more to come
photoshop for ipad launches 1

The most well-known photo editor is no longer chained to a desktop. On November 4, Adobe launched Photoshop for iPad, along with a list of updates to make the traditional Photoshop a bit less traditional, including a new Object Selection tool, one-click background removal, and updates to the interface. Adobe also announced Photoshop Camera for iOS and Android, and updates to Premiere Pro and Premiere Rush.
Photoshop for iPad
Teased last year during Adobe Max, Photoshop for iPad made its official debut at the start of this year’s event. While the goal is to eventually bring the same tools available for desktop to the iPad, as Adobe said last year, the first release of the iPad app is lighter than the robust desktop editor. Adobe says the first version focuses on composting, basic retouching, masking and the most commonly used Photoshop processes.

While the iPad version doesn’t have all the bells and whistles yet, Photoshop for iPad is built on the same code base as the original Photoshop, unlike Adobe’s previous Photoshop-inspired mobile apps like Photoshop Fix. Photo editors and designers can work with layers and more, and open the same PSD files in the desktop program. 

Read more
Videos go from widescreen to vertical fast with Adobe Premiere Pro’s new A.I.



Read more
With a touchscreen, the new Loupedeck goes all in on tactile photo, video work
loupedeck creative tool launches ct productshots v2 extra 07 hires

Loupedeck Creative Tool

Loupedeck launched as a tactile photo-editing console, but the company’s latest venture mixes tactile controls with a touchscreen interface designed for more than just photographers. On Tuesday, October 29, the company unveiled the Loupedeck Creative Tool, a customizable creative control console with dials, buttons, and a touchscreen to streamline access to creative software tools across several industries, including photography, videography, music, and design.

Read more