Adobe Project WetBrush and Project StyLit could be game changers for painters and animators

Updated November 4, 2016 to include Project StyLit demonstration video from Adobe.

Adobe is showing off two in-development technologies at its 2016 Adobe MAX conference. Project StyLit and Project WetBrush, aim to simplify and improve the way animators, illustrators, and painters work by bridging the gap between traditional and digital mediums. Digital Trends received a demo of the new technologies, and spoke with two Adobe representatives close to the projects.

First up is Project StyLit, which was previously demonstrated publicly this past June. Project StyLit makes its easy to illustrate complex shapes and add a hand drawn look to computer graphics by applying an artist’s style on a 3D model.

Adobe Principal Scientist, Paul Asente, demonstrated the technology in real-time. He started by drawing a simple outline of a circle on a piece of paper. Already, the system began applying the style to the source 3D model (in this case, a dinosaur).

Next, Asente began to shade within the circle to create a sphere, adding colors for highlights, midtones, and shadows. The software realistically transferred both the colors and textures to the appropriate areas of the source image. It was a bit like magic.

Finally, Asente swapped in a series of pre-drawn styles by other artists, showing the versatility of Project StyLit in recreating virtually any look, from a colored pencil scorpion to a pastel pumpkin.

The demo involved styles created on physical media which were transferred to Project StyLit via a live camera, but styles can also be created digitally within another application, like Photoshop.

In its current state, Project StyLit carries some limitations. Styles need to closely match the lighting quality of the target model – drawing a bright highlight and trying to apply it to a model that has no such highlights will result in an error. It can also only handle a single model at a time and can’t create full scenes directly on its own, beyond adding a basic background color. However, by applying the same style to a collection of models, it’s possible to create additional elements of a scene that can be composited digitally.

While Project StyLit requires a 3D model to work, the style is actually applied and rendered in two dimensions. A model, therefore, can’t be manipulated once a style is applied. However, by animating the target model separately and applying the style to each frame, Project StyLit can be used for animations. Adobe hopes to increase its effectiveness as an animating tool in the future, which could one day become a huge time saver.

A physics-based painting simulator

As Zhili Chen, Research Scientist at Adobe, explained, Project WetBrush is an attempt to bring the detailed look of brush strokes and paint behavior into the digital world. It can capture the up-close look of, say, an oil painting in a realistic way, like no other application can.

Perhaps the best way to describe it is as a painting simulator.

“The key to Project WetBrush is physics,” Chen said.

Everything in the program is modeled in three-dimensional space, from the thousands of bristles at the tip of the virtual paintbrush to the paint fluid itself. Not only does this generate realistic texture in the brush stroke, but different paints will even mix together to form new colors, just as they would if the artist was working with real paint on a physical canvas.

Again, all of this happens in three dimensional space and in real time. Chen showed how the canvas can be tilted and rotated to see the effect of lighting on the surface of the artwork. Zooming in reveals the depth of the paint itself, including the peaks and troughs created by crisscrossing brush strokes. The finished file can even be sent to a 3D printer.

Project WetBrush creates a very easy entry point into the digital space for traditional artists, as they can apply the same techniques they use on physical media without needing a deeper understanding of the software.

It will, however, likely require some serious computing muscle to handle it. Chen said that a RAW file at 4K resolution would be in the range of two to three gigabytes, but he clarified that this was before any compression was applied.

Both Project WetBrush and Project StyLit currently exist as experiments within Adobe, without a set timeframe for when they may find their way into a commercial application. The tools look incredibly promising, though, so hopefully we won’t have to wait long.

Home Theater

Looking for a podcast? Pandora’s Podcast Genome Project is just the ticket

Pandora has created a brand new service for podcast listeners. Powered by calls the Podcast Genome Project, the new podcast offering uses an advanced combination of algorithms and human curation to deliver the perfect podcasts for you.
Photography

Premiere Pro A.I. plug-in for Adobe paints your videos in the style of van Gogh

CyberLink is bringing its suite of artificial intelligence-based video effects directly to Adobe users as a plug-in for Premiere Pro. The A.I. Style video plug-in "redraws" video in the styles of artists like Vincent van Gogh.
Emerging Tech

The best drone photos from around the world

Most of today's drones come equipped with high-end cameras, which are quickly revolutionizing the world of aerial photography as we know it. Here are some of the best drone photos from around the world.
Photography

Photography News: Flickr keeping Creative Commons photos, ONA gets colorful

Flickr has confirmed it's saving all Creative Commons images, ONA has released a new capsule collection in partnership with Passion Passport and 7Artisans has launched a new drone-specific 35mm f/5.6 lens.
Photography

Get your Sagan on with 60 awe-inspiring photos of the final frontier

Few things instill a sense of wonder quite like the final frontier. The best space photos show off the beauty of Earth, our solar system, and the far corners of the universe. Here are our current favorites.
Deals

Cyber Monday 2018: When it takes place and where to find the best deals

Cyber Monday is still a ways off, but it's never too early to start planning ahead. With so many different deals to choose from during one of the biggest shopping holidays of the year, going in with a little know-how makes all the…
Emerging Tech

Awesome Tech You Can’t Buy Yet: 1-handed drone control, a pot that stirs itself

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!
Product Review

Airselfie 2 may as well be a GoPro stapled to a drunk hummingbird

On paper, the Airselfie 2 is marketed as flying photographer that fits in your pocket and snaps selfies from the sky. Unfortunately it’s more like a HandiCam controlled by a swarm of intoxicated bumblebees
Mobile

Which smartphone has the best camera? We found the sharpest shooters

They say that the best camera is always the one you have with you and that makes your smartphone camera very important indeed. Join us for a closer look at the best camera phones available right now.
Smart Home

Picture this: The Aura packs thousands of photos in a single frame (for a price)

Are you one of those people who miss the good old days of flipping through photo albums to see each and every favorite photo? If so, you might love the Aura digital photo frame. We tested the device and came away impressed.
Photography

Full frame or 4K for less than $1K? These 4 older cameras still have a lot to offer

Looking for a great camera deal? Sometimes, you might be better off buying one that's a few years -- last generation's professional models may not cost much more than today's entry-level models.
Photography

Get up close and personal with this telephoto lens for your phone

Moment is replacing its aging 60mm telephoto lens with a new 58mm tele lens, redesigned from the ground up for the latest iPhone, Pixel, and Galaxy phones. Mount it onto the phone via a case and get closer with 2x optical zoom.
Photography

Golf ball-sized Lume Cube Air is a pocketable LED for photos and video

Off-camera lighting for smartphones and GoPros just got even smaller. Meet the Lume Cube Air, a smaller portable LED light designed for photos and videos that weighs only about two ounces.
Photography

Edit portraits with A.I. and adjust focus in the new ON1 Photo RAW 2019 editor

ON1 Photo RAW 2019 now has a dedicated tab for portraits that automatically recognizes faces to help with retouching. The update also brings a new focus stacking tool, enhancements to layers, and improvements to local adjustments.