Adobe’s craziest new tools animate photos, convert recordings to music in a click

adobe max 2018 what to expect tiffany haddish
Actress Tiffany Haddish (left) co-hosting the 2018 Adobe MAX “Sneaks” keynote with Paul Trani, senior Creative Cloud evangelist at Adobe.

Adobe’s artificial intelligence is already introducing features that streamline the creative process but a look at what is next for Adobe Sensei could push the technology beyond just time-saving tools. During Adobe Max 2019, Adobe unveiled several sneak peeks at what the software engineers are developing next using the company’s artificial intelligence, Adobe Sensei. From creating a moving photo in one click, converting a recorded voice into a musical instrument to designing an animation that reacts to real-time tweets, creatives could soon have some crazy new tools inside the Creative Cloud.

Project Moving Stills

Project Moving Stills converts a still image into an animation, but unlike a cinemagraph, Moving Stills creates realistic 3D-camera movements in one click. Demonstrated on stage, the software uses A.I. to move into the scene, creating an effect that looks more like a videographer moving through the image than a boring 2D-slideshow transition.

Adobe Sensei understands how objects are arranged in a 3D space, Adobe explained, and uses that information to not only create a 3D-motion effect, but to also determine the best effect for that scene. The setting can be applied with one click, but the software also includes a handful of tools to change the 3D movement, from moving into the scene to panning up and down. The software also allows for custom camera movement by selecting a starting and ending point.

Moving Stills can also apply effects to multiple effects at once, creating a photo slideshow that makes the objects in the images pop as if shot with a 3D camera instead of the boring traditional zoom-pans on stills. (Sorry, Ken Burns.)

The popularity of cinemagraphs and GIFs have inspired several new tools like Plotagraph, but instead of animating an object in the photo, Moving Stills appears to take a step into the photo. As a sneak peek, Adobe hasn’t yet shared when Moving Stills will actually launch, or even if it will launch as a stand-alone or as part of existing software.

Project Kazoo

Don’t know how to play an instrument or sing, but want to create your own audio? A.I. may soon be able to help with that. Project Kazoo is a program that turns recordings of your voice into notes on an instrument — or even notes from a soprano singer.

Demonstrated on stage at Max by Adobe’s Zeyu Jin, the software first takes a recording and arranges that audio as notes on a scale, noting the note and duration. Users then select an instrument from a drop-down menu and the program replays those notes in that instrument. Besides working with voice, the program can also turn a recording of one instrument into another. A transpose slider also allows adjusting the audio to a higher or lower pitch.

Besides helping the non-musically inclined create their own audio, Adobe says the prototype can also be used to create effects for cartoon characters, like imagining what a cartoon violin’s laugh would sound like.

Brush Bounty

What if Photoshop brushes could paint motion? That’s the idea behind Brush Bounty, a tool that allows animators to paint in effects that would otherwise be time-consuming or even impossible to animate. Adobe’s Fabin Rasheed demonstrated Project Brush Bounty at Max, including brushes that could paint in the rain, hair blown by the wind, a sparkling night sky or a glowing orb.

Besides just saving animators from individually creating each drop of rain and each strand of hair, Brush Bounty can also tie those animations into locations or even tweets. Adding a hashtag to the project allows the animation to react in real time to any tweets using that hashtag. For example, on stage, Rasheed created a superhero with a glowing orb that increased in size and intensity with each tweet of #BrushBounty. 

The animation can also be tied to the viewer’s location — like matching the weather in the animation to the location. Another sneak peek showed the tool changing the direction of the wind based on how the viewer was holding the smartphone, changing wind directions with the movement of the smartphone.

The files can be exported as videos or GIFs, along with web elements for the interactive animations. Like the other sneak peeks, Adobe hasn’t shared just when the tool will launch.

Project Fastmask

For video editors, creating masks is a time-consuming task, particularly in scenarios with so much movement that the auto mask options don’t work. Project Fastmask is an A.I.-powered tool that masks out moving subjects — and even works after they leave the frame.

The person (or animal) is masked out by placing a handful of boundary points in the first frame. Clicking propagate will then adjust those boundary points for the next frame, continuing through the end of the clip and leaving a well-masked character for further adjustments.

Project Smooth Operator

Vertical videos are a headache for creatives shooting a video for multiple platforms (we’re looking at you, IGTV). Project Smooth Operator uses A.I. to automatically crop horizontal videos to vertical ones — without leaving the subject behind.

Smooth Operator uses A.I. to analyze the video and determine the most important parts. The tool will then keep those elements in the frame using the selected aspect ratio. If the subject moves, the crop will follow in a manner that feels similar to real panning. Besides converting from horizontal to vertical, the tool can also crop to a less drastic different aspect ratio.

Even more impressive, the demonstration included a video with two different subjects, a dog and its owner playing fetch. Smooth Operator panned between the two subjects, deciding where to be based on the action in the video.

Project Fontphoria

Getting just the right font is often a struggle for designers, but A.I. will soon be able to generate a font from an image — including characters that weren’t actually in the image. Fontphoria generates a font based on an image of text, such as a photo of hand-lettering or the font from a vintage poster. The program can also similarly generate fonts when you open a document but don’t have all the fonts used, applying the characteristics of the existing characters to create a full font.

A lens mode will allow Fontphoria to preview the font on existing text, using augmented reality to replace the existing text with the new font. Another feature allows custom modifications to be applied to all the characters at once, instead of manually applying special effects to each letter.

Adobe’s list of sneak peeks also included Fantastic Fold, a design program for packaging, Project Model Morph for manipulating 3D objects inside (eventually) Adobe Dimension, and Project Good Bones, a tool allowing for shape-aware editing of vector graphics. Adobe also offered a sneak at Project Waltz, which uses a smartphone to take photos or video from inside a 3D project.

As sneak peeks, Adobe hasn’t shared what or even how the tools will arrive — some will likely be stand-alone programs while others may be integrated into existing programs.

Emerging Tech

Awesome Tech You Can’t Buy Yet: 1-handed drone control, a pot that stirs itself

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!

Edit portraits with A.I. and adjust focus in the new ON1 Photo RAW 2019 editor

ON1 Photo RAW 2019 now has a dedicated tab for portraits that automatically recognizes faces to help with retouching. The update also brings a new focus stacking tool, enhancements to layers, and improvements to local adjustments.

The best HTC Vive games available today

So you’re considering an HTC Vive, but don't know which games to get? Our list of 25 of the best HTC Vive games will help you out, whether you're into rhythm-based gaming, interstellar dogfights, or something else entirely.

Premiere Pro A.I. plug-in for Adobe paints your videos in the style of van Gogh

CyberLink is bringing its suite of artificial intelligence-based video effects directly to Adobe users as a plug-in for Premiere Pro. The A.I. Style video plug-in "redraws" video in the styles of artists like Vincent van Gogh.
Emerging Tech

New simulation shows how Elon Musk’s internet satellite network might work

Elon Musk has the dream of building a network for conveying internet traffic via thousands of satellites. A new simulation created by a computer scientist looks at how feasible the idea is.

A dead pixel doesn't mean a dead display. Here's how to repair it

Dead pixel got you down? We don't blame you. Check out our guide on how to fix a dead pixel and save yourself that costly screen replacement, or an unwanted trip to your local repair shop.

Great PC speakers don't need to break the bank. These are our favorites

Not sure which PC speakers work best with your computer? Here are the best computer speakers on the market, whether you're working with a tight budget or looking to rattle your workstation with top-of-the-line audio components.

Printing to PDF in Windows is easy, no matter which method you use

Microsoft's latest operating system makes it easier than ever to print to PDF in Windows, but there are alternative methods for doing so, even if you want to forgo Adobe Acrobat. Here's how.

These are the 5 best free antivirus apps to protect your MacBook

Malware protection is more important than ever, even if you eschew Windows in favor of Apple's desktop platform. Thankfully, protecting your machine is as easy as picking from the best free antivirus apps for Mac suites.

These laptop bags will keep your notebook secure wherever you go

Choosing the right laptop bag is no easy feat -- after all, no one likes to second-guess themselves. Here are some of the best laptop bags on the market, from backpacks to sleeves, so you can get it right the first time around.

These Windows 10 keyboard shortcuts will update your OG Windows skills

Windows 10 has many new features, and they come flanked with useful new keyboard shortcuts. Check out some of the new Windows 10 keyboard shortcuts to improve your user experience.

Protecting your PDF with a password isn't difficult. Just follow these steps

If you need to learn how to password protect a PDF, you have come to the right place. This guide will walk you through the process of protecting your documents step-by-step, whether you're running a MacOS or Windows machine.

Don't know what to do with all your old DVDs? Here's how to convert them to MP4

Given today's rapid technological advancements, physical discs are quickly becoming a thing of the past. Check out our guide on how to convert a DVD to MP4, so you can ditch discs for digital files.

Here’s how to install Windows on a Chromebook

If you want to push the functionality of your new Chromebook to another level, and Linux isn't really your deal, you can try installing Windows on a Chromebook. Here's how to do so, just in case you're looking to nab some Windows-only…