Can computers draw? Google just taught a neural network to sketch

google sketch rnn research googlesketch
The doodles above were created by Sketch RNN and overlaid on a stock photo. Google Research / Igor Stevanovic / 123RF
Google’s AI can now identify your rough sketches — but the research team is also teaching computers to draw their own doodles. On April 13, the Google research team shared their latest work involving a neural network capable of drawing its own sketches, currently being called Sketch RNN. Unlike AutoDraw, Sketch RNN is a recently published research paper and is not yet available to the public.

The system is based on human sketches, but doesn’t imitate the human doodles exactly, Google Research says, instead creating its own new drawings. While the system still starts with a sketch, the program reconstructs the original drawing in a unique way. That’s because the team deliberately added noise between the encoder and decoder, so that the computer can’t recall the exact sketch.

The goal isn’t to teach computers to copy a drawing, but to see if neural networks are in fact capable of creating their own drawings. To do that, Google researchers David Ha and Douglas Eck used the process of creating 70,000 drawings to teach the system using the motor sequences, like direction and when to lift the pen, instead of simply inputting thousands of already completed drawings.

While the system’s cat drawings don’t look much better than a preschooler’s, sketch RNN is capable of creating a unique sketch. To test the program’s ability to draw a unique cat, the team also feeds it data of odd drawings, like a three-eyed cat. “When we feed in a sketch of a three-eyed cat, the model generates a similar looking cat that has two eyes instead, suggesting that our model has learned that cats usually only have two eyes,” Ha wrote.

If the input sketch is actually of a different object but still paired with the word cat, the program still creates a cat, though the overall shape mimics the original drawing. For example, when the researchers drew a truck and told the computer it was a pig, they got a truck-shaped pig.

So what’s the real world application? Google Research says the program can help designers quickly generate a large number of unique sketches. Eventually, the program could also be used to teach drawing, learn more about the way humans sketch, or to finish incomplete drawings.

Emerging Tech

Awesome Tech You Can’t Buy Yet: Folding canoes and ultra-fast water filters

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!
Emerging Tech

CRISPR gene therapy regulates hunger, staves off severe obesity in mice

Researchers from UC San Francisco have demonstrated how CRISPR gene editing can be used to prevent severe obesity in mice, without making a single edit to the mouse's genome. Here's how.
Cars

The redesigned 2020 Passat shows Volkswagen still believes in sedans

The sedan segment in America is shrinking, but Volkswagen still believes in it. The German firm has released a teaser sketch to preview the redesigned 2020 Passat it will introduce during the 2019 Detroit Auto Show.
Emerging Tech

Transplanted pig hearts show promise in baboon trials. Are humans next?

Researchers in Germany have successfully transplanted modified pig hearts into baboons. The results take us one step closer to ending organ transplant waiting lists for good. Here's why.
Photography

From DSLRs to mirrorless, these are the best cameras you can buy right now

From entry-level models to full-frame flagships, many cameras take great photos and video. The best digital cameras, however, push the industry forward with innovative sensors and improved usability, among other things. Here are our…
Photography

Photographers can now customize the layout of Lightroom Classic controls

Tired of scrolling past Lightroom tools that you don't use? Adobe Lightroom Classic now allows users to reorganize the Develop panel. The update comes along with new sharing options in Lightroom CC, and updates to the mobile Lightroom app.
Mobile

Leave the laptop at home, the iPad Pro is the travel buddy to take on vacay

The iPad Pro is a powerful tablet that's perfect for creatives and professionals. How does it fare when traveling with it as a laptop replacement? We took it on a two week trek in Japan to find out.
Social Media

Instagram could be making a special type of account for influencers

Instagram influencers fall somewhere between a business profile and a typical Instagram, so the company is working on developing a type of account just for creators. The new account type would give creators more access to analytical data.
Cars

Best Products of 2018

Our reception desk has so many brown boxes stacked up, it looks like a loading dock. We’re on a first-name basis with the UPS guy. We get new dishwashers more frequently than most people get new shoes. What we’re trying to say is: We…
Photography

These are the best action cameras money can buy

Action cameras are great tools for capturing videos of your everyday activities, whether it's a birthday party or the steepest slope you've ever descended on your snowboard. These are the best money can buy.
Photography

Canon holiday sale features the Rebel T6 2-lens kit for just $449

If you have a budding photographer in your life in need of a real camera, the Canon EOS Rebel T6 could make the perfect gift. Canon is currently offering the camera in a two-lens bundle for just $449 through December 29.
Emerging Tech

Light, speed: Lighting kit for DJI Mavic 2 lets you fly and film in the dark

Lume Cube, maker of small battery-powered LED lights for mobile photography, has announced a new lighting kit built specifically for the DJI Mavic 2 -- the first of its kind. Already our favorite drone, this makes the Mavic 2 even better.
Social Media

Instagram’s 2018 year in review shines a light on where our hearts are

What did Instagram users share the most in 2018? A lot of heart emojis, heart face filters, and heart GIFs. The platform recently shared the year's top trends, including hashtags like #fortnite and #metoo along with a few surprises.
Deals

Want a fun, affordable instant camera? The Fujifilm Instax Mini 7S is just $49

Instant cameras have had a surprising resurgence of late, and no brand is better recognized in the instant photo space today than Fujifilm Instax. Walmart is currently offering the Instax Mini 7S for just $49.