Neural network can create high-res images based on a text description

As far as artificial intelligence goes, 2016 has been the year of deep learning. Brain-inspired neural networks have received massive amounts of investment in time, resources and funding — and, boy, has it ever paid off!

In a new piece of research — carried out by investigators at Rutgers University, the University of North Carolina at Charlotte, Lehigh University, and the Chinese University of Hong Kong — neural networks have been used to generate high quality images based on nothing more detailed than basic text descriptions.

“Generating realistic images from text descriptions has many applications,” researcher Han Zhang told Digital Trends. “Previous approaches have difficulty in generating high resolution images, and their synthesized images in many cases lack details and vivid object parts. Our StackGAN for the first time generates 256 x 256 images with photo-realistic details.”

A video of the work was shared online by YouTuber Károly Zsolnai-Fehér as part of his excellent series of Two Minute Papers educational videos.

ai generates images based on text birdflowerdemo

“For many years, we have trained neural networks to perform tasks like face, traffic sign, or handwriting recognition,” Zsolnai-Fehér told us. “Generally, with millions of training examples, we show the neural network how to do something, and expect them to learn these concepts, and do well on their own afterwards. This piece of work is completely different: here, after learning the neural networks are able to create something completely new — such as synthesizing new, photorealistic images from a piece of text we have written. This opens up a world of possibilities, and I am super-excited to see where researchers take this concept in the future.”

While there have certainly been examples of computational creativity before — ranging from MIT’s Nightmare Machine to projects that can generate predictive video simply by looking at a still image — this is nonetheless an intriguing piece of work. It’s also fascinating because the two-stage method of drawing images looks, to our way of thinking, a whole lot like the way artists will sketch out a piece of work, and then do a second pass to add detail.

We may still be a way from replacing human illustrators with robots, but this is nonetheless an exciting leap forward.

Product Review

Google’s Pixel 3 is a hair away from pocket-sized perfection

Google’s Pixel 3 smartphone is the best Android phone you can buy. It doesn’t have the best looks or the best hardware, but you’ll be hard pressed to find better software and unique A.I. functionalities.
Emerging Tech

Curious how A.I. 'brains' work? Here's a super-simple breakdown of deep learning

What is deep learning? A branch of machine learning, this field deals with the creation of neural networks that are modeled after the brain and adept at dealing with large amounts of human-oriented data, like writing and voice commands.
Emerging Tech

What the heck is machine learning, and why is it everywhere these days?

Machine learning has been responsible for some of the biggest advances in artificial intelligence over the past decade. But what exactly is it? Check out our handy beginner's guide.
Computing

Nvidia is slowly rolling out its next generation of GPUs. Here's what you need to know about them

Nvidia's new RTX 2000 series graphics cards are impressive pieces of hardware, with some amazing advancements and some rather high price tags to match. Here's everything you need to know about Nvidia's new top-tier cards.
Emerging Tech

Shrimp eyes inspire new camera focused on helping self-driving cars see better

By mimicking the vision of mantis shrimp, researchers were able to make significant improvements on today’s commercial cameras. They hope their technology can help mitigate accidents by letting self-driving vehicles see more clearly.
Emerging Tech

This intelligent parachute system can bail out clumsy drone pilots

Parachutes can save drones when they unexpectedly fall from the sky. Among a number of such systems, Austrian firm Drone Rescue is this week showing off its latest design that automatically deploys when it senses trouble.
Cars

‘Bloodhound’ rocket car needs a speedy cash injection to survive

The rocket-powered Bloodhound car has driven into difficulties, with the company behind the project needing a multi-million-dollar cash injection to save its dream of attempting a 1,000 mph land speed record.
Emerging Tech

Tokyo robotic warehouse needs almost no human workers

Uniqlo has unveiled its first robot-powered warehouse that requires 90 percent fewer human workers to operate. The Japanese clothing giant plans to invest close to $1 billion dollars to convert all of its warehouses worldwide.
Emerging Tech

Drop everything and watch Boston Dynamics’ robo-dog dance to ‘Uptown Funk’

After a few years of Earthbound training, Boston Dynamics’ SpotMini robot dog is ready to take on Mars. Bruno Mars, to be precise. Check out Skynet's future pet as you've never seen it before.
Emerging Tech

Self-correcting quadcopter can keep itself aloft even if one rotor fails

Most quadcopters won't fly unless all four rotors are functioning. But what happens if one gets damaged during flight? Researchers from the Netherlands think they've come up with a solution.
Emerging Tech

MIT is building a new $1 billion college dedicated to all things A.I.

Massachusetts Institute of Technology (MIT) has announced a new $1 billion college of computing designed to offer the best possible education to future machine learning A.I. experts.
Emerging Tech

This gadget lets you sleep on airplanes without snuggling a stranger

Odd gadget, or a hug for your face? The Napup Fly+ is a travel pillow, sleep mask, and personal speaker system all rolled into one, attached to the back of the headrest to hold your head up.
Emerging Tech

From flying for fun to pro filmmaking, these are the best drones you can buy

In just the past few years, drones have transformed from a geeky hobbyist affair to a full-on cultural phenomenon. Here's a no-nonsense rundown of the best drones you can buy right now, no matter what kind of flying you plan to do.
Emerging Tech

Healthy mice born from two genetic mothers using stem cells, gene editing

Healthy mice have been born from two genetics mothers and later went on to bear healthy offspring of their own, according to a recent paper published by researchers at the Chinese Academy of Sciences.