Neural network can create high-res images based on a text description

As far as artificial intelligence goes, 2016 has been the year of deep learning. Brain-inspired neural networks have received massive amounts of investment in time, resources and funding — and, boy, has it ever paid off!

In a new piece of research — carried out by investigators at Rutgers University, the University of North Carolina at Charlotte, Lehigh University, and the Chinese University of Hong Kong — neural networks have been used to generate high quality images based on nothing more detailed than basic text descriptions.

“Generating realistic images from text descriptions has many applications,” researcher Han Zhang told Digital Trends. “Previous approaches have difficulty in generating high resolution images, and their synthesized images in many cases lack details and vivid object parts. Our StackGAN for the first time generates 256 x 256 images with photo-realistic details.”

A video of the work was shared online by YouTuber Károly Zsolnai-Fehér as part of his excellent series of Two Minute Papers educational videos.

ai generates images based on text birdflowerdemo

“For many years, we have trained neural networks to perform tasks like face, traffic sign, or handwriting recognition,” Zsolnai-Fehér told us. “Generally, with millions of training examples, we show the neural network how to do something, and expect them to learn these concepts, and do well on their own afterwards. This piece of work is completely different: here, after learning the neural networks are able to create something completely new — such as synthesizing new, photorealistic images from a piece of text we have written. This opens up a world of possibilities, and I am super-excited to see where researchers take this concept in the future.”

While there have certainly been examples of computational creativity before — ranging from MIT’s Nightmare Machine to projects that can generate predictive video simply by looking at a still image — this is nonetheless an intriguing piece of work. It’s also fascinating because the two-stage method of drawing images looks, to our way of thinking, a whole lot like the way artists will sketch out a piece of work, and then do a second pass to add detail.

We may still be a way from replacing human illustrators with robots, but this is nonetheless an exciting leap forward.

Product Review

Google’s Pixel 3 is a hair away from pocket-sized perfection

Google’s Pixel 3 smartphone is the best Android phone you can buy. It doesn’t have the best looks or the best hardware, but you’ll be hard pressed to find better software and unique A.I. functionalities.
Emerging Tech

Curious how A.I. 'brains' work? Here's a super-simple breakdown of deep learning

What is deep learning? A branch of machine learning, this field deals with the creation of neural networks that are modeled after the brain and adept at dealing with large amounts of human-oriented data, like writing and voice commands.
Emerging Tech

What the heck is machine learning, and why is it everywhere these days?

Machine learning has been responsible for some of the biggest advances in artificial intelligence over the past decade. But what exactly is it? Check out our handy beginner's guide.
Computing

Nvidia is slowly rolling out its next generation of GPUs. Here's what you need to know about them

Nvidia's new RTX 2000 series graphics cards are impressive pieces of hardware, with some amazing advancements and some rather high price tags to match. Here's everything you need to know about Nvidia's new top-tier cards.
Emerging Tech

From flying for fun to pro filmmaking, these are the best drones you can buy

In just the past few years, drones have transformed from a geeky hobbyist affair to a full-on cultural phenomenon. Here's a no-nonsense rundown of the best drones you can buy right now, no matter what kind of flying you plan to do.
Emerging Tech

Healthy mice born from two genetic mothers using stem cells, gene editing

Healthy mice have been born from two genetics mothers and later went on to bear healthy offspring of their own, according to a recent paper published by researchers at the Chinese Academy of Sciences.
Emerging Tech

Light-swallowing room promises Call of Duty fans the blackest of ops

What's it like to be in a room fully painted with the world's darkest material, Vantablack? The makers of one of the year's top video games teamed up with Vantablack scientists to find out.
Emerging Tech

Japanese scientists are chewing over an ‘electric gum’ that never loses flavor

Researchers at Japan's Meiji University may have found the secret to unlimited chewing gum -- and it just involves zapping your tongue with electricity. Here's what makes it all work.
Smart Home

Vector, the engaging Alexa-like robot, is ready to roam around your home

Anyone who has ever watched Short Circuit or WALL-E has surely dreamed about having a robot buddy come live with them. Finally, that dream is now a reality. It's name is Vector, and it's available now.
Emerging Tech

Ekster 3.0 lets you ask, ‘Alexa, where did I leave my wallet?’

Ekster's newest smart wallet is its best yet. It's slimmer than ever, boasts a neat card-dispensing mechanism, and will even let you know where it is, thanks to smart speaker integration.
Emerging Tech

Johns Hopkins’ lab-grown human retina could lead to big insights

Scientists from Johns Hopkins University have successfully grown human retina tissue from scratch in a lab. The work could help with the development of new therapeutics related to eye diseases.
Wearables

Skydio’s self-flying drone now has an Apple Watch app for flight prep

Skydio's clever R1 autonomous drone now has its own Apple Watch app, making flight preparations simpler than ever. The $2,000 flying machine is now also selling at its first retail outlet — Apple Stores in North America.
Emerging Tech

Are e-cigarettes safe? Here’s what the most recent science says

Ecigarettes are widely regarded and advertised as a healthier alternative to cigarettes for people who are trying to kick the smoking habit. How safe are these cigarette alternatives? We went deep into the recent scientific literature to…
Emerging Tech

Scientists created a condom that self-lubricates during sex. You’re welcome

Researchers from Boston University have invented a special coating for condoms which make them respond to bodily fluids by becoming more slippery. Here's how their new breakthrough works.