Neural network can create high-res images based on a text description

As far as artificial intelligence goes, 2016 has been the year of deep learning. Brain-inspired neural networks have received massive amounts of investment in time, resources and funding — and, boy, has it ever paid off!

In a new piece of research — carried out by investigators at Rutgers University, the University of North Carolina at Charlotte, Lehigh University, and the Chinese University of Hong Kong — neural networks have been used to generate high quality images based on nothing more detailed than basic text descriptions.

“Generating realistic images from text descriptions has many applications,” researcher Han Zhang told Digital Trends. “Previous approaches have difficulty in generating high resolution images, and their synthesized images in many cases lack details and vivid object parts. Our StackGAN for the first time generates 256 x 256 images with photo-realistic details.”

A video of the work was shared online by YouTuber Károly Zsolnai-Fehér as part of his excellent series of Two Minute Papers educational videos.

ai generates images based on text birdflowerdemo

“For many years, we have trained neural networks to perform tasks like face, traffic sign, or handwriting recognition,” Zsolnai-Fehér told us. “Generally, with millions of training examples, we show the neural network how to do something, and expect them to learn these concepts, and do well on their own afterwards. This piece of work is completely different: here, after learning the neural networks are able to create something completely new — such as synthesizing new, photorealistic images from a piece of text we have written. This opens up a world of possibilities, and I am super-excited to see where researchers take this concept in the future.”

While there have certainly been examples of computational creativity before — ranging from MIT’s Nightmare Machine to projects that can generate predictive video simply by looking at a still image — this is nonetheless an intriguing piece of work. It’s also fascinating because the two-stage method of drawing images looks, to our way of thinking, a whole lot like the way artists will sketch out a piece of work, and then do a second pass to add detail.

We may still be a way from replacing human illustrators with robots, but this is nonetheless an exciting leap forward.

Emerging Tech

‘Rogue medicine in a bathtub’: 4 experts on the vice and virtue of pharma hacking

A biohacker, pharmahacker, and two bioethicists walk into a bar. We ordered them a metaphorical round and had a chat about the risks and rewards of DIY medicine — from unsanctioned gene therapy to medication made on the kitchen counter.
Emerging Tech

Stanford A.I. can realistically score computer animations just by watching them

Researchers at Stanford University have developed a computer system that’s able to synthesize realistic sounds for 3D animation, based entirely on its knowledge about the physical world.
Emerging Tech

Replaced by robots: 10 jobs that could be hit hard by the A.I. revolution

According to one study, 47 percent of current jobs in the United States could be automated within the next two decades. Here are 10 examples of the kind of employment that refers to.
Emerging Tech

By studying patient data, A.I. can limit toxicity in cancer treatment

In a bid to improve quality of life for cancer patients, a team of researchers at the Massachusetts Institute of Technology have turned to machine learning to help avoid toxicity from cancer medications.
Cars

You don’t need to go autonomous to make trucking safer

Long haul truckers are very good at their jobs, but they face long hours and unpredictable conditions. Autonomous tech may be coming, but here’s how lidar technology companies are working to enhance trucking safety today.
Emerging Tech

Be a master of your own ever-changing ‘galaxy’ with this kinetic wall art

Art Machine is a stunning work of kinetic art that looks like a continuously swirling galaxy or turbulent weather formation viewed through a ship's porthole. Check it out in all its glory.
Emerging Tech

Omega Centauri hosts 10 million stars and probably not an ounce of life

Omega Centauri is about 16,000 light years away, making it visible to the naked eye. And it contains some 10 million stars, making it the largest globular cluster in the Milky Way. But it probably doesn't have an ounce of life.
Emerging Tech

The world’s first practical quantum computer has cash and a timeline

The dream of building a practical quantum computer could be closer than ever, thanks to a $15 million grant from the National Science Foundation to seven universities around the United States.
Emerging Tech

Forget flying cars: This shoe-tying robot is proof that the future is here

Engineering students from the University of California, Davis, recently built a robot whose sole personality in life is to tie shoelaces. It cost them under $600 to do it as well!
Emerging Tech

Bizarre stork robot uses a drone to compensate for its weak, twig-like legs

Developed by engineers from Japan’s University of Tokyo, Aerial Biped is a robot whose top half is comprised of a flying quadrotor UAV that's rooted to the ground by thin stork-like legs.
Emerging Tech

A treasure trove of 3D scientific specimens is now free to see online

Thanks to the California Academy of Sciences, you can access more than 700 scientific specimens and artifacts from the world-class collection via the online 3D and virtual reality platform Sketchfab.
Emerging Tech

Lyd is a battery-powered, ‘no-spill’ bottle that is activated by your lips

Lyd is a battery-powered bottle that’s something like a sippy cup for adults. Its no-spill solution is a specialized lid that uses an algorithm to detect when your lips are on the bottle.
Emerging Tech

Cotton and corn! Reebok’s newest sneaker is ‘made from things that grow’

Keen to move away from using oil-based materials to make its footwear, Reebok has turned to cotton and corn for its latest sneaker. No dyes have been used to color the shoes, either, and the packaging is 100 percent recyclable.
Computing

Apple AR glasses will launch in 2020, says respected industry analyst

Apple AR glasses may be closer to reality than we thought. Here is everything we know so far about the augmented reality system, including the rumored specifications of Apple's Project Mirrorshades.