A.I. can generate pictures of a finished meal based on just a written recipe

Recipe books contain photos. You know why? Because most of us aren’t capable of reading through a list of ingredients and associated instructions and picturing exactly what is supposed to come out of the oven or other cooking appliance at the end of the process. Artificial intelligence, it seems, doesn’t have quite the same problem — at least, not according to a project carried out by researchers from Tel-Aviv University in Israel.

Using a training data set of approximately 52,000 written recipes, along with images showing the completed foods, the researchers were able to devise a system that can read a recipe and then generate a picture showing what the end result is likely to look like.

“Our system takes a recipe as an input and generates, from scratch, an image that reflects the food that the system ‘believes’ this recipe describes,” Ori Bar El, one of the co-authors on the paper, told Digital Trends. “The important aspect is that the system has no access to the title of the recipe — otherwise this task would have been pretty easy — and that the text of the recipe is both long and does not describe the visual content of the image directly. [This fact] makes this task very hard even for humans, and all the more so for computers.”

tel aviv ai generates food pictures recipe

The neural network responsible for the feat generates its images using a two-stage process. First, the text of the recipe is converted into a vector of numbers in a process called text embedding. This numerical representation attempts to capture the meaning of the text by mapping semantically similar pieces of text to close vectors in the embedding space. After this is done, a separate network maps the text vectors and images to align them.

In the second stage, the team uses a Generative Adversarial Network (GAN) which both generates new images and evaluates them. This is the process that resulted in the A.I.-created painting which sold at Christie’s auction last year. By having the GAN attempt to fool itself into thinking a generated image is a real photo, the pictures the system comes up with look increasingly realistic.

“[One] challenge we faced was the fact that the quality of the images in the dataset we used was low,” Bar El continued. “This is reflected by lots of blurred images with bad lighting conditions.” The system also turned out to be better at generating certain, more formless foods (pasta, rice, soups, and salads) than others that had a distinctive shape, such as hamburgers.

While the results may be quite good enough for sharing on Instagram, however, it’s nonetheless an impressive example of machine learning. Pair it with IBM’s recipe-generating Chef Watson and it would be more dazzling.

Emerging Tech

Awesome Tech You Can’t Buy Yet: camera with A.I. director, robot arm assistant

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!
Gaming

The hottest Nintendo Switch games you can get right now

The Nintendo Switch's lineup started off small, but games have steadily released as the console continues through its second year. Here are the best Nintendo Switch games available now.
Web

Switch up your Reddit routine with these interesting, inspiring, and zany subs

So you've just joined the wonderful world of Reddit and want to explore it. With so many subreddits, however, navigating the "front page of the internet" can be daunting. Here are some of the best subreddits to get you started.
Mobile

Unleash your inner artist with the best drawing apps for the iPad Pro

The best drawing apps for the iPad Pro turn Apple's robust tablet into a canvas worthy of a true artist. Here are 20 of our current favorites, whether you're looking to keep things simple or take your art to the next level.
Emerging Tech

Hexbot is a modular robot arm that does everything from drawing to playing chess

Who wouldn’t want their own personal robot arm to do everything from laser engraving to competing against you in a game of chess? That's what Hexbot, a new modular robot, promises to deliver.
Emerging Tech

The best drone photos from around the world will take your breath away

Most of today's drones come equipped with high-end cameras, which are quickly revolutionizing the world of aerial photography as we know it. Here are some of the best drone photos from around the world.
Emerging Tech

Google’s radar-sensing tech could make any object smart

Computer scientists have shown how Google’s Soli sensor can be used to make dumb objects smart. Here's why radar-powered computing could finally make the dream of smart homes a reality.
Emerging Tech

Too buzzed to drive? Don’t worry — this autonomous car-bar will drive to you

It might just be the best or worst idea that we've ever heard: A self-driving robot bartender you can summon with an app, which promises to mix you the perfect drink wherever you happen to be.
Emerging Tech

Scientists successfully grow human blood vessels in a Petri dish

Researchers have managed to grow human blood vessels in a Petri dish for the first time, and even to successfully implant them into live mice. The results could be a game-changer for diabetes.
Emerging Tech

Tiny animals discovered in Antarctic lake deep beneath the ice

Scientists have made a surprising discovery in Antarctica: the carcasses of tiny animals including crustaceans and a tardigrade were found in a lake that sits deep beneath over half a mile of Antarctic ice.
Emerging Tech

How long is a day on Saturn? Scientists finally have an answer

The length of Saturn's day has always been a challenge to calculate because of the planet's non-solid surface and magnetic field. But now scientists have tracked vibrations in the rings to pin down a final answer.
Emerging Tech

Tiny microbots fold like origami to travel through the human body

Tiny robots modeled after bacteria could be used to deliver drugs to hard to reach areas of the human body. Scientists have developed elastic microbots that can change their shape depending on their environment.
Emerging Tech

Dinosaurs never stood a chance after asteroid impacts doubled 290M years ago

The number of asteroids pummeling Earth jumped dramatically around 290 million years ago. By looking at Moon craters, scientists discovered that d the number of asteroid impacts on both Earth and the Moon increased by two to three times.
Emerging Tech

Saturn didn’t always have rings, according to new analysis of Cassini data

Saturn's rings are younger than previously believed, according to new data gathered from the Cassini mission. The rings are certainly less than 100 million years old and perhaps as young as 10 million years old.