A.I. can generate pictures of a finished meal based on just a written recipe

Recipe books contain photos. You know why? Because most of us aren’t capable of reading through a list of ingredients and associated instructions and picturing exactly what is supposed to come out of the oven or other cooking appliance at the end of the process. Artificial intelligence, it seems, doesn’t have quite the same problem — at least, not according to a project carried out by researchers from Tel-Aviv University in Israel.

Using a training data set of approximately 52,000 written recipes, along with images showing the completed foods, the researchers were able to devise a system that can read a recipe and then generate a picture showing what the end result is likely to look like.

“Our system takes a recipe as an input and generates, from scratch, an image that reflects the food that the system ‘believes’ this recipe describes,” Ori Bar El, one of the co-authors on the paper, told Digital Trends. “The important aspect is that the system has no access to the title of the recipe — otherwise this task would have been pretty easy — and that the text of the recipe is both long and does not describe the visual content of the image directly. [This fact] makes this task very hard even for humans, and all the more so for computers.”

tel aviv ai generates food pictures recipe

The neural network responsible for the feat generates its images using a two-stage process. First, the text of the recipe is converted into a vector of numbers in a process called text embedding. This numerical representation attempts to capture the meaning of the text by mapping semantically similar pieces of text to close vectors in the embedding space. After this is done, a separate network maps the text vectors and images to align them.

In the second stage, the team uses a Generative Adversarial Network (GAN) which both generates new images and evaluates them. This is the process that resulted in the A.I.-created painting which sold at Christie’s auction last year. By having the GAN attempt to fool itself into thinking a generated image is a real photo, the pictures the system comes up with look increasingly realistic.

“[One] challenge we faced was the fact that the quality of the images in the dataset we used was low,” Bar El continued. “This is reflected by lots of blurred images with bad lighting conditions.” The system also turned out to be better at generating certain, more formless foods (pasta, rice, soups, and salads) than others that had a distinctive shape, such as hamburgers.

While the results may be quite good enough for sharing on Instagram, however, it’s nonetheless an impressive example of machine learning. Pair it with IBM’s recipe-generating Chef Watson and it would be more dazzling.

Emerging Tech

Harvard University has a bold new plan to make Mars livable for humans

Want to live on Mars? Harvard researchers have a bold new way to make it happen. Their plan involves covering portions of Mars with an insulating aerogel. Here's why it could work.
Computing

Need a free alternative to Adobe Illustrator? Here are our favorites

Photoshop and other commercial tools can be expensive, but drawing software doesn't need to be. The best free drawing software is just as powerful as some of the more expensive offerings.
Gaming

Get Nindie with it and check out these awesome indie games for the Switch

The Nintendo Switch's portability makes indies feel at home on the platform. Luckily, there are plenty of great titles to choose from. Here are our picks for the best Nintendo Switch indie games.
Gaming

The best Nintendo Switch games, from Breath of the Wild to Rocket League

The Nintendo Switch's lineup started off small, but games have steadily released as the console continues through its second year. Here are the best Nintendo Switch games available now.
Mobile

A.I. photo filters use neural networks to make photos look like Picassos

Artificial Intelligence apps put a novel spin on social network-style photo filters. Instead of just overlaying an effect, these photo filters use machine learning and neural networks to transform an image into a predetermined style.
Emerging Tech

China’s space station, Tiangong-2, has burned up in the atmosphere

China's space station, Tiangong-2, has burned up in the Earth's atmosphere as part of a planned deorbit. It was originally scheduled to be in space for two or three years, but it survived longer than expected and spent 1,000 days in space.
Emerging Tech

How re-engineering an old technology could give us EVs with 700 miles of range

Battery supply has been a critical limiting factor in electric vehicle adoption. Now Portland-based XNRGI has developed a battery based on old silicon wafer technology, and it could revolutionize the battery industry.
Emerging Tech

NASA’s Artemis capsule is complete, will carry the first woman to the moon

The crew capsule which will carry American astronauts to the moon as part of the Artemis project has been completed. The completion of the Artemis 1 capsule was announced by Vice President Mike Pence.
Emerging Tech

Three new astronauts join the International Space Station crew for Expedition 60

Exactly fifty years after Neil Armstrong and Buzz Aldrin set foot on the moon, a new team of astronauts from NASA, Roscosmos, and ESA have arrived at the International Space Station to begin their stay there.
Emerging Tech

Parrot retires its mini-drones to focus on its Anafi quadcopter

Parrot is retiring its mini-drones to focus on developing its more advanced Anafi drone for the commercial market. The company recently won a contract with the U.S. Department of Defense to develop a drone for use in combat.
Emerging Tech

Jetpack pilot flies around Sydney Harbour and stays dry, unlike before

Ten years ago, a jetpack demonstration by Aussie entrepreneur David Mayman saw him end up in Sydney Harbour, but on Sunday he returned with a far more sophisticated design that this time kept him dry.
Emerging Tech

Space tourism is coming, and it’s going to wreak havoc on Earth’s atmosphere

NASA has announced it will be allowing tourists to visit the International Space Station. But experts who spoke to Digital Trends warn that space tourism could hurt the environment by damaging our planet's fragile ozone layer.
Emerging Tech

Elon Musk’s Hyperloop pod race sees German team zoom to victory (again)

A German team of student engineers has come first in the latest Hyperloop pod speed contest in California. The team's design reached 288 mph (463 kph) along a straight, three-quarter-mile test track, beating three rival teams.
Cars

Toyota shows off mascot robots and tiny autonomous car for Tokyo Olympics

Toyota has shown off seven robots that it says will assist and entertain during the Tokyo Olympics next summer. The collection includes mascot and telepresence robots, as well as a tiny autonomous car to help during field events.