A.I. can generate pictures of a finished meal based on just a written recipe

Recipe books contain photos. You know why? Because most of us aren’t capable of reading through a list of ingredients and associated instructions and picturing exactly what is supposed to come out of the oven or other cooking appliance at the end of the process. Artificial intelligence, it seems, doesn’t have quite the same problem — at least, not according to a project carried out by researchers from Tel-Aviv University in Israel.

Using a training data set of approximately 52,000 written recipes, along with images showing the completed foods, the researchers were able to devise a system that can read a recipe and then generate a picture showing what the end result is likely to look like.

“Our system takes a recipe as an input and generates, from scratch, an image that reflects the food that the system ‘believes’ this recipe describes,” Ori Bar El, one of the co-authors on the paper, told Digital Trends. “The important aspect is that the system has no access to the title of the recipe — otherwise this task would have been pretty easy — and that the text of the recipe is both long and does not describe the visual content of the image directly. [This fact] makes this task very hard even for humans, and all the more so for computers.”

tel aviv ai generates food pictures recipe

The neural network responsible for the feat generates its images using a two-stage process. First, the text of the recipe is converted into a vector of numbers in a process called text embedding. This numerical representation attempts to capture the meaning of the text by mapping semantically similar pieces of text to close vectors in the embedding space. After this is done, a separate network maps the text vectors and images to align them.

In the second stage, the team uses a Generative Adversarial Network (GAN) which both generates new images and evaluates them. This is the process that resulted in the A.I.-created painting which sold at Christie’s auction last year. By having the GAN attempt to fool itself into thinking a generated image is a real photo, the pictures the system comes up with look increasingly realistic.

“[One] challenge we faced was the fact that the quality of the images in the dataset we used was low,” Bar El continued. “This is reflected by lots of blurred images with bad lighting conditions.” The system also turned out to be better at generating certain, more formless foods (pasta, rice, soups, and salads) than others that had a distinctive shape, such as hamburgers.

While the results may be quite good enough for sharing on Instagram, however, it’s nonetheless an impressive example of machine learning. Pair it with IBM’s recipe-generating Chef Watson and it would be more dazzling.

Emerging Tech

How emotion-tracking A.I. will change computing as we know it

Affectiva is just one of the startups working to create emotion-tracking A.I. that can work out how you're feeling. Here's why this could change the face of computing as we know it.
Photography

Free your digital memories, and frame them, with the best photo printers

Printed photos are experiencing a revival at the moment, but you don’t need to go to a special lab. Here’s our favorite options for making quality prints, from pocket-sized printers to wide-format photo printers capable of spitting out…
Gaming

The hottest Nintendo Switch games you can get right now

The Nintendo Switch's lineup started off small, but games have steadily released as the console continues through its second year. Here are the best Nintendo Switch games available now.
Gaming

Get Nindie with it and check out these awesome indie games for the Switch

The Nintendo Switch's portability makes indies feel at home on the platform. Luckily, there are plenty of great titles to choose from. Here are our picks for the best Nintendo Switch indie games.
Emerging Tech

Gravitational forces at heart of Milky Way shaped this star cluster like a comet

Hubble has captured the stunning Messier 62 cluster. The cluster is warped, with a long tail which stretches out to form a shape like a comet. It is thought this distortion is due to Messier 62's proximity to the center of the galaxy.
Emerging Tech

The grid of the future will be powered by … giant subterranean bagpipes?

In order to transition to a more renewable-focused energy system, we need to scale up our grid storage capacity --- and our existing methods aren't going to cut it. Could compressed air be the key?
Emerging Tech

Burgers are just the beginning: Embracing the future of lab-grown everything

You’ve almost certainly heard of the 'farm to fork' movement, but what about 'lab to table'? Welcome to the fast-evolving world of lab-grown meat. Is this the future of food as we know it?
Emerging Tech

Troubleshooting Earth

It’s no secret that humans are killing the planet. Some say it’s actually so bad that we’re hurtling toward a sixth major extinction event -- one which we ourselves are causing. But can technology help us undo the damage we’ve…
Emerging Tech

Inside the Ocean Cleanup’s ambitious plan to rid the ocean of plastic waste

In 2013, Boyan Slat crowdfunded $2.2 million to fund the Ocean Cleanup, a nonprofit organization that builds big, floating trash collectors and sets them out to sea, where they’re designed to autonomously gobble up garbage.
Emerging Tech

Climeworks wants to clean the atmosphere with a fleet of truck-sized vacuums

Using machines that resemble jet engines, Climeworks wants to fight climate change by extracting CO2 from thin air. The gas can then be sold to carbonated drink and agriculture companies, or sequestered underground.
Emerging Tech

How 3D printing has changed the world of prosthetic limbs forever

When he was 13 years old, Christophe Debard had his leg amputated. Here in 2019, Debard's Print My Leg startup helps others to create 3D-printed prostheses. Welcome to a growing revolution!
Emerging Tech

Geoengineering is risky and unproven, but soon it might be necessary

Geoengineering is a field dedicated to purposely changing the world's climate using technology. Call it 'playing god' if you must; here's why its proponents believe it absolutely must happen.
Digital Trends Live

Digital Trends Live: Earth Day, indoor container farming, robot submarines

Today on Digital Trends Live, we discuss how technology intersects with Earth Day, a new Tim Cook biography, indoor container farming, robot spy submarines, A.I. death metal, and more.
Gaming

Google’s Stadia is the future of gaming, and that’s bad news for our planet

Google’s upcoming Stadia cloud gaming service, and its competitors, are ready to change the way gamers play, but in doing so they may kick off a new wave of data center growth – with unfortunate consequences for the environment.