A.I. can generate pictures of a finished meal based on just a written recipe

Recipe books contain photos. You know why? Because most of us aren’t capable of reading through a list of ingredients and associated instructions and picturing exactly what is supposed to come out of the oven or other cooking appliance at the end of the process. Artificial intelligence, it seems, doesn’t have quite the same problem — at least, not according to a project carried out by researchers from Tel-Aviv University in Israel.

Using a training data set of approximately 52,000 written recipes, along with images showing the completed foods, the researchers were able to devise a system that can read a recipe and then generate a picture showing what the end result is likely to look like.

“Our system takes a recipe as an input and generates, from scratch, an image that reflects the food that the system ‘believes’ this recipe describes,” Ori Bar El, one of the co-authors on the paper, told Digital Trends. “The important aspect is that the system has no access to the title of the recipe — otherwise this task would have been pretty easy — and that the text of the recipe is both long and does not describe the visual content of the image directly. [This fact] makes this task very hard even for humans, and all the more so for computers.”

tel aviv ai generates food pictures recipe

The neural network responsible for the feat generates its images using a two-stage process. First, the text of the recipe is converted into a vector of numbers in a process called text embedding. This numerical representation attempts to capture the meaning of the text by mapping semantically similar pieces of text to close vectors in the embedding space. After this is done, a separate network maps the text vectors and images to align them.

In the second stage, the team uses a Generative Adversarial Network (GAN) which both generates new images and evaluates them. This is the process that resulted in the A.I.-created painting which sold at Christie’s auction last year. By having the GAN attempt to fool itself into thinking a generated image is a real photo, the pictures the system comes up with look increasingly realistic.

“[One] challenge we faced was the fact that the quality of the images in the dataset we used was low,” Bar El continued. “This is reflected by lots of blurred images with bad lighting conditions.” The system also turned out to be better at generating certain, more formless foods (pasta, rice, soups, and salads) than others that had a distinctive shape, such as hamburgers.

While the results may be quite good enough for sharing on Instagram, however, it’s nonetheless an impressive example of machine learning. Pair it with IBM’s recipe-generating Chef Watson and it would be more dazzling.

Mobile

Photograph your meal with the Foodvisor app for caloric, nutritional estimates

Many of us understand the importance of a healthy diet, but counting calories and diving into nutritional data is a lot of work. The Foodvisor app for Android or iOS gives you a calorific and nutritional breakdown of your food from a photo.
Gaming

The hottest Nintendo Switch games you can get right now

The Nintendo Switch's lineup started off small, but games have steadily released as the console continues through its second year. Here are the best Nintendo Switch games available now.
Emerging Tech

Awesome Tech You Can’t Buy Yet: camera with A.I. director, robot arm assistant

Check out our roundup of the best new crowdfunding projects and product announcements that hit the web this week. You may not be able to buy this stuff yet, but it sure is fun to gawk!
Web

Switch up your Reddit routine with these interesting, inspiring, and zany subs

So you've just joined the wonderful world of Reddit and want to explore it. With so many subreddits, however, navigating the "front page of the internet" can be daunting. Here are some of the best subreddits to get you started.
Emerging Tech

Pilotless planes are on their way, but would you fly in one?

Airbus says advancements in artificial intelligence can help it toward its goal of building a plane capable of fully autonomous flight, though whether passengers can be persuaded to travel in one is another matter entirely.
Emerging Tech

‘Tech vest’ prevents Amazon workers from colliding with robot co-workers

Amazon workers at its fulfillment centers are using "tech vests" to help protect them from collisions with their robot co-workers. The robots already have obstacle avoidance sensors, but the belt offers another layer of safety.
Mobile

T-Mobile 5G rollout: Here is everything you need to know

2019 will be a huge year for T-Mobile. Not only is a merger with Sprint likely, but T-Mobile is also in the midst of building out its next-generation mobile service. Here's everything you need to know about the T-Mobile 5G rollout.
Emerging Tech

3D printers are finally affordable. Here are the best models under $500

3D printer prices have dropped dramatically over the past few years, but just because something is cheap doesn’t mean it’s worth buying. Here, we’ve rounded up all the cheap 3D printers that are actually worth spending your money on.
Emerging Tech

ANYmal dog robot can get back on its feet when someone pushes it over

Roboticists at ETH Zurich have demonstrated how their ANYmal four-legged robot is capable of taking a kicking and keeping on walking -- or getting back to its feet if it's pushed over.
Emerging Tech

A.I. finds non-infringing ways to copy drugs pharma spends billions developing

Researchers have demonstrated an artificial intelligence which can find new methods for producing existing pharmaceuticals in a way that doesn’t infringe on existing patents. Here's how.
Emerging Tech

Coinstar machines will let you swap cash for Bitcoin at your local grocery store

Coinstar, the company which owns the coin exchange machines found at grocery stores and elsewhere, will soon let you easily buy Bitcoin with your cash money. Here's how it will work.
Emerging Tech

Facebook hasn’t given up on the idea of building an internet drone

Facebook's efforts to provide internet connectivity from the skies using solar-powered drones suffered a blow last year when the company abandoned its "Aquila" drone project. But the company clearly hasn't given up on the idea.
Emerging Tech

World’s biggest fleet of campus delivery robots now transporting student meals

The world’s largest fleet of delivery robots on a university campus is coming to Fairfax County, Virginia’s George Mason University. Here's how the ordering and delivery process plays out.
Deals

Smart luggage does it all with wireless charger, built-in scale, GPS tracking

The SkyValet smart luggage, currently being funded on Kickstarter, offers solutions to many common travel struggles. With SkyValet, you no longer need separate portable chargers, a scale to weigh your bag, a lock, or a tracking device. It's…