Hot dog! Yelp photo classification makes food shots easier to browse

yelp photo classification sandwiches somacrop
Yelp
A picture may be worth a thousand words — but it can also be worth lunch. Yelp visitors often rely on photographs to determine their next dining spot, and now, updated artificial intelligence is helping to both prioritize the best images and categorize each shot. So how can a computer determine a salad from a slice of pizza? Lindsay Goyne, Yelp consumer product manager Lindsay Goyne and software engineer Alex Miller recently sat down with Digital Trends to share just how new software is pushing more relevant photos to foodies through new Yelp photo classification.

yelp photo classification sandwichessomamobile
Yelp
Yelp

Unlike the new app inspired from HBO’s Silicon Valley, which doesn’t actually have much real world use outside of a few laughs, Yelp’s new hot dog-identifying app works to create a better experience for Yelp users. The neural network identifies over 20 different types of food, categorizing each dish so users can find out what that new diner’s burger looks like without digging through a few hundred photos. Hungry for pizza? Tap the photos, the food option, then click the pizza tab and see if that restaurant you’ve always wanted to try puts big chunks of tomato on top or whether they have deep dish.

“Photos have been trending up through multiple photo apps and the web,” said Goyne, “it’s a new favorite way to consume information. For some of these lower-risk options, like finding an option for lunch where you don’t need to do a bunch of research and you aren’t spending much money, photos are a great way to do that research.”

The software, launching earlier this year, is a result of user feedback. Yelp said that, when it comes to restaurant reviews, some of the most common questions were whether they had a certain dish. By organizing photos uploaded from other users, Yelp is able to present that information in a more precise way.

Yelp

The convolutional neural network was based on a model built by Google researchers, Miller said. Artificial intelligence platforms are frequently shared among developers so new programs don’t need to start from scratch — like Google’s Wi-Fi-free object recognition algorithm. Yelp gave the system expanded object recognition capabilities by feeding the system thousands of images for each food category. With that data, the computer was able to learn what makes a hot dog different from a sandwich.

Along with the food categories, images are automatically sorted by shots of the interior and exterior and photos of the menu.

Yelp also uses both user response and artificial intelligence to determine which photographs to show first. While the company is continuing to develop software for ordering the photos, the software mixes user feedback — including clicks on “helpful” and “like” — and mixes that with an AI program that puts blurry, dark photos toward the end of the list and images with a nice depth of field and more contrast to the top of the list. The program also tries to prevent similar photos from showing up right next to each other, like three burgers in a row, and determines what image to use as the main photo.

yelp photo classification sandwiches soma copy
Yelp
Yelp

Yelp’s software engineers are also working to teach the computer to recognize what the most important object in the photograph is, so that when the images is cropped to fit on different areas of the web page, the subject is still included.

The software is helping users sift through review photos that, on the most popular restaurants, can number over 1,000. Users won’t see the feature universally, since locations with only a few photographs do not integrate the category organization.

Yelp plans to bring the image classification system into more areas and is currently researching how a similar feature could help users looking for home services and automotive.

Mobile

Taking shots in the dark with Night Sight, the Pixel’s newest photo feature

The Google Pixel range has always been the home of some of the mobile world's best phone cameras. That performance is now getting even better with the introduction of the low-light Night Sight mode.
Product Review

Mediocre battery and a big notch slight Google's otherwise perfect Pixel phone

Google’s Pixel 3 XL has two big flaws: The gigantic notch on the front, and mediocre battery life. That being said, this is the best Android experience you can find in a smartphone today.
Mobile

These 100 best iPhone apps will turn your phone into a jack-of-all-trades

The iPhone is the most popular smartphone in the world, and we want to bring out the best in yours. Behold our comprehensive list of the best iPhone apps, from time-saving productivity tools to fun apps you won’t be able to put down.
Mobile

Google’s Gboard now uses A.I. to recommend GIFs based on your conversation

Google is bringing a new feature to Gboard that should make it better for those that regularly use GIFs and stickers. The feature essentially uses A.I. to recommend GIFs and stickers based on your conversation.
Photography

Golf ball-sized Lume Cube Air is a pocketable LED for photos and video

Off-camera lighting for smartphones and GoPros just got even smaller. Meet the Lume Cube Air, a smaller portable LED light designed for photos and videos that weighs only about two ounces.
Photography

Edit portraits with A.I. and adjust focus in the new ON1 Photo RAW 2019 editor

ON1 Photo RAW 2019 now has a dedicated tab for portraits that automatically recognizes faces to help with retouching. The update also brings a new focus stacking tool, enhancements to layers, and improvements to local adjustments.
Product Review

Fewer pixels, better camera? The Nikon Z6 shows the beauty of restraint

The Nikon Z6 is the sibling to the new mirrorless Z7 -- but for some photographers, the cheaper Z6 may be the better option. Read where the $2,000 camera beats the $3,400 one (and where it doesn’t) in our Nikon Z6 review.
Photography

Alpha Female: Sony awards five women grants to support artisan diversity

Women can face several challenges in launching a photography career -- Sony's latest initiative aims to help propel women in the industry forward. Sony recently announced the winners of the Alpha Female program.
Emerging Tech

The best drone photos from around the world

Most of today's drones come equipped with high-end cameras, which are quickly revolutionizing the world of aerial photography as we know it. Here are some of the best drone photos from around the world.
Social Media

Build a wish list and shop videos with Instagram’s latest shopping update

Eyeing a product on Instagram? Now there are more ways to shop from the social network. Instagram just rolled out options to save products in a collection as users can also now shop from videos.
Photography

See the National Forests like never before in these awe-inspiring drone videos

What's the difference between a National Park and a National Forest? Drones. With no ban on drones in National Forests -- at least, not yet -- filmmakers have a way to capture the immensity of these locations with stunning results.
Product Review

With outstanding image quality, the ‘basic’ Sony A7 III excels in every way

Replacing the four-year-old A7 II as the new entry-level model in Sony's full-frame line, the A7 III is an impressively capable camera that gives more expensive models a run for their money.
Social Media

Addicted to Instagram? Its new ‘activity dashboard’ is here to help

Ever get that nagging feeling you're spending too much time on Instagram? Well, a new "activity dashboard" has a bunch of features designed to help you better control how you use the addictive photo-sharing app.
Photography

Photography news: Best spot for fall photos, new firmware from Fuji and Nikon

Where's the best spot to take fall photos? Michigan, according to social media and a Nikon contest. The results and more in this week's photography news, including significant firmware updates for the Fujifilm X-T3, X-H1, and GFX 50S.