How many calories are in that sundae? Google will tell you with the snap of a picture

Handpick food porn
Shutterstock / Joshua Resnick
For many people, counting calories is an exercise in futility. Studies show that most people underestimate the calories in food, and that’s obviously problematic if you’re looking to shed a few pounds. Luckily, Google is working on an “automatic food diary,” Popular Science reports. Google is tapping the artificial intelligence researchers it acquired when it bought DeepMind for $400 million to develop an system that can measure the calories in food from pictures.

“If it only works 30 percent of the time, it’s enough that people will start using it.”

The system, called Im2Calories, uses a combination of image recognition and comparative analysis to identify meals from average-definition photos. As Google research scientist Kevin Murphy demonstrated at this week’s Rework Deep Learning Summit in Boston, the system determines the depth of each pixel in an image, matches the results to a vast database of nutritional information, and then takes into account portions by gauging the size of the food relative to the plate it’s on. In one test, Murphy said, Im2Calories was able to calculate the accurate caloric total of two eggs, two pancakes, three strips of bacon, and the accompanying condiments.

Im2Calories isn’t perfect, though. It currently includes a dropdown menu for users to select the correct food when it misidentifies something, which happens somewhat frequently right now. However, Murphy told Popular Science that complete accuracy is at this point unrealistic.

“Ok fine, maybe we get the calories off by 20 percent. It doesn’t matter. We’re going to average over a week or a month or a year,” he said. Recognition can only improve as the body of data grows, he said. “If it only works 30 percent of the time, it’s enough that people will start using it, we’ll collect data, and it’ll get better over time.”

Of course, that’s only true if the nutrition labels themselves are correct. The New York Times reports that the current system of measuring calories — burning food to see how much energy it contains, a method developed in the 19th century — doesn’t take into account digestion. The body expends more energy to break down high-protein foods like meat and yogurt, and some foods aren’t digested at all. The labels on nuts are probably the most misleading — according to some researchers, they’re likely 25 percent too high.

“If we can do this for food, that’s just the killer app.”

And that’s to say nothing of the controversy around the practice of calorie tabulating in the first place. A 2011 Harvard University study published in the New England Journal of Medicine found that the makeup of food was a far bigger determinant of health than its caloric value.

“This study shows that conventional wisdom — to eat everything in moderation, eat fewer calories and avoid fatty foods — isn’t the best approach,” Dr. Dariush Mozaffarian, a cardiologist and epidemiologist at the Harvard School of Public Health and lead author of the study, told the New York Times in an interview. “What you eat makes quite a difference. Just counting calories won’t matter much unless you look at the kinds of calories you’re eating.”

Perhaps that’s why Murphy floated the idea of applying the mechanics behind Im2Calories — automated object recognition — to other fields. “If we can do this for food, that’s just the killer app,” he said. “We can do things like traffic scene analysis, predict where the most likely parking spot is. And since this is all learned from data, the technology is the same, you just change the data.”

Murphy wasn’t forthcoming about a release timetable for Im2Calories, or with details of the form it could take. Those details are likely months to years from being hashed out, but when Im2Calories does launch publicly, prepare to feel a lot guiltier about your sugary indulgences.

Emerging Tech

Here’s how Facebook taught its Portal A.I. to think like a Hollywood filmmaker

When Facebook introduced its Portal screen-enhanced smart speakers, it wanted to find a way to make video chat as intimate as sitting down for a conversation with a friend. Here's how it did it.

Researchers teach self-driving cars to predict pedestrians’ next moves

University of Michigan researchers are developing a system that teaches self-driving cars to predict pedestrian movement. Humans don't always act in their own best self-interest, so autonomous cars will need to practice protective driving.
Movies & TV

The best shows on Netflix, from 'Haunting of Hill House’ to ‘Norsemen’

Looking for a new show to binge? Lucky for you, we've curated a list of the best shows on Netflix, whether you're a fan of outlandish anime, dramatic period pieces, or shows that leave you questioning what lies beyond.
Product Review

The Oaxis Timepiece is minimalist in style, maximalist in frustration.

The Oaxis Timepiece wants to be a traditional watch, a fitness tracker, and a basic smartwatch all-in-one. That’s a tall order, despite it sounding quite simple, so can the sub-$180 wearable manage to pull it off?

Olympus packs an enormous zoom ability in its latest interchangeable lens

The Olympus Digital ED M.Zuiko 12-200mm F/3.5-6.3 has the widest zoom range of any interchangeable lens with a 16.6x zoom. The lens, which covers a 24-400mm equivalent, is also weather sealed.

Nikon brings a classic workhorse lens to the Z series with new 24-70mm f/2.8 S

The Nikon Z series finally has a bright zoom available without an adapter. The Nikkor Z 24-70mm F/2.8 S offers new coatings and more customizable controls in a smaller, lighter body than the comparable F-mount lens.
Product Review

Canon democratizes full-frame with the EOS RP, but keep your expectations low

At just $1,300, the RP is Canon's least expensive full-frame camera yet, but it was born into a world of high-end, high-cost lenses where it doesn't yet feel at home.

Nikon will bring eye-detection autofocus to the Z6 and Z7 in May

An upcoming firmware update will bring Eye AF to the Nikon Z6 and Z7 -- along with improved autofocus performance in low light. The update will also give the cameras support for the CFexpress format.

Fujifilm’s X-T30 is a semi-pro, feature-rich camera that’s affordable to boot

Fujifilm's newest mirrorless camera delivers the premium features of the X-T3 without the premium price, giving aspiring enthusiasts a lower-cost option that can still match the image quality of Fuji's flagship.

Fujifilm XP140 squeezes more durability, low-light ability into a waterproof cam

Fujifilm's waterproof compact can now head even further underwater. The Fujifilm XP140 features several upgrades, including a more durable body, a wider ISO range for low light, and expanded auto modes.

From f/1.2 primes to the mysterious DS, here are Canon’s upcoming RF lenses

Canon's EOS R mirrorless series will gain six new lenses this year. Canon just shared a list of six lenses under development, including four zooms and two prime lenses. One has a mysterious new feature called Defocus Smoothing.

From DSLRs to mirrorless, these are the best cameras you can buy right now

From entry-level models to full-frame flagships, many cameras take great photos and video. The best digital cameras, however, push the industry forward with innovative sensors and improved usability, among other things. Here are our…

OnePlus 6T vs. Honor View 20: We compare the cameras in these ‘flagship killers’

For less than $600, you can buy either the OnePlus 6T or the Honor View 20, two extremely capable smartphones with plenty of exciting features. But which one has the best camera? We found out on a recent trip to France.

Photography news: Wacom’s slimmer pen, Leica’s cinema special edition

In this week's photography news, Wacom launches a new slimmer pen for pro users. Leica's upcoming M10-P is designed for cinema, inside and out, with built-in cinema modes in the updated software.