Skip to main content

Startup uses deep learning to let you shop for items by snapping photos

Computer vision and image recognition, aka the ability to show a computer a picture of something and have it tell you what it is seeing, has been befuddling researchers for years.

In the past decade, however, it has taken enormous leaps forward thanks to deep learning neural networks. These are essentially vast computational approximations of the way that the human brain works, which can learn to recognize objects and people based on training examples.

Recommended Videos

A number of companies have attempted to use this kind of technology to transform the retail space, but so far none have really succeeded. We scan QR codes when we go into a store, or type the name of a book into Amazon, but the technology that lets us snap a quick picture of, say, a chair that we like and easily search for it (or similar items) online has largely eluded us.

This is a problem a team of Cornell University researchers are trying to solve. With a new startup called GrokStyle, co-founders and computer scientists Sean Bell and Kavita Bala have developed a state-­of-­the-­art algorithm that is more accurate than any competing system at recognizing objects within a picture and then linking them to real­-world items for sale.

teaser2
Image used with permission by copyright holder

“What we’re focused on is the post­-search experience,” Bell, a computer science Ph.D., told Digital Trends. “That’s something I don’t feel has been very good so far. What we’re doing is not just recognizing a product, but finding out who else sells it, whether there are existing variations, whether you can get it in a different type of wood, etc. We’re not just trying to answer the ‘what is this?’ question about objects, but trying to answer the related questions people have in the shopping experience.”

As you can imagine, this isn’t easy ­– ­and particularly not since it does more than apps, which recognize, say, book covers and movies by letting you search for that item and that one alone.

“You may be in a restaurant and see a chandelier you like, and want to one to find one that is the same and available for sale — or similar, but in a different color or price point,” Bell said. “The idea is that you take a picture of something you like, and then based on that image, you get presented with a list of similar items. You can then filter these based on location, material, and various other metrics. It’s not just simply about either finding something or not finding it; we wanted to give you a wide variety of choice.”

Going forward, the idea is to even let users single out particular qualities of an object (say, its grain of wood or fabric) and then find other complimentary items. “Our system lets you hold certain aspects as constants, and then change other attributes,” he said.

The system the team has developed, described in the journal ACM Transactions on Graphics under the name “Learning visual similarity for product design with convolutional neural networks,” was benchmarked to be an astonishing two times as accurate as competing methods. It is hoped that users will be able to try out the system over the coming months.

“This is an exciting area, and ultimately we think it’ll come down to who has the best technology,” Bell said. “Right now we’re state of the art in terms of product image recognition. We’ve demonstrated to the academic community that our system for doing this is the most accurate. We want to continue that edge going forwards.”

Luke Dormehl
I'm a UK-based tech writer covering Cool Tech at Digital Trends. I've also written for Fast Company, Wired, the Guardian…
The Ioniq 5 is once again eligible for the $7,500 tax credit
2025 Hyundai Ioniq 5

After a brief and confusing absence, the Hyundai Ioniq 5 is once again eligible for the full $7,500 federal tax credit — and this time, it's sticking around (at least for now). So, what happened? Let’s unpack the ride.

The Ioniq 5, a sleek and tech-savvy electric crossover, initially made headlines not just for its design, but for being built at Hyundai’s brand-new Metaplant in Georgia. That domestic assembly qualified it for the EV tax credit under the Inflation Reduction Act (IRA), which requires vehicles to be made in North America with batteries sourced from trade-friendly countries. But early in 2025, the Ioniq 5 vanished from the list. Why? Likely due to its battery packs, which were then still being sourced from SK On’s Hungarian facility.

Read more
Sebastian Stan lays out Bucky’s future after Thunderbolts
Sebastian Stan in Thunderbolts.

There are some spoilers ahead for the ending of Marvel's Thunderbolts. Stop reading now if you don't want to be spoiled.

Earlier this year, Captain America: Brave New World briefly introduced a new direction for James "Bucky" Barnes, a character Sebastian Stan has been playing since 2011 in Captain America: The First Avenger. In Brave New World, the former Winter Soldier apparently retired from being a reformed hero and went into politics by running for Congress. Thunderbolts reveals that Bucky won his election to the House of Representatives. But his stay in Congress was short.

Read more
Jeep Compass EV breaks cover—but will it come to the U.S.?
jeep compass ev us newjeepcompassfirsteditionhawaii  4

Jeep just pulled the wraps off the all-new Compass EV, and while it’s an exciting leap into the electric future, there's a catch—it might not make it to the U.S. anytime soon.
This is a brand new electric version of the Jeep Compass, and being built on Stellantis' STLA platform—the same architecture underpinning models like the Peugeot E-3008 and E-5008—it looks much slicker and packs a lot more inside than previous versions of the Compass.
Let’s start with what’s cool: the new Compass EV is packing up to 404 miles of range on a single charge, a 74 kWh battery, and fast-charging that gets you from 20% to 80% in about 30 minutes. Not bad for a compact SUV with Jeep's badge on the nose.
There are two versions: a front-wheel-drive model with 213 horsepower and a beefier all-wheel-drive version with 375 horsepower. That AWD setup isn’t just for looks—it can handle 20% inclines even without front traction, and comes with extra ground clearance and better off-road angles. In short, it’s still a Jeep.
The design's been refreshed too, and inside you’ll find the kind of tech and comfort you’d expect in a modern EV—sleek, smart, and ready for both city streets and dirt trails.
But here’s the thing: even though production starts soon in Italy, Jeep hasn’t said whether the Compass EV is coming to America. And the signs aren’t promising.
Plans to build it in Canada were recently put on hold, with production now delayed until at least early 2026. Some of that might have to do with possible U.S. tariffs on Canadian and Mexican vehicles—adding a layer of uncertainty to the whole rollout.
According to Kelley Blue Book, a Stellantis spokesperson confirmed that the company has “temporarily paused work on the next-generation Jeep Compass, including activities at” the Canadian plant that was originally meant to build the model. They added that Stellantis is “reassessing its product strategy in North America” to better match customer needs and demand for different powertrain options.
So while Europe and other markets are gearing up to get the Compass EV soon, American drivers might be left waiting—or miss out entirely.
That’s a shame, because on paper, this electric Jeep hits a lot of sweet spots. Let’s just hope it finds a way over here.

Read more