Skip to main content

Which A.I assistant is smarter than the others? One company found the answer

Loup Ventures tests smart speakers and digital assistants each year to get a sense of their practical uses and to see who gets the highest score. This year’s tests are complete and the results are in. Once again, Google Assistant had the highest score, followed by, in order from highest to lowest, Siri, Alexa, and Cortana.

The test consists of 800 questions in five categories: Local knowledge, commerce, navigation, information, and commands. Each smart speaker has two scores: The number of questions correctly understood and the number of correct responses.

Recommended Videos

The table below summarizes this year’s test results for smart speakers. Loup Ventures differentiates between testing digital assistants on smart speakers and on smartphones. Google Assistant on Android phones and Siri on iPhones might have different relative scores than the same assistants on smart speakers.

Smart Speaker,
Voice Assistant
Answered Correctly  Understood the Question
Google Home,
Google Assistant
87.9% 100%
Apple HomePod,
Siri
74.6% 99.6%
Amazon Echo (2nd Gen),
Alexa 
72.5% 99%
Harman Kardon Invoke,
Microsoft Cortana
63.4% 99.4%

Even though Google Home understood all 800 questions in the test, the other smart speakers weren’t far behind. The HomePod only misunderstood three questions, and the Invoke and Echo misunderstood five and eight questions, respectively. Loup Ventures noted that most of the very few misunderstood questions contained proper names, such as towns or restaurants. From the perspective of understanding questions, therefore, you can safely assume these smart speakers will understand pretty much everything you ask or say to them.

The smart speakers’ scores on giving correct responses varied significantly. One area that drew the testers’ particular interest was how well the smart speakers answered questions related to commerce.

Loup Ventures noted that while “conventional wisdom suggests Alexa would dominate, Google Assistant correctly answers more questions about product information and where to buy certain items than Amazon’s Alexa, which tended to offer items to purchase.

To make the point, the testers gave the following example from the test.

  • Question: “How much would a manicure cost?”
  • Alexa: “The top search result for manicure is Beurer Electric Manicure & Pedicure Kit. It’s $59 on Amazon. Want to buy it?
  • Google Assistant: “On average, a basic manicure will cost you about $20. However, special types of manicures like acrylic, gel, shellac, and no-chip range from about $20 to $50 in price, depending on the salon.”

Loup Ventures also noted that because Apple HomePod and Google Home each have proprietary map data, their performance on questions about local topics and navigation stood “head and shoulders above the others.”

Bruce Brown
Bruce Brown Contributing Editor   As a Contributing Editor to the Auto teams at Digital Trends and TheManual.com, Bruce…
Tineco carpet cleaner at lowest-ever price for Prime Day — here’s how to save more
A man using the Tineco Carpet One Cruiser Smart Carpet Cleaner.

Not all vacuum deals will be able to provide in-depth cleaning for your carpet. You're going to need something more specialized, and we highly recommend the Tineco Carpet One Cruiser. From its original price of $699, it's available from Amazon's Prime Day for its lowest-ever price of $489, but you can get an additional 5% off with the checkout code TIN25PDPR. That means you'll only have to pay $465 for this smart carpet cleaner, for total savings of $234, but you'll need to act fast as we're not sure if the stocks that are up for sale will last until the final minutes of the shopping holiday.

BUY NOW

Read more
Tineco vacuum nearly $300 off for Prime Day — use this code for extra savings
The Tineco Floor One Stretch S6 cordless vacuum cleaner cleaning a spill.

In one of the most attractive vacuum deals that you can shop for Prime Day, Amazon has slashed the Tineco Floor One Stretch S6 to its lowest-ever price of $319 from its sticker price of $599. However, we've got a code for you to be able to get the cordless wet-dry vacuum cleaner with an extra 5% off — just enter TIN25PDPR during the checkout process so that you'll only have to pay $303, for total savings of $296. That's an excellent offer that you wouldn't want to miss, and you better hurry if you want to take advantage of it as it may not remain available until the end of the shopping holiday.

$303 at Amazon

Read more
Tineco’s docking vacuum has a special Prime Day price, but you can get it cheaper
A Tineco Pure One next to its charging base.

Vacuums feel like they're getting more and more expensive, and not just robot vacuum and mop combos, but ordinary hand vacs. You can go to Walmart and see bagged, corded vacuums that cost hundreds of dollars. It doesn't have to be that way. Tineco's Pure One vacuum brings power and convenience for the same price that other vacuums have, but with new features instead of going backwards into the world of cords and bags. Usually $459, it is down to $319 for Prime Day (that's a savings of $140 already) and we're happy to report you can get an extra 5% off with the code TIN25PDPR on Amazon. Tap the button below to see the vacuum yourself and snag this great deal, or keep reading for what makes this vacuum truly unique.

BUY NOW

Read more