Skip to main content

Shocker: Amazon reviews still can’t be trusted

A recent report by U.K. consumer watchdog Which? is yet another stark reminder that customer ratings on Amazon are not necessarily a reliable way of knowing if a product is good or not. The publication conducted a review of the e-commerce giant’s Bluetooth headphones category and discovered that nine of the 10 top products ranked based on customer ratings contained reviews of completely different products, thus artificially boosting the number of four-star and five-star reviews.

The practice is known as review merging. Among the products that were used to boost headphone ratings were umbrellas, personalized jigsaw puzzles, bowls, and jars. Bose was the only top-10 Bluetooth headphone brand that wasn’t found to be guilty of the practice.

Amazon reviews on a desktop computer, iPad, and iPhone.
Daniel Korpai/Unsplash/Digital Trends Graphic

This method for gaming Amazon’s reviews has been around for some time. Which? raised the issue in 2019, citing several other ways that Amazon sellers had been able to boost their listings, including the hijacking of Amazon customer accounts for the purpose of leaving fake reviews on their own products.

Review merging is a feature that Amazon created to allow merchants with many variations of the same product (e.g., headphones available in a variety of color options) to display a review from one variation on the pages of all variations, which makes sense. Unfortunately, the feature has been used to trick customers into buying products that would otherwise have poor ratings.

Which? shared its most recent findings with Amazon and a company spokesperson responded, saying that it proactively blocks the “majority” of abuse on the platform. “If we discover detail pages with incorrectly grouped reviews,” the spokesperson told Which? “we use these learnings to improve our prevention mechanisms. We have now taken appropriate enforcement action against the product listings and sellers in question.”

In the past, both the Federal Trade Commission (FTC) and Amazon has taken steps to go after these offenders. The FTC has levied fines, and Amazon has even booted some well-known (and well-reviewed) brands from its platform in retaliation for charges that they had used fake reviews. Amazon also pursued two companies it claimed were selling fake reviews on its site to sellers.

Digital Trends repeated  the Which? experiment on some of the top 10 Bluetooth headphone listings in the U.S., and it didn’t take long to discover that similar shenanigans are taking place. On the product page for the No. 2-ranked Bluetooth headphones, the first three reviews appear to reference the correct product, but then things take a decidedly different slant for the remaining reviews, which include references to digital photo frames, USB fans, TVs, and HDMI cables. Some of these date back as far as 2011 (several years before the first true wireless earbuds were released), suggesting they were handpicked by the seller purely for their five-star value.

In fairness, after looking at the remaining top 10 products, it turned out this was the only product which was in clear violation of Amazon’s rules. But we also noticed something strange about the products that showed up when you sort by average customer review: Every product listed was from an unknown brand, and most had fewer than 200 ratings.

The first recognizable brand in the list is Bose, which showed up in 16th place, despite having 6,500 five-star ratings.

How to avoid being scammed by fake reviews

Sellers on Amazon will do everything they can to ensure that their products get consistently high reviews because they know that’s the key to driving sales. But how can you tell when these ratings are too good to be true?

Question the brand

In the past decade, we’ve seen an explosion of brands entering the headphones market as interest in wireless cans and earbuds has increased each year. And just because a brand is unfamiliar to you doesn’t necessarily mean it makes bad products. We’ve tried cheap wireless earbuds from brands like UGreen, Tronsmart, Earfun, Tribit, and Back Bay Audio — none of which can be considered household names — and they were all very good for the price. But the less familiar the brand, the more due diligence is required on your part.

Read all of the reviews

When reading Amazon customer reviews, be wary of ultra-short ones that simply say “Great product!” or “Exactly what I was looking for.” Generally speaking, these are meaningless and won’t help you make an informed choice. Instead, look for longer reviews that go into greater detail. Any discussion of things like battery life, build quality, or comfort are good indicators that person has actually used the product. Reviews that include photos are even more likely to be legitimate.

However, no matter how many legit-looking reviews a product might have, you should google the product brand and model followed by “review” to see if anyone has published their thoughts outside of Amazon’s platform. Professionally written reviews and roundups are your best resource. Digital Trends maintains comprehensive lists for the best wireless earbuds, best wireless headphones, and best noise-canceling wireless earbuds, and they’re an excellent place to start your research. But don’t neglect YouTube, as reviewers on that platform often cover the lesser-known brands that larger publications will neglect.

Be patient

If something seems too good to be true, keep shopping. While it’s not impossible to get a great product for a crazy-low price, in general, you get what you pay for. If price is the most important factor when choosing a set of headphones (or any tech product), don’t just grab the first five-star-rated product that hits your budget. Amazon and other retailers have handy filtering tools that let you narrow your search by price, and these can reveal all of the other products that match what you’re willing to spend.

Simon Cohen
Simon Cohen covers a variety of consumer technologies, but has a special interest in audio and video products, like spatial…
Apple AirPlay 2 supports 24-bit lossless audio, but you can’t use it
An Apple AirPlay icon hovering above an Apple HomePod speaker.

Apple's wireless platform for audio and video streaming -- AirPlay -- is one of the best ways to play music from an Apple device to a wireless speaker. When at home, on a Wi-Fi network, it outperforms Bluetooth thanks to its wider bandwidth. The conventional wisdom has always been that AirPlay sets a hard limit on audio quality: iPhones and other Apple devices can only transmit lossless CD-quality audio, at 16-bit/44.1kHz, to an AirPlay-enabled speaker, leaving the technology incapable of supporting the higher-res streams now being offered by Apple Music and others.  But it seems that AirPlay can actually do 24-bit audio. Sort of.

The new second-gen HomePod, which Apple released in January, can stream lossless 24-bit/48kHz audio directly from Apple Music, using its own Wi-Fi connection to the internet. This isn't news: Apple added 24-bit lossless playback (via Apple's ALAC codec) to the first-gen HomePod and HomePod mini in 2021, along with Dolby Atmos support.

Read more
Anime we can’t wait to see in 2022
Luffy in his new pirate outfit for One Piece Film: Red key art.

The fall 2022 anime season looks to be a promising close to the year before Attack on Titan, Vinland Saga season 2, and Jujutsu Kaisen season 2 take the stage next year. That means what's left of the year should be bookended by some impressive anime premieres, as the various shows and movies that have been released this year have been quite high-profile.

And thanks to the mainstream spotlight that the genre has commanded more of in recent years, it's more accessible than it's ever been. Several of these series are just starting their TV runs, like the first anime adaptation of Chainsaw Man and the latter end of Spy x Family's debut season, but the final batch of JoJo's Bizarre Adventure: Stone Ocean episodes on Netflix and One Piece's next theatrical venture will keep fans more than eager for the rest of 2022.
Chainsaw Man

Read more
The one AirPods Pro improvement we just can’t see — yet
Apple AirPods Pro 2 inside their charging case.

There's one thing about the new Apple AirPods Pro that no review can answer. Not our AirPods 2 review. Not anyone else's. And, to me, it's that one unanswered question that matters more than any improved spec.

At the end of the day, these are AirPods Pro. They're going to be really good, and they're going to be better than the previous version. Better noise-cancellation is great. Better battery life is never a bad thing. Better Find My support is important. Better things are better across the board.

Read more