How we test receivers

how we test receivers av recievers

Of all the A/V gear we test and review, none is as involved or time consuming as the A/V receiver. All those bells and whistles that get crammed into a single box of audio/video awesomeness need to be tested for functionality and ease of use. Then there’s the obvious concern of sound quality, the testing of which can involve some pretty time intensive cable swapping. It’s a complicated job, but we love every minute of it.

While you can have a listen to a receiver and possibly even play around with its remote on the showroom floor of an electronics store, it is nearly impossible to get a real feel for how intuitive its interface is. Our goal with receiver reviews is to give you an insider’s look at what owning one of these wünder-boxes will be like and what kind of sound quality you can expect from it. Read on for our account of how we go about testing A/V receivers, stereo receivers and integrated amps.

If you’d like an idea of what receivers we like and why check out our picks for the best A/V receivers.

Out of the box

While un-boxing a receiver doesn’t involve much in the way of fanfare and confetti (unless you count those damn packing peanuts), there’s still something about it that gets our blood pumping every time. Maybe it’s that “new receiver smell”. Regardless, there’s a lot to be gleaned upon cracking open the box and we’re sure to have our notepad handy every time. Here, we’re able to gather some impressions on build quality as we get a glimpse at the receiver’s chassis and experience its weight as we pull it free from its Styrofoam cocoon. If we look closely, we can usually take a gander at the unit’s power supply, often a foreshadowing of how well the receiver will sound when put under heavy stress.

While we’re at it, we will catalog all the receiver’s accessories and cross check the list against what the manufacturer claims should be in the box. You’d be surprised at how many review units show up missing remotes, power cables and calibration microphones.

The hookup and setup

Though we’ve taken measures at our testing lab to make hooking up a receiver as easy as possible, it still takes a while to transfer the four HDMI cables, 14 speaker wires and 11 RCA cables involved in our home theater system from our reference receiver to the review unit.

harman-kardon-avr-3700-review-back-audio-ports-1500x991

With cables and wires in place, we move on to receiver setup. Since this is a process that many people less experienced than ourselves will have to go through, we consider it especially important that things go smoothly. We look for an intuitive graphic user interface (GUI) which usually consists of a series of menu screens that users have to navigate in and out of.

Setup involves inputting speaker distances, crossover points and adjusting channel levels. For this we use a good-ole Stanley tape measure and an analog decibel meter.

We do not run any auto-calibration routines until the end of our evaluation. More on this later.

The test bench

The idea behind having a test bench is that all the equipment in the system chain remains the same, save the piece that is being tested. This way, we have an easier time hearing the changes that the review piece brings to the system. Our reference system is presently comprised of a Marantz SR6005 A/V receiver, Anthem 225 Integrated amp, Oppo BDP-95 Universal Audiophile Blu-ray player, Aperion Audio Verus Grand speakers (for 2-channel testing) Aperion Audio 633 Concert HD 7-channel speaker system, Aperion Bravus 12” subwoofer and Aperion Bravus 8a subwoofer.

The audition

After all the heaving and wiring, finally sitting down to have a listen to the gear we’ve been setting up is a welcome treat.

We mentioned earlier that we favor a manual setup over any automated setup and calibration routines for the bulk of our reviews. We do this because, in our experience, these processes end up making EQ settings that are to the detriment of our system’s sound quality. The one exception we’ve experienced was with one particular manufacturer’s product, which made alterations to the subwoofer signal that ended up improving bass response a bit. Otherwise, we’ve noted many wrongly set speaker sizes, crossover points and some seriously funky EQ settings made in attempt to compensate for our room’s limitations (which we’ve taken physical measures to deal with already). Eventually, we will run the setup routine to see how it performs but we are rarely surprised by the results.

We start our listening tests with 2-channel stereo music. This allows the receiver to show us the best it has to offer in terms of amplification. While many manufacturers claim that their amps deliver equal power to all channels, we’ve seen several where that was not the case at all. With a multi-channel A/V receiver, the stereo and direct modes ensure that as much power is being delivered to the front left and right speakers as possible.

During this stereo listening session, we listen to music tracks that we know inside and out, backward and forward. Some of the music we use was even recorded, mixed and mastered by us, which gives us the best possible insight into how the reproduced track should sound. We take copious notes on how the receiver drives the Aperion Verus Grand speakers (which we are extremely familiar with) at both moderate and high volumes.

how-we-test-av-receivers

While in 2-channel testing mode, we’ll also switch back and forth between a digital input (usually HDMI) and an analog input fed by the Oppo BDP-95’s stellar two-channel output. The idea here is to rank the receiver’s built-in DAC (digital to analog converter) against a reference DAC with which we are very familiar. The closer the receiver’s built-in DAC gets to the superior DAC built into the Oppo, the better.

After our 2-channel testing we’ll move on to multi-channel music, primarily provided on SACD and DVD-Audio discs, though we do have some good multi-channel material on DTS Blu-ray discs as well. This puts the receiver under much greater strain as it will have to feed 5 to 7 speakers with sound simultaneously and for prolonged periods of time. We are able to best scrutinize the receiver’s capability to reproduce sound accurately through multiple channels with music because it is much easier to critique the way the receiver supports the reproduction of a musical instrument than it is to analyze how well it made an explosion or thundering helicopter sound.

Finally, we’ll move on to Blu-ray movies. Here, we listen to how well the receiver steers effects amongst channels to create a seamless 360 degree sound field. We’ll also listen for any breakup or distortion during highly explosive scenes as we push the receiver to extremely high volumes. We also use this time to check out the receiver’s video processing by comparing its processed video output to the output coming directly from our Blu-ray player.

Testing features

Testing a receiver’s various features is the most exhausting part of the process. There’s just so many and, since several of them rely on a LAN or wireless network, equipment outside of the receiver itself threatens to muck the process up (and it has…many times).

The network-reliant features usually include Apple AirPlay, DLNA delivery of photos, music and videos from a networked computer or storage device, Internet radio access and Internet music apps such as Pandora, Spotify and Rhapsody. First, we test each feature for ease of access and to verify that they function well. Then, we will engage and evaluate any built-in audio enhancer that is meant to improve the sound of low bitrate media. Finally, we take notes on how easy it is to access these features and how clearly designed the menu is for each of them.

The rest of the features tested are usually proprietary in nature and, frankly, too numerous and random to list here. Suffice it to say that we do spend time with as many of them as we can. Anything notable will be reported on.

Writing the review

For us, simply organizing our evaluation notes into something that resembles a narrative is not good enough. We aim to give a little back-story on the manufacturer, describe our experience with the receiver and put its audio performance and user-experience into a context that is understandable, even for those not as technically inclined. We hope that by reading our receiver reviews, you will walk away with a feel for whether that particular model is something you should bother to audition yourself or remove from your short list because, ultimately, a personal audition is absolutely essential.

Home Theater

TCL drops the price of its 75-inch 6-Series 4K Roku TV to $1,500

March is a great time for TV deals, and we've got a whopper: TCL has taken $300 off the price of its superb 75-inch 6-Series 4K HDR Roku TV, making it $1,500. That's the lowest price ever on this affordable TV.
Music

The best new music this week: Jenny Lewis, American Football, and much more

Looking for the best new music? Each week, we find the most compelling new releases just for you. This week, we have new music from Jenny Lewis, Andrew Bird, American Football, Avey Tare, Christian Scott aTunde Adjuah, and more.
Home Theater

Hulu vs. Amazon Prime Video: Which streaming service is best for you?

It's hard to dispute Netflix's leadership in on-demand streaming video, it's not alone. Two great alternatives are Amazon Prime Video and Hulu; each with its strengths and weaknesses. Which one is better? We pick the winner.
Gaming

Xbox One X vs. PS4 Pro: Which console is more powerful?

Far from cooling down, the console wars are only getting more intense. We compare Microsoft's Xbox One X to Sony's PlayStation 4 Pro to help you decide which premium console is right for you.
Deals

Building a 4K home theater? Grab a discounted Denon A/V receiver from Amazon

Denon makes some of the best 4K A/V receivers on the market, and a handful of Denon’s latest models are on sale on Amazon now. If you’ve been thinking about building a home theater and are looking for a 4K receiver that doesn’t cost…
Movies & TV

Comcast launches Xfinity Flex, a $5-a-month service aimed at cord cutters

For $5 a month, Xfinity Flex gives existing Xfinity internet subscribers a 4K- and HDR-ready set-top box that can stream video from YouTube, Netflix, Hulu, as well as free TV from apps like Cheddar and ESPN3.
Home Theater

Here’s how to watch Apple’s March 25 product reveal event live

It's almost here: Apple's much anticipated March 25 event, where it is widely expected to announce several streaming services, including on-demand and live TV with original programming. Here's how to watch it live.
Movies & TV

HBO’s Deadwood movie rustles up a trailer and a release date

This spring, HBO's long-awaited Deadwood movie will explore what happened 10 years after the events of HBO's award-winning drama, giving the series a finale 13 years after the show was canceled.
Movies & TV

Apple’s next big event is set for March 25: Here’s what you can expect

Apple's next big event takes place on March 25 in Cupertino, California. The company is expected to make several announcements related to its services, including Apple TV, so follow our guide to get ready for the big event.
Home Theater

Kanopy privacy breach reveals which movies members have been streaming

Free video streaming site, Kanopy, has been inadvertently publishing millions of lines of web log data for days, according to a new security report. A bad actor could guess a person's identity and see what they've been watching.
Home Theater

March Madness deal alert: Get a 43-inch LG 4K HDR TV for just $270

March is a great time to find a deal on a new TV, and this one is worth every penny: Walmart is selling LG's 43-inch 43UK6300PUE, a very capable 4K HDR Smart TV, for almost 50 percent off the regular price, at $270.
Home Theater

How to connect your Roku device to your hotel room’s TV

Staying at a hotel, but can't bear to be parted from your favorite streaming shows and movies? Take them with you with our complete guide to using your Roku on the road when staying at a hotel.
Product Review

Audio-Technica's M50xBT headphones bring signature studio sound to the streets

Audio pros may balk at cutting the cord on studio headphones, but it’s hard to argue with these results. Audio-Technica’s wireless ATH-M50xBT offer massive battery life and killer sound you can take anywhere.
News

Apple’s Beats to reportedly release truly wireless PowerBeats earphones in April

Beats will reportedly release a truly wireless PowerBeats earphones next month, following the announcement of Apple's new AirPods. The second-generation AirPods received the new H1 chip, which is also expected to power the new PowerBeats.