Nielsen NetRatings Opens to MRC Audit

It’s no secret that the advertising industry is driven by numbers and statistics: page impressions, viewership, size of audience, readership estimates, circulation, numbers of viewers, ROI, CPM, and a passel of other acronyms, metrics, and confusing numbers. While we in the technology industry are used to citing and tossing off many statistics about how many people use particular technologies, play particular games, or own particular devices, the fact is that the numbers cited in the vast majority of market research reports are, at best, well-informed guesses. You’ve probably heard the aphorism, "There’s lies, damn lies, and statistics" used as a quick way to sum up the persuasive power of a little numerical analysis to bolster an argument…even when the numbers and the analysis are often quite questionable? Add to that the pressure-cooker environment of ad sales, tight deadlines, and careers hanging in the balance, and you’ll often find hand-waving, smoke, and mirrors passed off as cold hard facts.

Measuring online audiences is also a pretty hazy thing: unless you can somehow force every Internet user to register with your site, magically force them not to share their accounts, and somehow truthfully profile them for key demographic information like their age, income, and geographic location, you’re never going to have a 100 percent accurate idea of who uses your site. For firms which purport to meaure audience share of, say, search engines or video sharing services, the task is even more daunting because its spread across millions of users and thousands of high traffic sites. The firms attempt to take accurate snapshots of Internet usage by profiling a small subset of users, and generalizing those results to the larger Internet population. That methodology can work if your sample size is large enough and sufficiently random—but, on the Internet, there’s essentially no way to know whether your sample is big enough or random enough, and there are innumerable invisible factors which might make your samples biased and, therefore, unrepresentative.

Last month, Internet Advertising Bureau president and CEO Randall Rothenberg decided to call two of the largest online media metrics firms—Nielsen NetRatings and comScore Media Metrics—to the carpet—the two firms’ numbers have never lined up very well, and neither jive with the server logs maintained by the IAB’s members. In an open letter, Rothenberg demanded that the firms reveal the methodologies behind their Internet audience metrics, and essentially prove that the numbers they’re publishing for Internet audiences—upon which increasing billions of advertising dollars are being spend—are accurate.

"To persist in using panels that potentially undercount or ignore the diverse populations that are the future of consumer marketing is to deny marketers the insights they need to build their businesses," wrote Rothenberg. "And it certainly appears to us as if these audiences are being undercounted or disregarded."

Historically, audience measurement and survey firms (particularly Nielsen) have been notoriously close-lipped about their methodologies.

In response, Nielsen NetRatings has announced it will submit its Internet audience measurement to the Media Rating Council‘s accredidation process (PDF). "The MRC process is the only audit that certifies to clients and to the industry that we have fully disclosed our methodology and that we are executing against that methodology," said Manish Bhatia, NetRatings’ executive VP. "We are confident that NetRatings’ methods will stand up to review and we are pleased to be supporting transparency and accountability in the industry."

Under the plan, Nielsen will submit its desktop meter—software its panelists use which logs Web usage—and its page-tagging technology for review by the MRC, an industry group set up in the 1960s and charged with setting minimum standards for audience measurement and ratings for broadcast media.

For its part, comScore has defended the integrity of its numbers, and has even published analyses highlighting possible causes of discrepancies between sites’ server logs and measured audiences; in particular, comScore notes "cookie deletion" may case sites to significantly overestimate their audience.

See? "Lies, damned lies, and statistics." In an tangential, ironic illustration of how misleading things can be even if they’re peripheral to statistics: that quote above is often mis-attributed to Mark Twain, but Twain himself said it came from Benjamin Disraeli.

News

LG’s SnowWhite is a Keurig for lovers of homemade ice cream

LG's SnowWhite conceptual countertop appliance, on display at this year's South by Southwest, is like a Keurig machine for ice cream lovers that produces your favorite frozen desserts from nothing but a little pod.
Deals

Make some time for the best smartwatch deals for March 2019

Smartwatches make your life easier by sending alerts right on your wrist. Many also provide fitness-tracking features. So if you're ready to take the plunge into wearables and want to save money, read on for the best smartwatch deals.
Gaming

The best of the last generation: Our 50 favorite Xbox 360 games

The Xbox 360 thrived during a generation where games were plentiful. Here's our list of the best Xbox 360 games of all time, including all game genres and even a few special indie hits.
Home Theater

The best Dolby Atmos movies for your home theater sound as good as they look

If you've got your hands on some sweet Dolby Atmos gear, the next step is to find films that take advantage of it. These are our picks in several genres for the best Dolby Atmos movies currently available on Blu-ray and streaming services.
Deals

Amazon shaves $50 off the Coway Mighty air purifier ahead of allergy season

When it's allergy season, a good air purifier is a must-have for sufferers. The Coway Mighty air purifier (now on sale from Amazon) is one of the best, greatly improving the air quality inside your home by removing dust, dander, pollen, and…
Smart Home

Dyson’s newest products strive to keep your home cool, clean, and well-lit

Dyson launched products to keep your home cool, clean, and well-lit. A Dyson intelligent task light cycles with nature and a personal air purifier harnesses unique airflow. Microprocessors in Dyson's vacuum self-adjust 8,000 times a second.
Smart Home

Walmart serves up a rare deal on the Google Home Max at $100 off

Some deals are predictable and others are pre-announced, but today Walmart posted a rare deal: $100 off the powerful Google Home Max. Since it rarely goes on sale, waiting may not be prudent. If you want one, grab it.
Smart Home

Smart light switches have become more affordable: Here are the best ones

The ability to control the lighting in your home can have a big effect on your living space. To have more control over your lighting, check out the best smart light switches on the market. 
Smart Home

Update your kitchen with the best refrigerators you can buy in 2019

There are tons of factors that go into buying a fridge, from size and capacity to color. It takes lots of testing and research, but we've chosen the best refrigerators to get you started, regardless of what you're looking for.
Smart Home

The best smart locks to increase your home security in 2019

A good smart lock should offer a combination of security and convenience. Fortunately, these devices keep your home protected, your family safe, and your belongings secure from possible intruders.
Deals

Suck up the savings with these vacuum cleaners on sale for $100 or less

Keeping your floors clean around the home is a constant chore. To help make things a whole lot easier, we've picked out some great vacuum cleaner deals available right now, from full-sized upright models to robot vacs.
Smart Home

Is your coffee maker hiding mold inside? Here's how to clean it

Are you a coffee drinker? If you brew your coffee at home and you don't clean your machine, you could be drinking mold, yeast, and other bacteria. Here's how to clean your coffee maker.
Deals

Walmart drops prices on Google Home Hub and Lenovo smart displays

Walmart slashed the prices of Google Home smart displays for two highly regarded Lenovo models and the original Google Home Hub. We can't think of a better way to improve your smart home setup and these deals can help you save up to $100.
Deals

Amazon lowers Echo Dot cost and slashes price of the Dot and Smart Plug bundle

Amazon just unleashed extraordinary price cuts on third-generation Echo Dot smart speakers. The Alexa device is back in stock following the blowout sales last holiday season. The Echo Dot is the best-selling Alexa smart speaker worldwide.