Nielsen NetRatings Opens to MRC Audit

It’s no secret that the advertising industry is driven by numbers and statistics: page impressions, viewership, size of audience, readership estimates, circulation, numbers of viewers, ROI, CPM, and a passel of other acronyms, metrics, and confusing numbers. While we in the technology industry are used to citing and tossing off many statistics about how many people use particular technologies, play particular games, or own particular devices, the fact is that the numbers cited in the vast majority of market research reports are, at best, well-informed guesses. You’ve probably heard the aphorism, "There’s lies, damn lies, and statistics" used as a quick way to sum up the persuasive power of a little numerical analysis to bolster an argument…even when the numbers and the analysis are often quite questionable? Add to that the pressure-cooker environment of ad sales, tight deadlines, and careers hanging in the balance, and you’ll often find hand-waving, smoke, and mirrors passed off as cold hard facts.

Measuring online audiences is also a pretty hazy thing: unless you can somehow force every Internet user to register with your site, magically force them not to share their accounts, and somehow truthfully profile them for key demographic information like their age, income, and geographic location, you’re never going to have a 100 percent accurate idea of who uses your site. For firms which purport to meaure audience share of, say, search engines or video sharing services, the task is even more daunting because its spread across millions of users and thousands of high traffic sites. The firms attempt to take accurate snapshots of Internet usage by profiling a small subset of users, and generalizing those results to the larger Internet population. That methodology can work if your sample size is large enough and sufficiently random—but, on the Internet, there’s essentially no way to know whether your sample is big enough or random enough, and there are innumerable invisible factors which might make your samples biased and, therefore, unrepresentative.

Last month, Internet Advertising Bureau president and CEO Randall Rothenberg decided to call two of the largest online media metrics firms—Nielsen NetRatings and comScore Media Metrics—to the carpet—the two firms’ numbers have never lined up very well, and neither jive with the server logs maintained by the IAB’s members. In an open letter, Rothenberg demanded that the firms reveal the methodologies behind their Internet audience metrics, and essentially prove that the numbers they’re publishing for Internet audiences—upon which increasing billions of advertising dollars are being spend—are accurate.

"To persist in using panels that potentially undercount or ignore the diverse populations that are the future of consumer marketing is to deny marketers the insights they need to build their businesses," wrote Rothenberg. "And it certainly appears to us as if these audiences are being undercounted or disregarded."

Historically, audience measurement and survey firms (particularly Nielsen) have been notoriously close-lipped about their methodologies.

In response, Nielsen NetRatings has announced it will submit its Internet audience measurement to the Media Rating Council‘s accredidation process (PDF). "The MRC process is the only audit that certifies to clients and to the industry that we have fully disclosed our methodology and that we are executing against that methodology," said Manish Bhatia, NetRatings’ executive VP. "We are confident that NetRatings’ methods will stand up to review and we are pleased to be supporting transparency and accountability in the industry."

Under the plan, Nielsen will submit its desktop meter—software its panelists use which logs Web usage—and its page-tagging technology for review by the MRC, an industry group set up in the 1960s and charged with setting minimum standards for audience measurement and ratings for broadcast media.

For its part, comScore has defended the integrity of its numbers, and has even published analyses highlighting possible causes of discrepancies between sites’ server logs and measured audiences; in particular, comScore notes "cookie deletion" may case sites to significantly overestimate their audience.

See? "Lies, damned lies, and statistics." In an tangential, ironic illustration of how misleading things can be even if they’re peripheral to statistics: that quote above is often mis-attributed to Mark Twain, but Twain himself said it came from Benjamin Disraeli.

Smart Home

Lenovo’s pint-sized smart alarm clock is set to ship next month

Lenovo opened up pre-orders for its Smart Clock, which it debuted at CES 2019, and announced that it will begin shipping to customers on June 2. The compact bedside companion is retailing for $79.

Best Buy Memorial Day sale: Dyson vacuums, Keurig coffee makers, and more

Best Buy's Memorial Day sale is focusing the majority of its deals on appliances. Washers, dryers, refrigerators, vacuums, and coffee makers are all receiving some pretty substantial price cuts.
Smart Home

Amazon chops the price for customer favorite Hamilton Beach 2-way coffee brewer

Do you sometimes want just a single cup of coffee without making a whole pot but other times use a full carafe? Have it both ways with the Amazon's Choice Hamilton Beach 2-Way Brewer. For today only, Amazon cut the price by $53.

Best Memorial Day smart mattress sales from Sleep Number, Beautyrest, and more

Memorial Day is one of the best holidays when it comes to online sales. If you're looking for a new mattress, a smart mattress may be right for you. Check out some of the best Memorial Day smart mattress sales of the year to take your smart…
Smart Home

Amazon Memorial Day sale: $210 off Arlo Pro wireless security camera kit

Weatherproof and wireless, the Arlo Pro security camera gives you the freedom to monitor any area or room inside or outside your home. Amazon dropped the price of the Arlo Pro HD security camera kit that includes everything you need.
Smart Home

Amazon Memorial Day deal drops price of August Smart Lock for homes to just $99

Smart lock are a strong start to any smart home security system. Now, in Amazon’s Memorial Day deal, score an August Smart Lock for the low price of just $99, down from $150. Lock in this deal now and start your summer off smart.
Smart Home

Walmart offers sweet deals on Owlet Smart Sock 2 baby monitor

Parenting is an amazing experience, but wondering how newborns and infants are at night can be nerve-wracking. Baby monitors can ease some of the stress by letting you check on the baby without entering the room.
Smart Home

Before you sell your Google Home Mini, here's how to factory reset it

If you’re thinking about swapping out Google's entry-level smart speaker, you can get a few bucks in cash or trade-in value out of your device. You’ll need to wipe your device first though. Here's how to factory reset a Google Home…

The best Amazon Prime Day 2019 deals: Everything you need to know

Amazon Prime Day 2019 is still a few months off, but it's never too early to start preparing. We've been taking a look at the best discounts from previous Prime Days to give you our predictions of what to expect this year.

Amazon slashes prices on Nest and Ecobee smart thermostats for Memorial Day

If you’re tired of constantly adjusting your thermostat and you want a smarter (not to mention more eco-friendly) way to keep cool this spring and summer, then these Nest and Ecobee smart thermostat deals are just what the doctor ordered.

Walmart Memorial Day sale: 4K TVs, laptops, and Apple iPads get price cuts

The Walmart Memorial Day sale has begun. With some pretty nice savings on Apple iPads, Samsung and Vizio 4K TVs, laptops, and Google Home devices, now is a great time to snag some electronics for cheap.

Best Memorial Day sales 2019: Walmart, Amazon, and Best Buy drop discounts

If you're looking to save big on some shiny new stuff for Memorial Day 2019, we've gathered everything you need to know into one place. Find out where to save the most money before the summer hits its stride.
Smart Home

The best stand mixers of 2019, including models at every price range

Making dough is hard work, but the right stand mixer can make free up some time (and your hands). Here are our current favorites, from the likes of KitchenAid, Sunbeam, and several other manufacturers.
Smart Home

Amazon slices the price on Instant Pot DUO Plus 60 for this Memorial Day sale

Amazon dropped the price on the Instant Pot DUO Plus 60 6-quart, 9-in-1 multi-use cooker for this year's Memorial Day Sale. The right size for 4-to-6 people, the 6-quart DUO Plus 60 is a pressure cooker, slow cooker, rice cooker, and more.