Why Intel and Nvidia controversies prove you should always wait for benchmarks

lntel announces high end xeon and core x series processors 9th gen intel spectre

Biased benchmarks are nothing new, but that doesn’t make them any less misleading.

The last couple of months have been exciting times for those looking to upgrade their PCs. SSD prices have continued to fall and both Nvidia and Intel have showcased new hardware that is more powerful than anything they’ve ever released before, especially when it comes to games. But in both the debut of the Turing-powered RTX 2000 graphics cards from Nvidia and the reveal of Intel’s 9000-series CPUs, we’ve been fed benchmark information that exaggerates the advantages of the new hardware.

Just over a month since Nvidia’s controversial claims about the performance of its RTX-series of graphics cards, the PC hardware community is once again facing problems with misleading results from tests of pre-release hardware. As we sit mired in the controversy over the paid-for test results of Intel’s Core i9-9900K CPU, it’s more important than ever to remember that waiting for third-party benchmarks is a must when it comes to making an informed purchase of new components.

After spending most of its Gamescom reveal of the RTX cards talking about a feature that wasn’t even available at launch, Nvidia suggested that its cards were several times faster than previous generations using a brand new metric: RTX OPS. It responded to criticism about a lack of traditional gaming numbers with another skewed table of results which again heavily favored its new hardware.

intel nvidia pre ordering bad rtx2080results
Nvidia’s own comparison results were skewed by a focus on DLSS.

When we finally got our hands on the cards we found them to be very capable and certainly more powerful than their predecessors, but not quite like what Nvidia claimed. Indeed Pascal hardware remains competitive on both price and performance even today, when the RTX 2080 and 2080 Ti cards are very much available for those who want them.

Intel’s new CPU lineup was similarly marred by iffy benchmark results. In its keynote presentation, Intel showed off results published by a company that it paid to test its new chips. The flagship of the consumer range, the 9900K with its eight cores and 5GHz clock speed, was shown to dominate both the 8700K from the last-generation of Intel chips and the top-tier AMD consumer CPU, the 2700X. But there were discrepancies in the results and the test conditions that achieved them.

Principle Technologies, the company that performed the testing, has since admitted that it made a mistake using inferior cooling on the AMD CPUs it benchmarked and that it erroneously used a setting in the Ryzen Master overclocking software that disabled half the cores on the Ryzen 2700X. Media and consumers have also highlighted a number of other concerns with the benchmarking methodology, and Principled Technologies has responded by pledging to redo the tests with those concerns in mind.

Intel is standing by the results, claiming that they are “consistent with what we have seen in our labs,” but because of the NDA that prevents other independent media from reporting on the results, there’s no way to refute such claims until the chips are on sale.

Misleading results like those generated by both Nvidia and Intel lead to headlines and help push pre-orders of hardware that are entirely unproven in real-world settings in the rigs of real gamers. You could argue that it’s putting new hardware’s best foot forward, but equally so, it could be seen as deliberately misleading. Don’t forget: Companies like Intel and Nvidia will always want to push people to buy the next generation of hardware, even when the previous generation might still be the better option for some people.

That’s exactly why pre-ordering hardware is such a bad idea. You don’t really know what you’re buying. Always wait for the benchmarks, as otherwise all you’re doing is rewarding companies for great media spin, not great hardware.


'World's best gaming processor'? We put Intel's new i9 through the ringer

Intel has launched the first Core i9 for the average gamer. Despite some controversies around its release, it’s the fastest gaming processor we’ve yet tested.

Is the Surface Pro 6 a sidestep, or does it blow away its predecessor?

How good is the new Surface Pro, and is it worth an upgrade? The best way to find out is to pit the Surface Pro 6 vs. Surface Pro 5 in a head to head that tests them both on performance, design, and portability.

Updated Intel processor benchmarks still beat AMD Ryzen competitor, but by less

After some controversy, updated Principled Technologies testing shows the Intel i9-9900K with a reduced lead over the AMD Ryzen 2700X in benchmarks, and with the AMD Ryzen 2700 X seeing better performance. 

Nvidia is slowly rolling out its next generation of GPUs. Here's what you need to know about them

Nvidia's new RTX 2000 series graphics cards are impressive pieces of hardware, with some amazing advancements and some rather high price tags to match. Here's everything you need to know about Nvidia's new top-tier cards.

Consider an extended warranty plan if you buy a Surface Pro 6

Though Microsoft offers a standard one-year warranty on the Surface Pro 6, consumers may want to purchase an extended warranty plan if they intend on keeping their tablet longer due to the device's low repairability score.
Product Review

Samsung’s Galaxy Book 2 is a Surface Pro alternative with one big advantage

The 2-in-1 form factor is clearly a big deciding factor for anyone looking to buy a new device, which is why Samsung is again getting in the action this year with the new Galaxy Book 2.

Google Chrome 70 is finally getting a picture-in-picture mode

Picture-in-picture mode is finally coming to Google Chrome 70 on Mac, Linux, and Windows. The feature not only applies to YouTube but also any other website where developers have chosen to implement it.

Samsung Chromebook Plus V2 vs. Google Pixelbook

Samsung's Chromebook Plus V2 attempts to answer the question: can you spend around half as much as on the premium Google Pixelbook and be happy that you saved some serious cash?

Protecting your PDF with a password isn't difficult. Just follow these steps

If you need to learn how to password protect a PDF, you have come to the right place. This guide will walk you through the process of protecting your documents step by step, whether you're running a MacOS or Windows machine.

Intel's 9th-gen chips could power your next rig. Here's what you need to know

The Intel Core i9-9900K processor was the star of the show for consumers, but a powerful 28-core Xeon processor also led announcements. Here's everything you need to know about the latest Intel chipsets.

Core i9s and Threadrippers are all powerful, but should you go AMD or Intel?

The battle for the top prosumer CPUs in the world is on. In this head to head, we pit the Core i9 versus the Threadripper to see which is the best when it comes to maximizing multi-core performance on a single chip.

Despite serious security flaws, D-Link will (again) not patch some routers

D-Link revealed that it won't patch six router models despite warnings raised by a security researcher. The manufacturer, for the second time in a span of about a year, cited end-of-life policies for its decision to not act.

Apple’s latest feature ensures MacOS apps are safer than ever

MacOS is mythically known for being more immune to viruses than Windows, but that doesn't mean there isn't room to make it safer. Apple is using an app notarization feature to protect users from downloading malicious apps.

There’s now proof that quantum computing is superior to the classical variety

For the first time in computer science history, researchers have tangibly demonstrated how a quantum computer is better than a classical computer. A quantum computer was able to solve a math problem that a classical PC cannot.