Skip to main content

Stop worrying so much about benchmarks when buying a new GPU

GPU prices are finally normal, and you might have found yourself in recent weeks browsing graphics cards reviews to see which ones top the charts. After all, the best graphics cards live and die based on their performance in gaming benchmarks, right?

But those benchmarks are far from a definitive answer, and in most cases, they skew the conversation away from the games you actually play and the experiences they offer.

I’m not saying we need to throw the baby out with the bathwater. GPU benchmarks offer a lot of value, and I don’t think anything needs to change about how we (or others) conduct GPU reviews. But now that it’s actually possible to upgrade your graphics card, it’s important to take all of the performance numbers in context.

Get your weekly teardown of the tech behind PC gaming
Check your inbox!

Games, not benchmarks

A character swinging a sword in Lost Ark.
The most popular Steam game of 2022 so far? Lost Ark, which only calls for a GTX 1050. Image used with permission by copyright holder

DT’s computing evergreen coordinator Jon Martindale made a joke concerning GPU prices the other day: “I need a new GPU so I can get 9,000 frames in Vampire Survivors.” Silly, but there’s a salient point there. When looking at performance, it’s important to recognize the fact that there are around four times as many people playing Terraria or Stardew Valley as there are playing Forza Horizon 5 or Cyberpunk 2077 at any given time.

The best games to benchmark your PC are not the most popular games that people play. In the top 25 most popular Steam games, only two of them are regularly used in benchmarks: Grand Theft Auto V and Rainbow Six Siege. Virtually no “live” games are included in benchmark suites due to network variation, despite the fact that these games largely top the charts in player count, and recent, GPU-limited games are usually overrepresented.

The games that we and others have chosen as benchmarks aren’t the problem — they offer a way to push a GPU to its extreme in order to compare it to the competition and previous generations. The problem is that benchmark suites frame performance around the clearest margins. And those margins can imply performance that doesn’t hold up outside of a graphics card review.

Benchmarks are often misleading

A hand grabbing the RTX 3090 Ti graphics card.
Jacob Roach / Digital Trends

Especially when it comes to the most recent graphics cards, benchmarks can be downright misleading. Every benchmark needs at least an average frame rate, which is a problematic number in and of itself. Brief spikes in frame rate are over-represented in an average of 1% lows and 0.1% lows — which average the lowest 1% and 0.1% of frames, respectively. But those numbers still don’t say much about how often those frame rate dips occur — only how severe they are.

A frame time chart can show how often frame rate dips happen, but even that only represents the section of the game the benchmark focused on. I hope you see the trend here: The buck has to stop somewhere, even as more data points try to paint a picture of real-world performance. Benchmarks show relative performance, but they don’t say much about the experience of playing a game.

The RTX 3090 Ti is 8.5% faster than the RTX 3090 in Red Dead Redemption 2, for example. That’s true, and it’s important to keep in mind. But the difference between the cards when playing is all of seven frames. I’d be hard-pressed to tell a difference in gameplay between 77 fps and 84 fps without a frame rate counter, so while the RTX 3090 Ti is technically faster, it doesn’t impact the experience of playing Red Dead Redemption 2 in any meaningful way.

Performance benchmarks for the RTX 3090 and RTX 3090 Ti in Red Dead Redemption 2.
Image used with permission by copyright holder

The recent F1 2022 is another example. The game shows huge disparities in performance between resolutions with all of the settings cranked up (as you’d usually find them in a GPU review). But bump down a few GPU-intensive graphics options, and the game is so CPU limited that it offers almost identical performance between 1080p and 4K. No need for a GPU upgrade there.

No one is lying or intentionally misleading with benchmarks, but the strict GPU hierarchy they establish is an abstraction of using your graphics card for what you bought it for in the first place. Benchmarks are important for showing differences, but they don’t say if those differences actually matter.

How to make an informed GPU upgrade

Installing a graphics card in a motherboard.
Image used with permission by copyright holder

You should absolutely look at benchmarks before upgrading your GPU, as many as you can. But don’t put your money down until you answer these questions:

  • What games do I want to play?
  • What resolution do I want to play at?
  • Are there other components that I need to upgrade?
  • What’s my budget?

Relative performance is extremely important for understanding what you’re getting for your money, but better isn’t strictly better in the world of PC components. Depending on the games you’re playing, the resolution you’re playing at, and potential bottlenecks in your system, you could buy a more expensive GPU and get the exact same performance as a cheaper one.

That doesn’t mean you shouldn’t splurge. There’s a lot to be said about buying something nice just because it’s nice, even if it doesn’t offer a huge advantage. If you have the means, there’s novelty in owning something super powerful like an RTX 3090 — even if you just use it to play Vampire Survivors. Just don’t expect to notice a difference when you’re actually playing.

This article is part of ReSpec – an ongoing biweekly column that includes discussions, advice, and in-depth reporting on the tech behind PC gaming.

Editors' Recommendations

Jacob Roach
Senior Staff Writer, Computing
Jacob Roach is a writer covering computing and gaming at Digital Trends. After realizing Crysis wouldn't run on a laptop, he…
Nvidia DLSS is amazing, but only if you use it the right way
Lies of P on the KTC G42P5.

Nvidia's Deep Learning Super Sampling, or DLSS, has become a cornerstone feature of modern PC games. It started as a way to boost your performance by rendering a game at a lower resolution, but the prominence and popularity of DLSS have prompted Nvidia to add even more features under the name.

Today, DLSS incorporates several different features, all of which leverage AI to boost performance and/or image quality. It can be intimidating if you're a new RTX user, so I'm here to break down all of the increases of DLSS in 2024 and how you can best leverage it in supported games.
The many features of DLSS

Read more
AMD needs to fix this one problem with its next-gen GPUs
The RX 7800 XT graphics card with the ReSpec logo.

AMD's current-gen graphics cards have been a revelation. Last generation, AMD was able to hit performance parity with Nvidia while sacrificing ray tracing performance. This generation, AMD is maintaining parity while getting closer in ray tracing, as showcased by GPUs like the RX 7900 GRE. But the next frontier of gaming is rapidly approaching, and AMD's current options aren't up to the task right now.

I'm talking about path tracing. Nvidia calls it "full ray tracing," and it's a lighting technique that can take gaming visuals to the next level. Path tracing is only available in a small list of titles right now, but with frame generation and upscaling tools better than they've ever been, it won't be long before we see these destination gaming experiences everywhere.
Player two in path tracing

Read more
Don’t buy the new MSI Claw handheld — at least not yet
Sonic Superstars running on the MSI Claw.

Don't buy the new MSI Claw handheld, at least not yet. After being announced in January, MSI confirmed that its Windows-based handheld gaming PC would launch on March 8 through the official MSI store -- today, if you're reading this article the day it's published. It says units will start shipping on March 12, with retailers selling them by March 15. MSI has confirmed that there won't be any reviews for the handheld in the near future, unless a media outlet happens to get their hands on what is described as a "very limited" initial run.

Buying any new product before third-party reviewers can poke and prod it is problematic, but the MSI Claw is an even riskier venture. It's not only MSI's first handheld gaming PC ever, but it's also launching with one of Intel's Core Ultra CPUs. We don't know how this chip will perform inside the Claw, and that's a problem for the Claw without any independent reviews.
A new challenger

Read more