Skip to main content

Why I leave Nvidia’s game-changing tech off in most games

Ratchet and Clank Rift Apart running on the Samsung Odyssey OLED G8.
Jacob Roach / Digital Trends

Nvidia’s most recent graphics cards have increasingly relied on Deep Learning Super Sampling (DLSS) 3 to find their value. GPUs like the RTX 4070 Ti and RTX 4060 Ti aren’t impressive on their own, but factor DLSS 3 into the buying decision, and they start to become attractive. If you look at Nvidia’s overall strategy for this generation of chips, it looks like the company has started selling DLSS, not graphics cards.

It’s not hard to see why DLSS 3 is so important. It makes the impossible possible, like path tracing in Cyberpunk 2077, and it helps multiply frame rates far beyond what should be possible in games like Portal RTXBut now that we finally have DLSS 3 in more games and the party trick status has faded away, I’ve left Frame Generation off in most games. Here’s why.

How DLSS 3 works

Nvidia DLSS 3 running in Microsoft Flight Simulator.
Nvidia

First, it’s important to explain how DLSS 3 works. It comprises two components. DLSS Super Resolution is the image reconstruction technique we’ve come to know and love over the past several years. DLSS 3 adds Frame Generation as well, which is exclusive to RTX 40-series graphics cards and helps GPUs like the RTX 4070 stand out from the crowd.

Frame Generation is the interesting bit. It works by comparing two sequential frames in a game and creating a field of motion. It tracks particles, reflections, shadows, lighting, and everything in-between, then brings that all together to calculate a new frame. When combined with DLSS Super Resolution, as Nvidia points out, it makes the tech capable of generating seven out of every eight pixels you see. That’s mighty impressive.

A chart shing motion through Nvidia's DLSS 3.
Nvidia

If you break down this process, though, it’s clear to see that there’s a problem. That generated frame is basically a “dumb” frame. It’s just a picture, completely devoid of what you’re doing in the game or the inputs you’re entering. All it has to go on is the frame that came before and the frame that will come after. You can think about Frame Generation like an ultrafast AI image generator that’s taking your previous and next frame into account. Critically, it doesn’t react to your inputs.

A chart showing how DLSS 3 reconstructs frames.
Nvidia

This creates extra latency. As a thought experiment, imagine you’re running a game at 30 frames per second (fps). That means there’s 33.3 milliseconds between each frame, so if you take an action, you’ll have to wait 33.3ms to see it reflected in the game (there’s more latency elsewhere in the PC, but let’s ignore that for now). This is why, especially if you’re accustomed to playing games at 60 fps or higher on PC, it can feel like you’re playing in slow-motion at 30 fps.

Let’s bring in DLSS Frame Generation. Ignoring some overhead that’s necessary for calculating each frame, it would theoretically double your frame rate to 60 fps by generating every other frame. That’s how Frame Generation works. Remember half of those frames are dumb, though. You’re getting the appearance of 60 fps, but only the responsiveness of 30 fps.  And that’s the critical issue with DLSS 3.

Nvidia attempts to offset this problem with its latency-reducing Reflex tech. This basically syncs up the CPU and GPU so that frames are rendered as soon as they’re ready, eliminating the typical render queue that sits in-between the two components. Reflex ensures your real frames arrive as fast as possible, so the impact of your fake frames doesn’t feel as large.

A diagram explaining different types of system latencies.
Nvidia

Nvidia likes to point out the experience of all three components working in tandem — Reflex, Frame Generation, and Super Resolution all improving responsiveness and smoothness as a singular unit. That’s just the problem, though; they aren’t a single unit. In games that support all three, you’re free to use Super Resolution and Reflex on their own, which will always result in lower latency compared to turning on Frame Generation.

This is a much more potent combo for actually increasing your frame rate, too. Super Resolution is simply enhancing detail on images that are actually rendered by your graphics card. In the same situation as above, if Super Resolution took you from 30 fps to 60 fps, you’d actually be getting the responsiveness of 60 fps.

Not right for every game

Diablo 4 running on the Alienware x16.
Jacob Roach / Digital Trends

The dynamic between Super Resolution and Frame Generation became clear when I started playing Diablo 4Like most other games with DLSS 3 support, I jumped into the graphics menu and flipped on Frame Generation, and instead of Super Resolution, I opted for Nvidia’s Deep Learning Anti-Aliasing (DLAA). The game was smooth, but something felt off.

Everything I did felt just a hair behind my input. It wasn’t a problem at first, but as I started climbing levels and taking on harder content, the tight rotation of abilities and attacks I needed to execute (along with a healthy dose of network lag) didn’t feel right. I turned off Frame Generation, turned on Super Resolution instead, and suddenly it felt right.

This wasn’t the first time I experienced the occasional sluggishness of DLSS 3, but it was put on full display in the fast-paced environment of Diablo 4. It’s also problematic in Marvel’s Spider-Man and Ratchet & Clank: Rift Apart, especially if you’re trying to tackle the higher difficulties of the games. Returnal can feel off as well, given how quickly you need to dodge around screen.

Hogwarts Legacy running on the Samsung Odyssey OLED G8.
Jacob Roach / Digital Trends

The story here isn’t that DLSS 3 is bad and you should turn it off, though. DLSS 3 is very impressive, and there’s a reason I say I leave it off in “most” games. I wouldn’t be able to comfortably play Portal RTX without the tech, and Cyberpunk 2077‘s path tracing mode owes its life almost exclusively to DLSS 3. That’s not to mention games like Hogwarts Legacy and A Plague Tale: Requiem, where a hair of extra latency is worth a performance and visual upgrade.

However, Nvidia has billed DLSS 3 as some sort of performance multiplier across games, and although it can improve the smoothness of your games, it also comes with some reasonable trade-offs. And unfortunately, the situations where you need DLSS 3 the most are also the situations where it shows the most problems.

RTX 4060 performance in Cyberpunk 2077 at 1440p
Jacob Roach / Digital Trends

For instance, with the RTX 4060, you’ll get about 67 fps in Cyberpunk 2077 with the Ultra RT preset at 1440p and DLSS 3 enabled. As we’ve covered, you’re actually feeling the latency of about 33 fps, though. DLSS 3 enhances already good performance. It doesn’t fully make up for poor performance, unlike Super Resolution.

This is important to point out, especially with the backlash some of Nvidia’s recent GPUs have received. Nearly all of Nvidia’s current-gen GPUs have carried DLSS 3 as a badge of honor, making up for lackluster generational improvements. It’s absolutely fair to factor DLSS 3 into a buying decision, but you should weigh it against the raw performance of the graphics card. The DLSS 3 performance number you see in a chart doesn’t tell the full story. In the case of a game like Cyberpunk 2077, you may believe you can reasonably play the game at over 60 fps with maxed-out ray tracing, but the feeling of actually playing at that frame rate isn’t even close.

Reasonable trade-offs

Two RTX 4060 graphics cards sitting next to each other.
Jacob Roach / Digital Trends

Personally, I use DLSS Super Resolution and Reflex together when I can, usually skipping out on the Frame Generation option unless it’s an extreme circumstance like Portal RTX. It’s true that Frame Generation is a shortcut to much higher performance, but it also carries all of the caveats that shortcuts normally do.

As I’ve covered, there are plenty of situations where DLSS 3 makes sense and can vastly improve your gaming experience. But it still can’t overcome the experience of better raw performance out of your graphics card, which is a very important factor to keep in mind. There has been a lot of marketing hype around DLSS 3, and for as much of that is earned, there are still trade-offs you need to contend with.

Editors' Recommendations

Jacob Roach
Senior Staff Writer, Computing
Jacob Roach is a writer covering computing and gaming at Digital Trends. After realizing Crysis wouldn't run on a laptop, he…
The success of AMD’s FSR 3 hinges on this one feature
AMD's RX 7900 XTX installed in a PC.

AMD finally shared more details on its FidelityFX Super Resolution 3 (FSR 3) this week, and it's exactly what everyone was asking for. It supports frame generation, and it works across GPUs from AMD and Nvidia. The company is even releasing a driver-based version of its Fluid Motion Frames tech, potentially enabling game support for thousands of titles. It's all good stuff.

But a big question remains: How is AMD going to deal with latency?

Read more
AMD isn’t just copying Nvidia’s homework with FSR 3
Frank Azor presenting AMD's FSR 3 at Gamescom.

After nearly a year of waiting, AMD has finally shared more details on its upcoming FidelityFX Super Resolution 3 (FSR 3). If you've seen the original announcement you know what to expect -- it's AMD's FSR upscaling combined with something called Fluid Motion Frames to multiply frame rates. The big news? It works with any GPU.

Well, not technically any GPU. AMD says its Fluid Motion Frames works on anything from the original RDNA generation (RX 5000) and newer, but that includes GPUs from Nvidia and Intel. It's a much different approach than Nvidia's Deep Learning Super Sampling 3 (DLSS 3). The DLSS Frame Generation feature not only requires an Nvidia RTX GPU, but specifically one from the most recent generation like the RTX 4070.

Read more
Despite mixed reviews, the RTX 4060 is moving the needle for Nvidia
Logo on the RTX 4060 Ti graphics card.

Nvidia has been taking a beating lately with its graphics cards, at least if you believe the reviews. On the financial side, however, Nvidia is still bringing in the cash with its controversial RTX 4060 family.

The company released its earnings for the second quarter of fiscal 2024 (or, in real life, the third quarter of 2023). Unsurprisingly, Nvidia brought in a ton of money overall -- a new record at $13.51 billion, which is 101% higher than a year ago, largely due to the AI boom. What's surprising is that Nvidia's gaming revenue is up, too.

Read more