Skip to main content

Meet Blackwell, Nvidia’s next-generation GPU architecture

Nvidia introducing its Blackwell GPU architecture at GTC 2024.

We finally have our first taste of Nvidia’s next generation of GPUs, named Blackwell. Sure, they’re built for enterprises, and no, they won’t run Cyberpunk 2077 (at least not officially). But this is the first look we’ve have at what Nvidia is cooking up for its RTX 50-series GPUs, which are rumored to launched sometime in the next year.

The GPU we have today is the B200 — Blackwell 200, if you can spot it — that comes packed with 208 billion transistors. The architecture is built on TSMC’s 4NP node, which is an enhanced version of the 5nm node. It’s a little surprising given that Nvidia’s Ada Lovelace GPUs are built with TSMC’s 4N node — one refinement step away from 4NP. Nvidia notes that it’s using a custom version of this process, however.

The die for Nvidia's Blackwell GPU.

Nvidia laid out six parameters that set Blackwell apart. The first is that custom 4NP process, which Nvidia is using to connect two GPU dies across a 10TB-per-second interconnect. Second is an updated Transformer Engine. Nvidia says the architecture can handle double the model size of last-gen Ada Lovelace, and it supports a new 4-bit floating point instruction set.

There’s also fifth-generation NVLink, allowing enterprises to hook up Blackwell GPUs in sizes of 576 GPUs in a single fleet. Nvidia is throwing in a couple of AI security features as well, including confidential computing capabilities and a RAS (reliability, availability, and serviceability) engine to ensure maximum uptime for its data center GPU.

Nvidia's GB200 NVL72 server rack.

That’s great if you’re running a data center, but it’s the sixth and final pillar that gets me excited. Nvidia says the B200 has a dedicated decompression engine. This is focused on enterprise right now, but we’ve seen how big of a difference dedicated decompression hardware can make in gaming as well. If Nvidia carries this engine over to its gaming GPUs, and supports the proper formats, it could make a massive difference once you’re able to throw a Blackwell graphics card in your gaming PC.

Get your weekly teardown of the tech behind PC gaming
Check your inbox!

All eyes are on the end of the year, or potentially early next year, for Nvidia’ Blackwell gaming GPUs to show up. For now, enterprise customers have access to the B200 through the HGX B200 — a server board that combines eight B200 GPUs — and the GB200, which brings together the B200 GPU with Nvidia’s Grace CPU. Nvidia is offering that part through the GB200 NVL72, which brings together a dizzying 72 B200 GPUs and 36 Grace CPUs.

Editors' Recommendations

Jacob Roach
Senior Staff Writer, Computing
Jacob Roach is a writer covering computing and gaming at Digital Trends. After realizing Crysis wouldn't run on a laptop, he…
GDC 2024 in review: Path tracing, upscaling, and CPU-killing tech
A banner with GDC on it outside a conference center.

ReSpec is a bit different this week. I’ve spent the week in sunny San Francisco at the Game Developers Conference (GDC), running from meeting to meeting and trying to find a moment of time to write a few words.

Instead of a normal column, we decided to post a sampling of entries from the newly launched ReSpec newsletter covering what I saw at GDC this week. If you want this same newsletter delivered to your inbox each week, sign up now and get in on the exclusive content.
Path tracing is a lie

Read more
I was wrong — Nvidia’s AI NPCs could be a game changer
A character in an AI-driven dialogue tree by Nvidia.

I wasn’t a fan of the Covert Protocol demo that Nvidia showed me on a video call late last week. The short mystery demo features a handful of NPCs that are directed entirely by AI. There’s a door greeter, an executive waiting for a room, and a receptionist -- and all three featured what were, on the surface, bland dialogue trees generated with AI.

At GDC 2024, trying out the demo myself, I was converted.

Read more
Nvidia is bringing ray tracing and DLSS 3 to your car
Cyberpunk 2077 running in a Tesla.

I know it sounds crazy, but a new MediaTek chip powered by Nvidia graphics promises to bring AAA gaming, ray tracing, and the coveted DLSS 3 to your car. The chips I'm talking about are MediaTek's new Dimensity Auto Cockpit, which integrated an Nvidia GPU, along with a host of AI and gaming capabilities.

It's not clear what Nvidia graphics are packed on MediaTek's chips, but clearly, they're using some variation of the Ada Lovelace architecture we see on RTX 40-series GPUs. Those are the only GPUs that support DLSS 3's frame generation capabilities, and they're extremely efficient -- important for a chip packed into a car.

Read more