Skip to main content

Nvidia’s new liquid-cooled GPUs are heading to data centers

Nvidia is taking some notes from the enthusiast PC building crowd in an effort to reduce the carbon footprint of data centers. The company announced two new liquid-cooled GPUs during its Computex 2022 keynote, but they won’t be making their way into your next gaming PC.

Instead, the H100 (announced at GTC earlier this year) and A100 GPUs will ship as part of HGX server racks toward the end of the year. Liquid cooling isn’t new for the world of supercomputers, but mainstream data center servers haven’t traditionally been able to access this efficient cooling method (not without trying to jerry-rig a gaming GPU into a server, that is).

Related Videos
Nvidia A100 liquid-cooled data center GPU.

In addition to HGX server racks, Nvidia will offer the liquid-cooled versions of the H100 and A100 as slot-in PCIe cards. The A100 is coming in the second half of 2022, and the H100 is coming in early 2023. Nvidia says “at least a dozen” system builders will have these GPUs available by the end of the year, including options from Asus, ASRock, and Gigabyte.

Data centers account for around 1% of the world’s total electricity usage, and nearly half of that electricity is spent solely on cooling everything in the data center. As opposed to traditional air cooling, Nvidia says its new liquid-cooled cards can reduce power consumption by around 30% while reducing rack space by 66%.

Instead of an all-in-one system like you’d find on a liquid-cooled gaming GPU, the A100 and H100 use a direct liquid connection to the processing unit itself. Everything but the feed lines is hidden in the GPU enclosure, which itself only takes up one PCIe slot (as opposed to two for the air-cooled versions).

Data centers look at power usage effectiveness (PUE) to gauge energy usage — essentially a ratio between how much power a data center is drawing versus how much power the computing is using. With an air-cooled data center, Equinix had a PUE of about 1.6. Liquid cooling with Nvidia’s new GPUs brought that down to 1.15, which is remarkably close to the 1.0 PUE data centers aim for.

Energy usage for Nvidia liquid-cooled data center GPUs.

In addition to better energy efficiency, Nvidia says liquid cooling provides benefits for preserving water. The company says millions of gallons of water are evaporated in data centers each year to keep air-cooled systems operating. Liquid cooling allows that water to recirculate, turning “a waste into an asset,” according to head of edge infrastructure at Equinix Zac Smith.

Although these cards won’t show up in the massive data centers run by Google, Microsoft, and Amazon — which are likely using liquid cooling already — that doesn’t mean they won’t have an impact. Banks, medical institutions, and data center providers like Equinix compromise a large portion of the data centers around today, and they could all benefit from liquid-cooled GPUs.

Nvidia says this is just the start of a journey to carbon-neutral data centers, as well. In a press release, Nvidia senior product marketing manager Joe Delaere wrote that the company plans “to support liquid cooling in our high-performance data center GPUs and our Nvidia HGX platforms for the foreseeable future.”

Editors' Recommendations

Nvidia’s first CPU is here and powering next-gen cloud gaming
Nvidia Grace Hopper processors.

During Computex 2022, Nvidia announced the upcoming release of its first system reference designs powered by the Nvidia Grace CPU. Upon launch, Nvidia's first CPU will help usher in the next generation of high-performance computing (HPC), enabling tasks such as complex artificial intelligence, cloud gaming, and data analysis.

The upcoming Nvidia Grace CPU Superchip and the Nvidia Grace Hopper Superchip will find their way into server models from some of the most well-known manufacturers, such as Asus, Gigabyte, and QCT. Alongside x86 and other Arm-based servers, Nvidia's chips will bring new levels of performance to data centers. Both the CPU and the GPU were initially revealed earlier this year, but now, new details have emerged alongside an approximate release date.

Read more
How to watch Nvidia’s Computex 2022 keynote
Nvidia previews RTX 3090 Ti GPU at CES 2022.

Nvidia just wrapped its Computex 2022 keynote, which was packed with announcements about the company's enterprise business. Although the presentation was light on next-gen GPU news, Nvidia still shared some announcements related to liquid-cooled GPUs in the data center and the processors that could power next-gen cloud gaming.

The keynote happened late Monday night in the U.S., lining up with the morning in Taiwan,where Computex takes place. To get you up to speed, we have a replay of the keynote here, as well as all of Nvidia's announcements.
How to watch Nvidia's Computex 2022 keynote
NVIDIA Keynote at COMPUTEX 2022

Read more
Nvidia confirms Computex 2022 keynote. 40-series GPU coming soon?
Graphics card inside the Maingear Vybe.

Nvidia has confirmed its keynote for the upcoming Computex 2022 event, which will take place on May 23.

Team Green will "present how AI is powering the enterprise data center and the latest products and technologies for gamers and creators." To catch all the announcements, make sure to check our guide on how to watch Nvidia's Computex 2022 keynote.

Read more