Skip to main content

Nvidia embraces ARM on its new Grace supercomputing processors

Image used with permission by copyright holder

After a lot of speculation, Nvidia finally announced its powerful supercomputer CPU called Nvidia Grace at its annual GPU Technology Conference. Named after famed American computer scientist and computer programming pioneer Grace Hopper, Nvidia’s first data-center processor is based on architecture from ARM. The company claimed in a press session ahead of GTC that Nvidia Grace is capable of delivering “10x the performance of today’s fastest servers on the most complex A.I. and high-performance computing workloads.”

This is Nvidia’s first partnership with ARM since announcing its $40 billion acquisition of the company in 2020.

Recommended Videos

Unlike Apple’s ARM-based M1 processor, Nvidia Grace won’t be headed to a computer near you. Instead, it is designed to be used on diverse applications like natural language processing, recommender systems, and A.I. supercomputing, Nvidia’s executives said. Nvidia Grace is adopted by both the Swiss National Supercomputing Centre (CSCS) and the United States Department of Energy Los Alamos National Laboratory to help power and drive scientific research.

Get your weekly teardown of the tech behind PC gaming
Check your inbox!

The company claimed that the volume of data and size of models used to train A.I. systems are growing exponentially, and the largest models are doubling every two-and-a-half months. To help reduce the bottleneck in communication between the processing and graphics core, Grace employs Nvidia’s NVLink interconnect technology, allowing large chunks of data to move between system memory, the CPU, and the GPU.

By tightly coupling the CPU and GPU inside Grace’s architecture, Nvidia stated that this processor will be seven times as fast on natural language training as Nvidia’s Selene supercomputer. Selene has a performance of 2.8-A.I. exaflops and is arguably one of the world’s fastest supercomputers for artificial intelligence applications today.

Grace combines energy-efficient ARM CPU cores with an innovative low-power memory subsystem.

And compared to traditional x86 server processors, like those made by rival Intel, Nvidia claimed that Grace is 10 times faster.

“A Grace-based system will be able to train a one trillion parameter NLP model 10x faster than today’s state-of-the-art NVIDIA DGXTM-based systems, which run on x86 CPUs,” the company added. This means that data that would have taken a month to analyze would now take just three days with Grace.

Powering this performance is ARM’s next-generation Neoverse cores alongside Nvidia’s fourth-generation NVLink interconnect, which has a bandwidth of 900 GB/s between the CPU and GPU. Grace will also use faster LPDDR5X memory, which is faster and more energy-efficient than DDR4 memory.

“It combines energy-efficient ARM CPU cores with an innovative low-power memory subsystem to deliver high performance with an energy-efficient design,” the company said.

Nvidia Grace will be used by Hewlett Package Enterprise in its Alps supercomputer, which will become available in 2023.

And Bluefield 3 for data centers too

Image used with permission by copyright holder

In addition to Nvidia Grace, the company also took the wraps off of its data center CPU called Bluefield 3. Referred to as the DPU, or data processing unit, Bluefield 3 is built for A.I. and accelerated computing that’s optimized for “multi-tenant, cloud-native environments, offering software-defined, hardware-accelerated networking, storage, security, and management services at data-center scale.”

The DPU delivers the equivalent of 300 cores to power data center services, which can free up the CPU to run other applications.

“Modern hyperscale clouds are driving a fundamental new architecture for data centers,” said Nvidia CEO Jensen Huang. “A new type of processor, designed to process data center infrastructure software, is needed to offload and accelerate the tremendous compute load of virtualization, networking, storage, security, and other cloud-native A.I. services. The time for BlueField DPU has come.”

Nvidia claims that Bluefield 3 delivers 10x the performance of the prior generation Bluefield 2, and the DPU is powered by 16x Arm X78 cores and has four times the acceleration for cryptography. The chip is the first 400 SeE/NDR DPU, Nvidia claimed, and it supports PCIe 5.0.

Additionally, Nvidia also built in network security to allow the DPU to detect and respond to cyber threats.

Bluefield 3 is expected to become available in early 2022.

Chuong Nguyen
Silicon Valley-based technology reporter and Giants baseball fan who splits his time between Northern California and Southern…
Nvidia’s RTX 50-series may launch ‘soon,’ whatever that means
Nvidia CEO Jensen Huang with an RTX 4090 graphics card.

As we inch closer to the expected release date of Nvidia's RTX 50-series, the number of leaks is growing by the minute. Today, a reputable leaker weighed in on when we might see the RTX 50-series join the ranks of the best graphics cards. Could Blackwell make an appearance sooner than currently expected? It's certainly possible, but who even knows at this point?

The information comes from kopite7kimi, who, in typical tipster fashion, dropped a vague message on X (formerly Twitter) and then left without answering any questions. However, at this point in the GPU release cycle, even one vague sentence is enough to send the internet for a spin, which is what's happening in the reply section of Kopite's tweet.

Read more
It’s finally time to stop buying Nvidia’s RTX 30-series GPUs
RTX 3080 Ti in front of a window.

If you're looking for a budget GPU, the general advice is usually to buy from the previous generation of graphics cards. After all, as the new cards take over the market, the older ones are still waiting to be sold -- and while they're no longer among the best graphics cards, they're still perfectly acceptable alternatives.

We've now reached the point in the current generation of Nvidia GPUs where that advice no longer applies. If you want to get the best bang for your buck, it's time to stop buying Nvidia's RTX 30-series and look for other options.
The RTX 30-series arrived at the worst possible time

Read more
Bad news for AMD? Nvidia might fast-track the RTX 50-series
Two RTX 4060 cards side by side

Things are finally about to start heating up for some of the best graphics cards. Although we're still in the dark about final release dates, both AMD and Nvidia are said to be launching new GPUs in the first quarter of 2025. However, a new leak tells us that Nvidia might try out a different approach with the RTX 50-series, and that's bound to put some pressure on AMD at the worst possible time.

What's new? We've already heard that Nvidia is likely to announce the RTX 5090 and the RTX 5080 at CES 2025, with its CEO Jensen Huang scheduled to hold a keynote during the event. However, the release dates for the rest of the lineup remained a mystery. Now, a previously reliable source sheds some light on the matter with potential details about the planned launch dates for the RTX 5070, RTX 5070 Ti, RTX 5060, and RTX 5060 Ti.

Read more