Skip to main content

Nvidia’s latest A.I. results prove that ARM is ready for the data center

Nvidia just published its latest MLPerf benchmark results, and they have are some big implications for the future of computing. In addition to maintaining a lead over other A.I. hardware — which Nvidia has claimed for the last three batches of results — the company showcased the power of ARM-based systems in the data center, with results nearly matching traditional x86 systems.

In the six tests MLPerf includes, ARM-based systems came within a few percentage points of x86 systems, with both using Nvidia A100 A.I. graphics cards. In one of the tests, the ARM-based system actually beat the x86 one, showcasing the advancements made in deploying different instruction sets in A.I. applications.

MLPerf results with Arm processors.
Image used with permission by copyright holder

“The latest inference results demonstrate the readiness of ARM-based systems powered by ARM-based CPUs and Nvidia GPUs for tackling a broad array of A.I. workloads in the data center,” David Lecomber, senior director of HPC at Arm, said. Nvidia only tested the ARM-based systems in the data center, not with edge or other MLCommons benchmarks.

MLPerf is a series of benchmarks for A.I. that are designed, contributed to, and validated by industry leaders. Although Nvidia has led the charge in many ways with MLPerf, the leadership of the MLCommons consortium is made up of executives from Intel, the Video Electronics Standards Association, and Arm, to name a few.

The latest benchmarks pertain to MLCommons’ inference tests for the data center and edge devices. A.I. inference is when the model begins producing results. It comes after the training phase where the A.I. model is still learning, which MLCommons also has benchmarks for. Nvidia’s Triton software, which deals with inference, is in use at companies like American Express for fraud detection and Pinterest for image segmentation.

Nvidia also highlighted its Multi-Instance GPU (MIG) feature when speaking with press. MIG allows the A100 and A30 graphics cards to go from a single A.I. processing unit into a few A.I. accelerators. The A100 is able to split into seven separate accelerators, while the A30 can split into four.

By splitting up the GPU, Nvidia is able to run the entire MLPerf suite at the same time with only a small loss in performance. Nvidia says it measured 95% of per-accelerator performance when running all of the tests compared to a baseline reading, allowing the GPUs to run multiple A.I. instructions at the same time.

Editors' Recommendations

Jacob Roach
Senior Staff Writer, Computing
Jacob Roach is a writer covering computing and gaming at Digital Trends. After realizing Crysis wouldn't run on a laptop, he…
Nvidia’s new liquid-cooled GPUs are heading to data centers
Nvidia A100 liquid-cooled data center GPU.

Nvidia is taking some notes from the enthusiast PC building crowd in an effort to reduce the carbon footprint of data centers. The company announced two new liquid-cooled GPUs during its Computex 2022 keynote, but they won't be making their way into your next gaming PC.

Instead, the H100 (announced at GTC earlier this year) and A100 GPUs will ship as part of HGX server racks toward the end of the year. Liquid cooling isn't new for the world of supercomputers, but mainstream data center servers haven't traditionally been able to access this efficient cooling method (not without trying to jerry-rig a gaming GPU into a server, that is).

Read more
Nvidia’s first CPU is here and powering next-gen cloud gaming
Nvidia Grace Hopper processors.

During Computex 2022, Nvidia announced the upcoming release of its first system reference designs powered by the Nvidia Grace CPU. Upon launch, Nvidia's first CPU will help usher in the next generation of high-performance computing (HPC), enabling tasks such as complex artificial intelligence, cloud gaming, and data analysis.

The upcoming Nvidia Grace CPU Superchip and the Nvidia Grace Hopper Superchip will find their way into server models from some of the most well-known manufacturers, such as Asus, Gigabyte, and QCT. Alongside x86 and other Arm-based servers, Nvidia's chips will bring new levels of performance to data centers. Both the CPU and the GPU were initially revealed earlier this year, but now, new details have emerged alongside an approximate release date.

Read more
Zoom’s A.I. tech to detect emotion during calls upsets critics
coronavirus crisis not ready for an online first world analysis zoom conference lifestyle image

Zoom has begun to develop A.I. technology which can reportedly scan the faces and speech of users in order to determine their emotions, which was first reported by Protocol.

While this technology appears to still be in its early phases of development and implementation, several human rights groups project that it could be used for more discriminatory purposes down the line, and are urging Zoom to turn away from the practice.

Read more