Skip to main content

AMD just won the AI arms race

A render of the new Ryzen AI 300 chip on a gradient background.
AMD
Computex 2024 logo.
This story is part of our coverage of Computex, the world's biggest computing conference.

TOPS — also known as trillions of operations per second.

The acronym has quickly become the go-to measurement for expressing the AI horsepower of a system, and the biggest tech companies in the world are duking it out to outdo each other.

Recommended Videos

Microsoft really kicked things off with the requirement of a 40 TOPS NPU, but AMD just launched its new Strix Point Ryzen AI processors — and they’re the real deal. AMD is the first to launch capable NPUs (neural processing units) in systems that also have discrete GPUs on board — and that’s a game-changer.

Get your weekly teardown of the tech behind PC gaming
Check your inbox!

The battle over TOPS begins

A chart showing NPU performance in different chips.
AMD

Microsoft’s push into on-device has meant a rapid increase in the performance of NPUs. The new hardware was first introduced in Intel’s Meteor Lake chips, which could handle just 10 TOPS. The acronym is quickly becoming the go-to way to measure the AI horsepower of a system, standing for trillions of operations per second. As it turns out, those 10 TOPS weren’t all that useful in these initial laptops, despite being marketed as “AI PCs.” It just wasn’t enough performance to be favored over the CPU or GPU in most tasks.

The jump to 40 TOPS in Copilot+ PCs is important, especially for background tasks like the new Recall feature. As Microsoft and Qualcomm noted, that NPU is critical to producing devices with long battery life too. That’s because the initial group of laptops under the Copilot+ PC banner all belong to the same class of laptop. These are highly portable MacBook Air competitors meant for light work on the go.

But let’s get real — the most powerful AI PC in the world is never going to be a device without a powerful GPU. Despite what Microsoft has been saying, GPUs remain the most important component in raw AI performance. Modern graphics cards have loads of AI power under the hood, thanks to the Nvidia’s heavy investment in the technology early on. And that’s what makes these new AMD laptops so exciting. They combine a 50 TOPS NPU with an additional 320 TOPS of the RTX 4070 — all in a stunningly sleek package. The NPU can handle the lighter background tasks, but as of now, you still need a GPU to handle more-intensive AI tasks, especially ones in content creation applications.

An Asus ProArt laptop on a surface against a desert background.
Asus

For me, the star of the lineup of the first Ryzen AI laptops is the Asus ProArt P16. While devices like the new Surface Laptop 13 are a solid alternative to the M3 MacBook Air, they’re not meant to compete with the MacBook Pro. But that’s exactly what the ProArt P16 looks to do. Despite having the new Ryzen AI 9 HX chips and up to an RTX 4070, the device is just 0.59 inches thick. You read that right — the ProArt P16 is considerably thinner than the 16-inch MacBook Pro. There’s been plenty of attempts at creating MacBook Pro alternatives recently, but none that undercut its design in this way.

Even beyond that, the ProArt P16 is only marginally thicker than the Qualcomm-powered Copilot+ PCs, despite having way more headroom for GPU and AI performance. For some, it’s within 0.02 inches.

As a sidenote, the design is extremely modern, using a massive trackpad and some oversized stereo speaker grills flanking the keyboard. It even has a high-resolution OLED panel.

Of course, I’m not expecting the ProArt P16 to get the kind of battery life the MacBook Pro or the Qualcomm laptops achieve. That kind of efficiency is hard to replicate without switching to Arm, especially in a laptop this powerful. The lack of a discrete GPU in the MacBook Pro M3 Max also helps it achieve its incredible battery life. Until Qualcomm can scale up its integrated graphics in the same way Apple has, these discrete Nvidia GPUs will remain the best way to go.

Things are about to heat up

The Surface Laptop shown in front of a Copilot+ sign.
Luke Larsen / Digital Trends

The race for AI performance is only just getting started. Qualcomm was the first out of the gate with its Snapdragon X chips, but the achievement has only poured oil on the fire for these other companies. AMD’s Ryzen AI is the first up to take back the crown and integrate more capable NPUs in more powerful systems. But you can bet that Intel, Apple, and even Qualcomm won’t be idly watching.

Apple is about to crank the nob on its own AI features at WWDC, having just released the M4 for the iPad Pro, which has a neural engine capable of 38 TOPS. The rollout to MacBooks on those may take a bit, but they may come just in time to take use of these new AI features built into macOS.

Intel is also gearing up for its own comeback later this year with Lunar Lake, which is said to also hit the 40+ TOPS requirement for Copilot+.

As you might guess, laptop manufacturers are caught in the middle of this situation. It’s hard enough for companies like Asus, Dell, and Lenovo to figure out which CPU platforms to support — let alone know how to brand these changes to their existing customers. We’ve seen a mix of approaches, which is what you’d expect. But it leads to a whole lot of confusion on the part of the average laptop buyer, who’s stuck having to choose among these different CPU platforms.

Here’s what’s clear for now, though. When it comes to Windows laptops, the most efficient and long-lasting devices will likely continue to be the Qualcomm-based devices, such as the new Surface Pro and Surface Laptop. When it comes to raw power, whether it’s for video editing, gaming, or even heavy AI workloads, you’ll want something like the ProArt P16 that has both a strong NPU and discrete GPU. Outside of the MacBook Pro, AMD has the exclusivity on such devices right now — even if that lead won’t last for long.

Luke Larsen
Luke Larsen is the Senior Editor of Computing, managing all content covering laptops, monitors, PC hardware, Macs, and more.
Ryzen AI nearly hits 60 fps in Black Myth: Wukong, but it’s not that simple
OneXFly F1 Pro gamig handheld.

Although AMD APUs appear in some of the best gaming handhelds, the latest Strix Point chips are still hard to find in new releases. However, the new OneXFly F1 Pro gamin handheld is making its debut with the Ryzen AI HX 370 chip in tow, and according to a benchmark in Black Myth: Wukong, it managed to average an impressive 58 frames per second (fps) at a 15-watt thermal design power (TDP). That's an impressive result, but digging deeper reveals that AAA gaming on the go is still not without any sacrifice.

The OneXFly F1 Pro comes with the Ryzen AI HX 370, which sports a total of 12 cores -- four Zen 5 and eight Zen 5c -- as well as 24 threads. The maximum boost clock on the Zen 5 cores reaches 5.1GHz, but the smaller Zen 5c maxes out at 3.3GHz. The default TDP was rated at 28 watts, but it can be configured between 15W and 54W. For an APU, the AI HX 370 delivers solid graphics capabilities, as it's equipped with the AMD Radeon 890M. It also sports a 7-inch OLED screen with a refresh rate of 144Hz.

Read more
AMD’s Ryzen 7 9800X3D is official, and it shakes things up in a big way
Pads on the AMD Ryzen 7 7800X3D.

We all knew it was coming. A string of rumors over the past several months has pointed to AMD releasing the Ryzen 7 9800X3D on November 7, but the company itself just confirmed the new CPU. It's looking for a spot among the best processors, packing 3D V-Cache on top of an eight-core Zen 5 CPU in order to improve gaming performance.

True to rumors we've seen this week, AMD is pricing the CPU at $479, which is nearly $30 more expensive than the Ryzen 7 7800X3D. AMD claims that the new chip provides an average gaming increase of 8% over the last-gen CPU, and 20% faster gaming performance compared to Intel's recent Core Ultra 9 285K. In addition, AMD says that minimum frame rates are up, with the Ryzen 7 9800X3D improving 1% lows in The Last of Us Part One by 31%.

Read more
AMD CPUs just got a major performance update for games
AMD Ryzen 7 7800X3D installed in a motherboard.

Major motherboard brands are gearing up for the release of AMD's upcoming Ryzen 9000X3D processors with BIOS updates that add support for the new CPUs. Alongside support, some brands, such as Gigabyte and Asus, have added an "X3D Turbo Mode," which is said to boost performance by up to 35%.

The update is targeting some of the best processors packing AMD's 3D V-Cache tech, but it might give other AMD processors a boost, too. One user on X (formerly Twitter) took the update out for a spin in Forza Horizon 5 and found a 5% uplift on the Ryzen 7 9700X. That's a far cry from the 35% we've seen quoted by Gigabyte, but it's a promising performance improvement nonetheless considering that this CPU doesn't come with 3D V-Cache.

Read more