Skip to main content

AMD just won the AI arms race

A render of the new Ryzen AI 300 chip on a gradient background.
AMD

TOPS — also known as trillions of operations per second.

The acronym has quickly become the go-to measurement for expressing the AI horsepower of a system, and the biggest tech companies in the world are duking it out to outdo each other.

Microsoft really kicked things off with the requirement of a 40 TOPS NPU, but AMD just launched its new Strix Point Ryzen AI processors — and they’re the real deal. AMD is the first to launch capable NPUs (neural processing units) in systems that also have discrete GPUs on board — and that’s a game-changer.

Get your weekly teardown of the tech behind PC gaming
Check your inbox!

The battle over TOPS begins

A chart showing NPU performance in different chips.
AMD

Microsoft’s push into on-device has meant a rapid increase in the performance of NPUs. The new hardware was first introduced in Intel’s Meteor Lake chips, which could handle just 10 TOPS. The acronym is quickly becoming the go-to way to measure the AI horsepower of a system, standing for trillions of operations per second. As it turns out, those 10 TOPS weren’t all that useful in these initial laptops, despite being marketed as “AI PCs.” It just wasn’t enough performance to be favored over the CPU or GPU in most tasks.

The jump to 40 TOPS in Copilot+ PCs is important, especially for background tasks like the new Recall feature. As Microsoft and Qualcomm noted, that NPU is critical to producing devices with long battery life too. That’s because the initial group of laptops under the Copilot+ PC banner all belong to the same class of laptop. These are highly portable MacBook Air competitors meant for light work on the go.

But let’s get real — the most powerful AI PC in the world is never going to be a device without a powerful GPU. Despite what Microsoft has been saying, GPUs remain the most important component in raw AI performance. Modern graphics cards have loads of AI power under the hood, thanks to the Nvidia’s heavy investment in the technology early on. And that’s what makes these new AMD laptops so exciting. They combine a 50 TOPS NPU with an additional 320 TOPS of the RTX 4070 — all in a stunningly sleek package. The NPU can handle the lighter background tasks, but as of now, you still need a GPU to handle more-intensive AI tasks, especially ones in content creation applications.

An Asus ProArt laptop on a surface against a desert background.
Asus

For me, the star of the lineup of the first Ryzen AI laptops is the Asus ProArt P16. While devices like the new Surface Laptop 13 are a solid alternative to the M3 MacBook Air, they’re not meant to compete with the MacBook Pro. But that’s exactly what the ProArt P16 looks to do. Despite having the new Ryzen AI 9 HX chips and up to an RTX 4070, the device is just 0.59 inches thick. You read that right — the ProArt P16 is considerably thinner than the 16-inch MacBook Pro. There’s been plenty of attempts at creating MacBook Pro alternatives recently, but none that undercut its design in this way.

Even beyond that, the ProArt P16 is only marginally thicker than the Qualcomm-powered Copilot+ PCs, despite having way more headroom for GPU and AI performance. For some, it’s within 0.02 inches.

As a sidenote, the design is extremely modern, using a massive trackpad and some oversized stereo speaker grills flanking the keyboard. It even has a high-resolution OLED panel.

Of course, I’m not expecting the ProArt P16 to get the kind of battery life the MacBook Pro or the Qualcomm laptops achieve. That kind of efficiency is hard to replicate without switching to Arm, especially in a laptop this powerful. The lack of a discrete GPU in the MacBook Pro M3 Max also helps it achieve its incredible battery life. Until Qualcomm can scale up its integrated graphics in the same way Apple has, these discrete Nvidia GPUs will remain the best way to go.

Things are about to heat up

The Surface Laptop shown in front of a Copilot+ sign.
Luke Larsen / Digital Trends

The race for AI performance is only just getting started. Qualcomm was the first out of the gate with its Snapdragon X chips, but the achievement has only poured oil on the fire for these other companies. AMD’s Ryzen AI is the first up to take back the crown and integrate more capable NPUs in more powerful systems. But you can bet that Intel, Apple, and even Qualcomm won’t be idly watching.

Apple is about to crank the nob on its own AI features at WWDC, having just released the M4 for the iPad Pro, which has a neural engine capable of 38 TOPS. The rollout to MacBooks on those may take a bit, but they may come just in time to take use of these new AI features built into macOS.

Intel is also gearing up for its own comeback later this year with Lunar Lake, which is said to also hit the 40+ TOPS requirement for Copilot+.

As you might guess, laptop manufacturers are caught in the middle of this situation. It’s hard enough for companies like Asus, Dell, and Lenovo to figure out which CPU platforms to support — let alone know how to brand these changes to their existing customers. We’ve seen a mix of approaches, which is what you’d expect. But it leads to a whole lot of confusion on the part of the average laptop buyer, who’s stuck having to choose among these different CPU platforms.

Here’s what’s clear for now, though. When it comes to Windows laptops, the most efficient and long-lasting devices will likely continue to be the Qualcomm-based devices, such as the new Surface Pro and Surface Laptop. When it comes to raw power, whether it’s for video editing, gaming, or even heavy AI workloads, you’ll want something like the ProArt P16 that has both a strong NPU and discrete GPU. Outside of the MacBook Pro, AMD has the exclusivity on such devices right now — even if that lead won’t last for long.

Editors' Recommendations

Luke Larsen
Luke Larsen is the Senior editor of computing, managing all content covering laptops, monitors, PC hardware, Macs, and more.
AMD on the Ryzen 7 9800X3D: ‘We have a lot to say’
A delidded Ryzen 7000 CPU.

AMD just revealed its Ryzen 9000 chips at Computex 2024, but the company is already working on its versions of these processors with 3D V-Cache. These X3D variants, as they're called, have been a mainstay of AMD's lineup since the Ryzen 7 5800X3D, and they consistently rank among the best gaming processors. AMD's Donny Woligroski says the company is "not just resting on laurels," and that it has some big plans for the next version of X3D chips.

The news comes from PC Gamer, which shared various quotes from an interview with Woligroski. Although we've known for a while that 3D V-Cache would come to Ryzen 9000 eventually, Woligroski says that AMD is pushing the tech forward. "It's not like, 'hey, we've also added X3D to a chip.' We are working actively on really cool differentiators to make it even better. We're working on X3D, we're improving it," Woligroski told PC Gamer.

Read more
Buying a laptop just got very confusing
The Surface Laptop running local AI models.

Buying a laptop has never been straightforward. Deciding between MacBook, Windows laptop, or Chromebook is easy enough for most people. But now, there's an entirely new problem to consider. Although Windows laptops are about to be more capable than ever, deciding which laptop to buy is getting extremely complex.

A lot of the chips are still falling -- literally -- on which of these laptops are the best. But one thing's for sure: There are more factors to consider than ever before.
To Copilot+ PC or not?

Read more
A wave of new handhelds is arriving at the worst possible time
Another Crab's Treasure running on the MSI Claw.

We saw the floodgates open on a new range of handhelds at Computex 2024. After the success of devices like the Steam Deck and ROG Ally, smaller companies like Zotac, Antec, XPG, and Adata are all getting in on the handheld craze, eyeing a slot among the best handheld gaming PCs. It might be the worst time to release a new handheld, though.

Although it's great to see competition among handheld gaming PCs, we're facing down the next generation of mobile chips from AMD and Intel. These new chips are said to come with a big boost to efficiency and graphics performance, both of which have massive implications for a handheld gaming PC. If you're in the market for a new handheld, don't be swayed by the new crop of devices showing up -- it's best to wait for now.
Big chip implications

Read more