Skip to main content

The next Intel desktop chips may muddy the AI waters

Intel CEO Pat Gelsinger presents Intel's roadmap including Arrow Lake, Lunar Lake, and Panther Lake.
Intel

Intel is hitting a big milestone with Arrow Lake-S, its upcoming desktop processors. After all, those chips will be the first ones to feature a neural processing unit (NPU) in a desktop PC. However, impressive as the milestone might be, the CPU itself will be far from an AI workhorse. In fact, the NPU may be nowhere near being able to qualify for Microsoft’s Copilot+ PC program. The good news? It really doesn’t matter.

Before we dive in, it’s worth noting that Intel is yet to confirm the specs for Arrow Lake-S. However, Jaykihn on X (formerly Twitter) shared a list of various specs that are rumored to appear in the processors. This includes the trillion operations per second (TOPS) counts for the GPU, the CPU, and the NPU. That’s where things get a bit dicey.

Recommended Videos

According to the leak, the NPU will feature a measly 13 TOPS of AI performance. For comparison, Intel Lunar Lake CPUs, found only in laptops, offer 45 TOPS, while AMD’s Ryzen AI 300 series bumps that number up to 50 TOPS. Both qualify for the Microsoft Copilot+ certification, which calls for at least 40 TOPS. Why, then, would Intel release a next-gen product with a little over a fourth of the AI performance it already introduced in laptops?

It’s simple: Those NPU TOPS aren’t really needed in a desktop — at least not now. As Tom’s Hardware points out, NPUs are meant to handle AI and machine learning workloads while having little impact on the battery. That’s why we’re seeing these high TOPS counts in NPUs mainly found in ultralight workstation laptops. Seeing as battery life is not a concern for a desktop user, one big reason to even have an NPU in the first place is out.

Collection of various small improvements/changes shipping with Arrow Lake -S.

All specifications are “up to”, except for TOPS, which may exceed the listed number on the retail product. pic.twitter.com/EyAxyFVZMf

— Jaykihn (@jaykihn0) July 9, 2024

Then, there are other factors. Desktop PCs that are meant to handle AI workloads should just be equipped with a discrete GPU, which may be a better option for handling AI anyways. Nvidia’s RTX 4090 features up to 1,321 AI TOPS, which explains why it’s still so expensive nearly two years after launch. The current demand for AI drives both AI laptops and desktop GPUs.

Even if Intel were to equip the Arrow Lake-S with a more capable NPU, it’d be useless compared to a discrete GPU from Nvidia’s latest generation. It doesn’t even have to be the RTX 4090; a cheaper GPU will still run circles around any sort of NPU.

It feels like, if these specs are true, Intel will be able to slap a label on Arrow Lake-S and talk about having the first desktop NPU for consumers — even if it has little impact on actual AI workloads. Ultimately, if the CPUs had to feature an NPU, it’s for the best that the NPU isn’t great, as there would be very few scenarios where you could take advantage of a 45 TOPS NPU in a desktop setting anyway.

It does, however, leave a question mark over certain features, such as the now-delayed Recall. The feature has so far been exclusive to Copilot+ PCs, though you have to assume Microsoft will one day consider bringing it to desktop if it turns out to be a success.

Monica J. White
Monica is a computing writer at Digital Trends, focusing on PC hardware. Since joining the team in 2021, Monica has written…
Intel Arrow Lake gets a surprise 33% gaming boost — with one caveat
The Core Ultra 9 285K socketed into a motherboard.

Intel Arrow Lake has struggled to compete against some of the best processors from both AMD and Intel itself, but improvements are on the way. In fact, a completely unexpected update just gave the CPUs a major boost. Unfortunately, there's a caveat: That boost only applies to one game.

The update in question was just announced by CDProjektRed, which has dropped a surprise patch for Cyberpunk 2077. The game studio now promises to improve in-game performance on Arrow Lake CPUs by up to 33%, which is a tune-up that gamers badly need, considering that the CPUs generally failed to impress in gaming scenarios.

Read more
AMD’s next-gen APU may trail behind the RX 6600
AMD's CEO delivering the Computex 2024 presentation.

AMD's next-gen APU lineup, dubbed Strix Halo, is right around the corner -- but for now, all we can rely on are leaks when it comes to information about these processing units. Today, a leaked Geekbench test gave us some insight into the graphics performance of one of the upcoming top processors. While the integrated GPU sports more cores, it failed to beat the aging RX 6600, and actually trailed behind by a significant margin.

Brace yourself, because the APU in question has a name that you'll need to write down. In the Geekbench test, the chip is referred to as AMD Ryzen AI Max+ Pro 395 w/ Radeon 8060S. The actual product name will likely omit the mention of the GPU, but even just the first part is quite a mouthful. AMD also drops the "9" that you'd usually expect to see in a flagship processor, such as the Ryzen 9 9900X.

Read more
MSI’s Claw 8 AI+ is more than just a refresh
The MSI Claw 8 AI+ gaming handheld.

MSI has just unveiled two next-gen gaming handhelds, the MSI Claw 8 AI+ and the Claw 7 AI+. A follow-up to the original MSI claw that failed to make much of a splash, these two mini PCs are referred to as a "refresh" -- but they seem to be more than just that. The consoles, apart from updated specs, get a few design changes too. The downside? The flagship is significantly heavier.

We got our first look at the new Claw during this year's Computex, but that was before we knew the full specs. Now, MSI has revealed pretty much every spec for the two handhelds.

Read more