Skip to main content

OnePlus 9 Pro’s throttling controversy shows why benchmarks don’t always matter

All smartphones are pretty fast nowadays. A long as you get a phone that costs over $300, you should expect to have little to no issue with speed. The very best smartphones, from iPhones to Android, offer fast and powerful chips that do far more than we need in our day-to-day lives. No more is this more apparent than a recent scandal around OnePlus and the OnePlus 9 series.

OnePlus recently came under fire for appearing to slow down performance when a user used some of the most popular Android apps on their newest flagship phones. When using an app like Chrome, Microsoft Office, or WhatsApp, performance would drop relative to performance for benchmarking apps. This behavior was spotted in a performance review of the OnePlus 9 Pro and substantiated by Geekbench who opted to remove the phone from their Android Benchmark charts.

It's disappointing to see OnePlus handsets making performance decisions based on application identifiers rather than application behavior. We view this as a form of benchmark manipulation. We've delisted the OnePlus 9 and OnePlus 9 Pro from our Android Benchmark chart. https://t.co/G40wmWeg7o

— Geekbench (@geekbench) July 6, 2021

With the OnePlus 9 and 9 Pro having a powerful Qualcomm Snapdragon 888 chip, this appears to be incongruous on the face of it. Why bother shipping a powerful chip in your phone, if you’re going to artificially throttle it. Well, turns out there’s a good reason.

OnePlus defended itself in a statement, saying that the change was made to preserve the battery life of OnePlus devices by optimizing the most popular apps in the Play Store against the Qualcomm Snapdragon 888 processor.

“Our top priority is always delivering a great user experience with our products, based in part on acting quickly on important user feedback. Following the launch of the OnePlus 9 and 9 Pro in March, some users told us about some areas where we could improve the devices’ battery life and heat management,” a OnePlus spokesperson told XDA Developers. “As a result of this feedback, our R&D team has been working over the past few months to optimize the devices’ performance when using many of the most popular apps, including Chrome, by matching the app’s processor requirements with the most appropriate power. This has helped to provide a smooth experience while reducing power consumption. While this may impact the devices’ performance in some benchmarking apps, our focus as always is to do what we can to improve the performance of the device for our users.”

A OnePlus 9 Pro showing the "about phone" information.
Andy Boxall/Digital Trends

Throttling the smartphone based on what apps are being used is a tactic typically used by Android manufacturers to optimize their phones towards benchmarks. This means that certain phones will appear faster once you use a certain benchmark as Geekbench or 3DMark, but will slow down (relatively) in regular use. Apple has also been found guilty of this in the past, albeit applying this throttling to older iPhones that had reached a low battery capacity (and the company later issued an update to change it). Google was found to be doing the same on some Pixel 5s, slowing down the processor beyond what other phones running the similar SoC would experience — until an update was released to fix this as well.

The issue here is that most users don’t notice when their phones are being “slowed down.” In actual use of the OnePlus 9 Pro, as seen in our reviews of both OnePlus 9 models, we found it to be a quick and speedy performer both times. “The Qualcomm Snapdragon 888 processor provides all the power you could want — there were absolutely no performance issues for me,” we noted. Similarly with the Pixel 5. We found it was a phone which handled all common tasks “without interruption — and without feeling like it’s underpowered” and noting that “there are times when the Pixel 5 runs more smoothly than some more powerful phones.” As a Pixel 5 owner for the past few months, I cannot help but concur with this characterization.

It’s about the experience, not the numbers.

The best thing in a smartphone is the overall experience, not the abstract numbers in benchmarks and spec sheets. This is not to say that benchmarks and benchmarking don’t matter, they have their place. If the OnePlus 9 and 9 Pro feel fast enough in day-to-day use AND the battery life lasts longer, who truly cares whether it’s has a lower number in this benchmarking app or that? Granted, OnePlus could (and still should) have communicated this better or made this an optional feature — after all, it offers considerable customization in so many parts of its software.

There are times when I’ve criticized OnePlus for focusing on the wrong things, as with the Nord CE 5G, but this experience with the OnePlus 9 Pro is an example of the company correctly prioritizing the overall experience.

Now, OnePlus has recently announced the OnePlus Nord 2, an affordable device that is built on the Dimensity 1200 chip. With OnePlus having customized that chip for optimal performance as well, it’ll take a review to see whether a similar throttling situation recurs on the Nord 2. If it’s anything like our experience with the 9 Pro, it is likely to be fine no matter what.

Editors' Recommendations

Topics
Michael Allison
A UK-based tech journalist for Digital Trends, helping keep track and make sense of the fast-paced world of tech with a…
The OnePlus 11 Concept steals the Nothing Phone’s best trick
OnePlus shows off a OnePlus 11 with rear LED lighting.

OnePlus has teased a new special concept phone based on the OnePlus 11. The Oppo subbrand highlighted a slew of LEDs around the back of the phone as a standout feature. The LEDs were reminiscent of the approach used by Nothing, another phone brand built by former OnePlus CEO Pete Lau.

The company sent out a teaser of its concept phone showing off what appeared to be LED lightning around the back in a very striking image. “The images show the engineering breakthroughs of the OnePlus 11 Concept by highlighting the icy blue pipelines which run through the entire back of the phone, almost like OnePlus 11 Concept has its own series of blood vessels. OnePlus 11 Concept’s pipelines are housed inside a bold and futuristic unibody glass design inspired by the calm stillness and vast power of a glacial lake,” OnePlus said, as reported by The Verge.

Read more
How I learned to love the OnePlus 11’s controversial software
The OnePlus 11's screen.

When I picked up the OnePlus 10 Pro, I missed the old OxygenOS immediately. Gone was the fluid and feature-light software that made OnePlus phones such a great experience, replaced by the heavy, slower, and more annoying ColorOS-inspired software few liked as much. I liked it even less on the OnePlus 10T, and I wasn’t the only one.

I really like the OnePlus 11, but I wasn’t expecting to like OxygenOS 13 much. My early impression of ColorOS 13 was good, but I didn’t trust the newly Oppo-ified OnePlus enough to think it would carry over. But after using, and loving, the OnePlus 11 for several weeks, I no longer feel any animosity towards OxygenOS. Have I simply become used to it, or has the software actually got better?
What’s the problem with OxygenOS?

Read more
This is the cheaper (and cooler) OnePlus 11 you wish you could buy
OnePlus 11R, a cheaper OnePlus 11, at the Cloud 11 event in India.

The OnePlus 11, in many ways, attempts to do over the shortcomings of the previous OnePlus flagships. While the OnePlus 11 feels closer to OnePlus's once-revered form, the company's strategy to launch flagship killers in niche markets such as India and China still keeps older OnePlus users attracted to the brand, despite its evolution in recent years. The OnePlus 11R — a $200 cheaper OnePlus 11 — is the latest phone that fits the picture that OnePlus purists long for.

OnePlus has spent the last few years facing the odds. By pivoting into the budget segment with its Nord series, OnePlus has been able to sell more units but at the cost of losing its grip on the "never settle" identity. OnePlus, which once enjoyed a cultdom for its clean software and hardware portraying parsimony, has attempted to keep fans in price-conscious markets (especially in Asia) with its R suffix series.

Read more