Skip to main content
  1. Home
  2. Computing
  3. News

Google just changed how it grades the AI models you use for Android coding

Android Bench has a new testing framework and eight new models, so the rankings you remember are now out of date.

Add as a preferred source on Google
Android Bench featured.
Google

Google just changed how it measures which AI models are best at writing Android app code, and the update has shuffled the rankings developers use to pick their tools. The company’s Android Bench leaderboard, which launched in March, now runs on a new testing system called Harbor. Google says this replaces the older, more generic testing tool it used before, and gives a better read on how models perform on real Android tasks, like updating old code to Jetpack Compose or handling wearable device networking.

New models shake up the top of the list

Since the testing tool changed, Google ran every model through it again. Eight new models were added to the leaderboard, including Claude Fable 5, Claude Sonnet 5, Claude Opus 4.8, GLM 5.2, Kimi K2.7 Code, MiniMax M3, Qwen 3.7 Plus, and Qwen 3.7 Max.

Claude Fable 5 now sits at the top with a score of 84.5 percent, followed by GPT 5.5 at 80.2 and Claude Sonnet 5 at 76.2. Among free, open-weight models, GLM 5.2 leads with 72.2 percent, ahead of Kimi K2.7 Code at 70.4. Google’s own Gemini 3.1 Pro is placed fifth with a score of 73.7 percent. If you refer to Android Bench to pick the right model for your coding work, you should head over to the Android Bench website and check the refreshed leaderboard.

Developers can now submit their own test tasks

When Google launched Android Bench in March, it published its testing methodology and test harness on GitHub for transparency. Now, it’s taking that open approach further by letting developers contribute their own Android development tasks to the benchmark. Developers can also run the tests themselves with their preferred models and share the results with the community.

Recommended Videos

The rankings are most likely to change as more new models show up, like OpenAI’s recently released GPT-5.6 Sol, Terra, and Luna. If you’re picking an AI tool for Android coding, treat the current leaderboard as a snapshot, not a permanent ranking, and check back before you commit to one for your next project.

Pranob Mehrotra
Pranob is a seasoned tech journalist with over eight years of experience covering consumer technology. His work has been…
Google is testing an AI-first homepage, and the Search button is reportedly taking a back seat
A quietly spotted redesign shows Google testing life without its own Search button.
Google Chrome with Gemini

For years, the Search button has been an integral part of the Google Search experience. However, right now, typing "google.com" into a browser is reportedly bringing up a new simplified layout that doesn’t include the Search button anymore (for a select group of signed-out users). 

It appears that the search giant is testing a new, AI-first layout with three dedicated buttons, which are new for traditional Google Search users, but familiar for those who use the Gemini chatbot on a regular basis.  

Read more
The FCC wants to ban some drones it already approved. Yeah, this is getting complicated.
FCC considers expanding drone restrictions to previously approved DJI models
dji drone

The US Federal Communications Commission is considering a move that could make things pretty awkward for drone buyers. The agency wants to expand its existing restrictions to cover certain drones with features such as LiDAR sensing, thermal imaging, and aerosol-dispersing systems. The weird part? Some of these drones were already approved for sale in the US.

In a report by DJI's own blog, this new development puts several DJI models in the spotlight, including the Air 3S, Avata 360, and Mini 5 Pro. Under the proposal, these drones could potentially be pulled from the US market, even though the FCC had previously cleared them. And no, if you already own one, the government isn't coming to take it away.

Read more
Hoy combines AirDrop, Loom, and voice messages in the Mac menu bar
The pre-release app lets Mac users send files, voice notes, and screen recordings without bouncing between separate tools
Person, Text, Electronics

Hoy wants sending something from your Mac to feel as casual as dropping a file onto someone’s desk. Instead of opening another app, you drag it onto that person’s face sitting in the menu bar.

https://twitter.com/heyiamdk/status/2082151995687748064

Read more