Skip to main content
  1. Home
  2. Computing
  3. News

Meta’s new AI model runs entirely offline, but your GPU needs to keep up

Meta drops a free 30 billion parameter AI model that lives entirely on your desktop.

Add as a preferred source on Google
meta-logo
Meta

Meta has a new AI model out, and for once, the biggest headline isn’t about capability; it’s about freedom. Muse Glimmer, sitting around 30 billion parameters, ships with an Apache 2.0 license, meaning the weights on Hugging Face are yours to download, modify, and build on top of, no permission needed. You can simply run it on a graphics card on your local machine, no server farm or online connectivity required. 

Meta’s Superintelligence Lab took its larger Muse Spark and essentially had it teach a smaller, leaner version to think as it does. Muse Glimmer accepts both text and image inputs, though it only answers in text. It supports over 100 languages, remembers conversations stretching past 131,000 tokens, and its knowledge stops at January 4, 2026.

How much RAM do you need?

At full precision, Muse Glimmer would eat up 64GB of video memory, way more than most people have lying around, especially in this AI-inflated RAM pricing age. Meta gets around this with quantization, a method that compresses the numbers the model uses so it takes up far less space. That shrinks the language portion to under 20GB.

Two versions are available. K-Quant-Dynamic requires 32GB and barely loses any accuracy (0.2%), while K-Quant-17GB squeezes into 24GB with a slightly bigger, 1% accuracy hit. In real terms, that means you need at least an RTX 5090, RTX 4090, RTX 3090, or a Mac with an Apple Silicon Max chip.

Does it actually feel fast?

Meta paired the model with an accelerator called DFlash that predicts multiple tokens at once instead of one at a time. On an RTX 5090, that pushes speeds from 74.9 tokens per second to 233.4, over three times faster. 

Compared to Google’s Gemma4 and Alibaba’s Qwen3.6, Muse Glimmer leads in planning and multi-step tasks but falls behind when it comes to actually operating a desktop. You can grab it now through Hugging Face or LM Studio if you have the compatible hardware.

Rachit Agarwal
Rachit is a seasoned tech journalist with over ten years of experience covering the consumer technology landscape.
Google and Cathay Pacific are using AI to tackle aviation’s overlooked climate problem
A third of aviation's climate impact comes from contrails most people never think about.
Aircraft, Flight, Transportation

Those wispy white lines trailing behind airplanes (called contrails) sure look harmless from the ground, but they're doing more damage to the climate than we realize.

As part of Operating Blue Skies, Google has partnered with Cathay Pacific, one of the major international airlines operating both passenger and cargo flights, to test and deploy AI-driven contrail mitigation technology across a region where air travel is growing faster than anywhere else: Asia Pacific. 

Read more
As AI takes over schools, teachers are going back to basics to curb AI cheating
AI detectors kept getting it wrong, so schools are trying something that actually works.
ChatGPT on iPhone

Last year, teachers spent most of their energy trying to catch students using ChatGPT to write essays. This year, many have decided that's a losing battle, especially since the detectors meant to catch cheaters have been burning innocent students instead. 

A Bloomberg investigation found popular tools like GPTZero and Copyleaks wrongly flagged pre-ChatGPT college essays as AI-written, and one UC Davis senior was accused of cheating and handed a zero on his midterm, purely based on a detector's score, even though he wrote every word himself.

Read more
Meta’s Muse agent is getting closer, and it might take over your to-do list
Meta’s upcoming AI life manager does more than just answer questions.
Meta Logo

While most people's idea of AI is just a chatbot, agentic uses help build them as something more. Finding an email attachment, remembering a deadline, or following up on something that many people can take advantage of. Meta’s upcoming Muse agent is coming in as that solution.

Early screenshots shared by TestingCatalog show a personal assistant that can proactively handle everyday tasks and keep track of longer-term goals. The agent has reportedly moved from internal testing into a limited closed alpha, with invite-code functionality now appearing alongside its waitlist.

Read more