|

Meta AI Releases Muse Glimmer: A 30B Open-Weights Agentic Model That Runs on One Consumer GPU

ByRicardo

Meta has launched Muse Glimmer, a 30-billion-parameter multimodal mannequin distilled from Muse Spark. It is tuned for always-on native agent workflows, and ships underneath Apache 2.0. A 30B mannequin usually wants over 55 GB of reminiscence at full precision. Meta compresses it to roughly 4-bit, then provides block-level speculative decoding so it solutions quick sufficient to sit down inside an actual agent loop. The end result runs on one client GPU or a Mac, with no community name.

Is it deployable?

Yes, the weights are open underneath Apache 2.0. The Hugging Face collection carries BF16 weights, GGUF k-quants, ExecuTorch builds, and the DFlash drafter. Self-hosting is the day-one path.

  • Which firms: Solo builders and startups can run it on one 24 GB GPU or an M4/M5 Max Mac. Mid-market groups get on-prem inference with out a per-token invoice. Regulated enterprises get an air-gappable agent. Meta advises including system-level guardrails slightly than delivery the mannequin as a naked endpoint.
  • Industries: Healthcare, authorized, monetary providers, protection and public sector, manufacturing, and discipline service. These are the settings the place information residency, offline operation, or latency rule out a cloud name.
  • Applications: Desktop brokers that learn screenshots, coding brokers, and schema-based perform calling. Also doc and chart understanding, artificial information era, and LLM-as-a-judge analysis.