Tencent Releases Hy3: An Open 295B Mixture-of-Experts (MoE) Model with 21B Active Parameters and 256K Context
Tencent’s Hy workforce launched Hy3. Hy3 is a 295B-parameter Mixture-of-Experts (MoE) mannequin. It prompts solely 21B parameters per token. The weights ship below the Apache License 2.0. Hy3 is geared toward reasoning, agentic workflows, and long-context duties. What is Hy3? Hy3’s structure incorporates a sparse MoE with 192 consultants and top-8 routing. Only 8 consultants…
