Key Info

Tencent has released the open weights for Hy4, its natively multimodal flagship MoE model with 770B total and 49B active parameters and a 1M-token context window. The release includes a Hy4 System Card with a comprehensive safety evaluation report, plus GitHub, weights, GGUF, and license links.

Highlights

  • Hy4 is a natively multimodal MoE model: 770B total parameters, 49B active, 1M context.
  • Open weights are published alongside a System Card containing a full safety evaluation.
  • Distribution includes GitHub repo, model weights, GGUF builds, and a license.
  • Tencent will host a live AMA on r/LocalLLaMA, Friday 8–10 AM PT.