Key Info

Tencent released the open weights for Hy4, its natively multimodal flagship MoE model, along with a system card containing a comprehensive safety evaluation report.

Highlights

  • Hy4 is a mixture-of-experts model with 770B total parameters and 49B active parameters.
  • It supports a 1M token context window.
  • The release includes the Hy4 System Card with safety evaluations.
  • A live AMA on r/LocalLLaMA is scheduled for Friday, 8–10 AM PT.