Key Info
Tencent released the open weights for Hy4, its natively multimodal flagship MoE model, along with a system card containing a comprehensive safety evaluation report.
Highlights
- Hy4 is a mixture-of-experts model with 770B total parameters and 49B active parameters.
- It supports a 1M token context window.
- The release includes the Hy4 System Card with safety evaluations.
- A live AMA on r/LocalLLaMA is scheduled for Friday, 8–10 AM PT.