Key Info
Tencent released the open weights for Hy4, a natively multimodal MoE model with 770B total and 49B active parameters and 1M context, along with a System Card covering safety, security, and alignment evaluations.
Highlights
- Hy4 is a natively multimodal MoE model with 770B total parameters, 49B active parameters, and 1M context length.
- The System Card includes evaluations of frontier risks in cyber and bio, with further reviews by Tencent's Xuanwu, Zhuque, and Keen Labs.
- Independent safety and security testing was conducted by FangcunLeap and alice_dot_io.
- Tencent positions this as among the first to raise the bar for responsible AI in Asia.