Hy4 Preview Released: 770B-Parameter Open-Source Model with 1M Context

Key Info

Hy4 preview has been released, bringing a 770B-parameter model with 49B active parameters, a 1M context window, and an open-source, productivity-focused design at a consistent affordable price.

Highlights

• Massive scale: 770B total parameters with 49B active, likely using a Mixture-of-Experts architecture.
• 1M context window: Supports extremely long inputs for complex productivity tasks.
• Open source frontier: Weights and resources are available on Hugging Face and GitHub.
• Affordable and consistent pricing: Designed for practical, ongoing use.