Key Info

The Tencent Hunyuan (Hy) team held its first Reddit r/LocalLLaMA AMA and shared details not previously made public, including a smaller Hy4-mini model on the roadmap and the reasoning behind Hy4's architecture choices.

Highlights

  • A smaller model, Hy4-mini, is confirmed to be on the roadmap.
  • The team will consider a smaller open image model for local use, since Hy Image 3.0 is too large for most setups, and teased a video model coming soon.
  • For Hy4's final design, the team weighed GQA against MLA: MLA offers better model quality at the same KV cache size but has significantly higher compute intensity, making speculative decoding on inference GPUs compute-bound.
  • The team said DSA helped address the compute tradeoff, tipping the decision toward GQA.