Meta's Muse Spark Open: 816B-Parameter Model Now Available via Open Math OS

Key Info

SAIR Foundation announced on Open Math OS that Meta's Muse Spark Open is now available to all approved teams, featuring 816B total parameters with 42B active and a 1M-token context window.

Highlights

• Muse Spark Open has 816B total parameters, with 42B active per inference (mixture-of-experts style design).
• Context window is 1M tokens.
• Access is available now to all approved teams via Open Math OS.
• Teams must apply through the Open Math OS application link to get access.