Key Info
MiniMax-M3.1-Flash is now available as open weights, and NVIDIA's NeMo team provided day-0 fine-tuning support for it in NeMo-AutoModel.
Highlights
- Day-0 fine-tuning support added in NVIDIA NeMo-AutoModel
- Supports FSDP2, expert parallelism, pipeline parallelism and context parallelism
- Scales up to 128 GPUs
- The model was reportedly trained on 200T+ tokens before release and is now open weights