Key Info
Hy4 Flash now has 4-bit and 8-bit MLX checkpoints published on Hugging Face for Apple Silicon, both including MTP support, with a TensorFold update enabling local execution.
Highlights
- Two quantization variants available: 4-bit MLX MTP and 8-bit MLX MTP
- Checkpoints hosted on Hugging Face for Apple Silicon devices
- TensorFold update released the same day to run Hy4 Flash locally
- Extends Hy4 Flash beyond cloud to on-device Mac inference