Top Picks
Collection
Favs • 6 items • Updated • 1
How to use dicksondickson/Swift-1.5-Qwen3.8-27b-oQ5e-bf16-mtp-MLX with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] hf download dicksondickson/Swift-1.5-Qwen3.8-27b-oQ5e-bf16-mtp-MLX --local-dir Swift-1.5-Qwen3.8-27b-oQ5e-bf16-mtp-MLX
This model is a quantization of: https://huggingface.co/ukisai/Swift-1.5-Qwen3.8-27b
This checkpoint was quantized using oMLX 0.7.0rc1 with imatrix enabled.
Important tensors are left at bf16 which is for Apple M3 chips and later.
Apple M1/M2 use the fp16 variant.
Run the model using oMLX: https://github.com/jundot/omlx
5-bit