Instructions to use AutomatosX/AX-Unlimited-OCR-3B-MoE-MLX-AXQ-MXFP8 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use AutomatosX/AX-Unlimited-OCR-3B-MoE-MLX-AXQ-MXFP8 with MLX:
# Make sure mlx-vlm is installed # pip install --upgrade mlx-vlm from mlx_vlm import load, generate from mlx_vlm.prompt_utils import apply_chat_template from mlx_vlm.utils import load_config # Load the model model, processor = load("AutomatosX/AX-Unlimited-OCR-3B-MoE-MLX-AXQ-MXFP8") config = load_config("AutomatosX/AX-Unlimited-OCR-3B-MoE-MLX-AXQ-MXFP8") # Prepare input image = ["http://images.cocodataset.org/val2017/000000039769.jpg"] prompt = "Describe this image." # Apply chat template formatted_prompt = apply_chat_template( processor, config, prompt, num_images=1 ) # Generate output output = generate(model, processor, formatted_prompt, image) print(output) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- LM Studio
- Atomic Chat
Runtime format audit (2026-10-06)
No quantization-container correction was needed. This family has no n-gram tensors; no n-gram file or declaration was added. This remote format audit does not grant an oMLX/MTPLX runtime profile or a successful load/generation claim.
See runtime_audit.json for pinned config/index/header bindings, architecture, physical-format findings, and applied corrections. This is development evidence; no quality, MTP exactness, speed, or certification claim is added. Historical evidence stays bound to its original revision.
AX-Unlimited-OCR-3B-MoE-MLX-AXQ-MXFP8
Development AXQuant (AXQ) MXFP8 language MLX pack of
baidu/Unlimited-OCR
@ 07dea832e22aefee32ad281d4b80551282e1c168.
Language experts/attention/MLP and embeddings at native MXFP8 (group 32, physical repack of unrefined 8-bit allocations); dual vision (CLIP + SAM), projector, norms, MoE routers, and LM head BF16-preserved. Measured total 9.57 BPW.
Converted via MLX-VLM unlimited_ocr from
tokimoa/unlimited-ocr-mlx-bf16
@ cd57bdd8d4efa47a2e49c2123550cbd698ff529a, a community MLX BF16 remaster
that AutomatosX byte-verified against the upstream weights (592 direct +
6 conv-transpose + 33 packed-expert comparisons, zero differences).
Built with AXQuant 1.9.0 (plan-manual + convert --q-mode mxfp8,
--allow-unmeasured). Load smoke: mlx-vlm loads 616 modules. MXFP8 is a
physical repacking mode, not a measured planner method.
Claims
| Claim | Status |
|---|---|
| AXQuant architecture-prior / development quant | Yes |
| OCR accuracy / document-bench scores | Not claimed |
| Vision optimization | No — CLIP + SAM encoders + projector BF16-preserved |
| Certified release | No |
Attribution
Base weights © Baidu (MIT). BF16 remaster © tokimoa. Quantization by AXQuant (development).
- Downloads last month
- 150
8-bit
Model tree for AutomatosX/AX-Unlimited-OCR-3B-MoE-MLX-AXQ-MXFP8
Base model
baidu/Unlimited-OCR