Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

83

Base only

Active filters: ampere

halt95/Qwen3.8-Flash-Next-W4A16-Merlin

Image-Text-to-Text • 124B • Updated 9 days ago • 1.23k • 19

Winnougan/Wan2.2-INT8-Convrot

Updated Jul 1 • 36

JRamirez-UAB/Qwen3.6-35B-A3B-EXL3-4.00bpw-24GB

Image-Text-to-Text • 10B • Updated 3 days ago • 339 • 1

halt95/Swift1.5-Huihui-Qwen3.8-Flash-Next-W4A16-Merlin

Image-Text-to-Text • 124B • Updated 9 days ago • 318 • 4

imgailab/sdxl-trtx-bf16-ampere

Updated Aug 12, 2025 • 5

imgailab/flux1-schnell-bf16-ampere

Text-to-Image • Updated Aug 13, 2025

imgailab/flux1-dev-bf16-ampere

Text-to-Image • Updated Aug 13, 2025

imgailab/sdxl-bf16-ampere

Text-to-Image • Updated Aug 13, 2025

Winnougan/LTX-2.3-INT8

Updated Jun 27 • 21

sch0tten/Qwen3.5-27B-research-AWQ

Text Generation • 10B • Updated Jun 12 • 1.04k • 2

pranay5255/flash-attn-v2-ampere

Updated Apr 14 • 1

useful-quants/GLM-4.6V-Flash-W4A16-BF16Vision

Image-Text-to-Text • 10B • Updated Jun 18 • 20 • 2

useful-quants/InternVL3_5-4B-Instruct-W4A16-BF16Vision

Image-Text-to-Text • 5B • Updated Apr 30 • 7

useful-quants/Mistral-NeMo-Minitron-8B-Instruct-W4A16

Text Generation • 8B • Updated Apr 30 • 14

useful-quants/Phi-4-mini-instruct-W4A16

Text Generation • 4B • Updated Apr 30 • 18

useful-quants/Qwen3-4B-Instruct-2507-W4A16-G128

Text Generation • 4B • Updated May 6 • 12

useful-quants/Qwen3-VL-4B-Instruct-W4A16-BF16Vision

Image-Text-to-Text • 4B • Updated May 7 • 19

mattbucci/gemma-4-21B-REAP-AWQ

Image-Text-to-Text • 26B • Updated May 10 • 10

useful-quants/Ministral-3-3B-Instruct-2512-W4A16-BF16Vision

Text Generation • 4B • Updated Jun 11 • 10

aidendle94/diffusiongemma-26B-A4B-it-INT8-dynamic

Text Generation • 26B • Updated Jun 12 • 235 • 4

thad0ctor/torch2.12-cu133-cp312-wheels

Updated Jun 15 • 4

aleada/Pixtral-12B-W4A16

Image-Text-to-Text • 13B • Updated Sep 16 • 241 • 1

aleada/Llama-3.2-11B-Vision-Instruct-W4A16

Image-Text-to-Text • 11B • Updated Sep 16 • 327

aleada/Phi-4-mini-instruct-W4A16

Text Generation • 4B • Updated Sep 16 • 80

aleada/SmolLM3-3B-W4A16

Text Generation • 3B • Updated Sep 16 • 102

aleada/Phi-4-W4A16

Text Generation • 15B • Updated Sep 16 • 118

aleada/Gemma-3-12B-it-W4A16

Image-Text-to-Text • 12B • Updated Sep 16 • 25

Israeli-AI/DeepSeek-v4-flash-180b-W4A16-VOLTA-Ampere

Text Generation • 180B • Updated Sep 2 • 150 • 2

Relativ3pa1n/Laguna-S-2.1-W4A16

Text Generation • 22B • Updated Jul 25 • 27 • 1

Relativ3pa1n/Laguna-S-2.1-W8A16

Text Generation • 36B • Updated Jul 25 • 18