Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

175

Base only

Active filters: ik_llama.cpp

Downtown-Case/GLM-4.6-128GB-RAM-IK-GGUF

Text Generation • 357B • Updated Dec 19, 2025 • 27 • 19

ubergarm/GLM-4.6-GGUF

Text Generation • 357B • Updated Oct 2, 2025 • 84 • 28

ubergarm/Ling-1T-GGUF

Text Generation • 1000B • Updated Oct 29, 2025 • 23 • 12

ubergarm/Kimi-K2-Thinking-GGUF

Text Generation • 1T • Updated Nov 20, 2025 • 96 • 22

ubergarm/GigaChat3-10B-A1.8B-GGUF

Text Generation • 11B • Updated Nov 21, 2025 • 223 • 13

sokann/GLM-4.5-GGUF-3.2162bpw

358B • Updated Nov 29, 2025 • 15

sokann/GLM-4.6-GGUF-3.2263bpw

357B • Updated Nov 30, 2025 • 9

ubergarm/Devstral-2-123B-Instruct-2512-GGUF

Text Generation • 125B • Updated Dec 10, 2025 • 15 • 7

ubergarm/GLM-4.7-GGUF

Text Generation • 358B • Updated Dec 24, 2025 • 106 • 26

ubergarm/Devstral-Small-2-24B-Instruct-2512-GGUF

Text Generation • 24B • Updated Dec 25, 2025 • 9 • 2

ubergarm/MiMo-V2-Flash-GGUF

Text Generation • 309B • Updated Jan 6 • 16 • 4

ubergarm/DeepSeek-V3.2-Speciale-GGUF

Text Generation • 671B • Updated Jan 9 • 52 • 20

ubergarm/GLM-4.7-Flash-GGUF

Text Generation • 30B • Updated Jan 21 • 114 • 24

ubergarm/Kimi-K2.5-GGUF

Text Generation • 1T • Updated Feb 6 • 16 • 11

ubergarm/Step-3.5-Flash-GGUF

Text Generation • 197B • Updated Feb 16 • 92 • 44

ubergarm/MiniMax-M2.5-GGUF

Text Generation • 229B • Updated Feb 15 • 110 • 51

ubergarm/GLM-5-GGUF

Text Generation • 754B • Updated Feb 15 • 38 • 16

ubergarm/Qwen3.5-397B-A17B-GGUF

Text Generation • 396B • Updated Apr 3 • 287 • 38

ubergarm/Qwen3-Coder-Next-GGUF

Text Generation • 80B • Updated Feb 26 • 298 • 21

ubergarm/Qwen3.5-122B-A10B-GGUF

Text Generation • 122B • Updated Mar 20 • 266 • 20

ubergarm/Qwen3.5-35B-A3B-GGUF

Text Generation • 35B • Updated Mar 16 • 232 • 10

ubergarm/Qwen3.5-27B-GGUF

Text Generation • 27B • Updated Apr 24 • 74 • 18

sokann/GLM-5-GGUF-1.594bpw

754B • Updated Mar 1 • 23 • 3

sokann/Qwen3.5-27B-GGUF-4.165bpw

27B • Updated Mar 13 • 38 • 8

KeinNiemand/Qwen3.5-122B-A10B-IK_GGUF

Text Generation • 122B • Updated Mar 13 • 45 • 1

Uninformed/GLM-4.7-Architect-355B-A32B-GGUF

Text Generation • 358B • Updated Mar 13 • 12 • 2

sokann/Qwen3.5-27B-GGUF-4.915bpw

27B • Updated Mar 13 • 24 • 6

sokann/Qwen3.5-27B-GGUF-4.151bpw

27B • Updated Mar 13 • 20 • 1

AlexanderKyng/Mistral-Small-119B-2603-ik-GGUF

Text Generation • 119B • Updated Apr 11 • 16

sokann/GLM-5.1-GGUF-1.673bpw

754B • Updated Apr 12 • 26 • 4