Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

23,985

Base only

Active filters: llama-cpp

deadbydawn101/RavenX-CyberAgent-Qwen3.6-35B-A3B-Opus-4.7-OpenMythos-Pentester-BugHunter-RATH-GGUF

Text Generation • 36B • Updated 6 days ago • 10.5k • 52

prithivMLmods/VibeThinker-3B-GGUF

Text Generation • 3B • Updated 3 days ago • 12k • 25

barozp/Qwen3.6-28B-REAP20-A3B-GGUF

Text Generation • 28B • Updated Apr 19 • 22.1k • 39

mitkox/FastContext-1.0-4B-SFT-Q4_K_M-GGUF

4B • Updated 4 days ago • 983 • 9

spiritbuun/buun-Qwen3.6-chat_template

Updated 22 days ago • 49

oussaber/VibeThinker-3B-Q4_K_M-GGUF

Text Generation • 3B • Updated 3 days ago • 2.36k • 6

prism-ml/Ternary-Bonsai-8B-gguf

Text Generation • 8B • Updated 9 days ago • 13.6k • 99

mitkox/FastContext-1.0-4B-SFT-Q5_K_M-GGUF

4B • Updated 4 days ago • 379 • 5

RavichandranJ/Dolphin3-Cyber-8B-GGUF

Text Generation • 8B • Updated 11 days ago • 16.5k • 22

deadbydawn101/gemma-4-E4B-Agentic-Opus-Reasoning-GeminiCLI-GGUF

Text Generation • 8B • Updated Apr 16 • 5.94k • 19

LocalAI-io/privacy-filter-multilingual-GGUF

Token Classification • 1B • Updated 1 day ago • 677 • 5

prithivMLmods/gemma-4-12B-it-heretic_decensored-GGUF

Image-Text-to-Text • 12B • Updated 2 days ago • 1.48k • 4

Tesslate/OmniCoder-9B-GGUF

9B • Updated Mar 12 • 14.9k • 310

prism-ml/Bonsai-8B-gguf

Text Generation • 8B • Updated Apr 18 • 17.5k • 720

prithivMLmods/Holo-3.1-9B-GGUF

Image-Text-to-Text • 9B • Updated 17 days ago • 79k • 7

JohnRoger/VibeThinker-3B-Q8_0-GGUF

Text Generation • 3B • Updated 3 days ago • 1.39k • 3

aiplatforms/mistral-24b-ru-uncensored-gguf

Text Generation • 24B • Updated May 7 • 783 • 6

squ11z1/gpt-oss-nano

Text Generation • 9B • Updated 17 days ago • 3.35k • 22

sillykiwi/Qwen3-4B-Cybersecurity-Heretic-16bit-Q4_K_M-GGUF

Text Generation • 4B • Updated Apr 3 • 687 • 6

prism-ml/Ternary-Bonsai-4B-gguf

Text Generation • 4B • Updated 9 days ago • 2.64k • 17

rico03/Qwen3.6-27B-Claude-Opus-Reasoning-Distilled-GGUF

Text Generation • 27B • Updated Apr 23 • 19.4k • 47

brunopio/Qwen3.5-14B-A3B-Claude-4.6-Opus-Reasoning-Distilled-reap-Q4_K_M-GGUF

Text Generation • 14B • Updated 24 days ago • 6.13k • 10

ThePradip/minicpm5-1b-kids-storyteller-GGUF

Text Generation • 1B • Updated 5 days ago • 944 • 2

prithivMLmods/Gemma4-BLIP3o-Captioner-5B

Image-Text-to-Text • 5B • Updated 7 days ago • 1.5k • 2

FlameF0X/Apodex-1.0-mini-Q4_K_M-GGUF

Text Generation • 36B • Updated 7 days ago • 244 • 3

cfontes/GLM-5.2-Q4_K_M-GGUF

Text Generation • 753B • Updated 1 day ago • 347 • 2

LeroyDyer/Mixtral_AI_Cyber_Dolphin-Q4_K_M-GGUF

7B • Updated Aug 26, 2024 • 38 • 2

RachidAR/ablation-model-fineweb-v1-Q6_K-GGUF

2B • Updated Apr 23, 2024 • 6 • 1

NoelJacob/Meta-Llama-3-8B-Instruct-Q4_K_M-GGUF

Text Generation • 8B • Updated Apr 24, 2024 • 651 • 3

elyza/Llama-3-ELYZA-JP-8B-GGUF

8B • Updated Jun 26, 2024 • 2.38k • 75