Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

442

Base only

Active filters: granite-4.0

ibm-granite/granite-4.0-350m

Text Generation • 0.4B • Updated Oct 23, 2025 • 18.1k • 70

ibm-granite/granite-4.0-tiny-base-preview

Text Generation • 7B • Updated Nov 3, 2025 • 197 • 34

ibm-granite/granite-4.0-tiny-preview

Text Generation • 7B • Updated Nov 3, 2025 • 58.9k • 184

SaisExperiments/granite-4.0-tiny-preview-Q8_0-GGUF

Text Generation • 7B • Updated Jul 11, 2025 • 21 • 1

bartowski/ibm-granite_granite-4.0-tiny-preview-GGUF

Text Generation • 7B • Updated Jul 11, 2025 • 1.17k • 5

mradermacher/granite-4.0-tiny-preview-GGUF

7B • Updated Jul 12, 2025 • 381

mradermacher/granite-4.0-tiny-base-preview-GGUF

7B • Updated Jul 12, 2025 • 474 • 1

mradermacher/granite-4.0-tiny-base-preview-i1-GGUF

7B • Updated Jul 12, 2025 • 228

mradermacher/granite-4.0-tiny-preview-i1-GGUF

7B • Updated Jul 12, 2025 • 124

elichen-skymizer/granite-4.0-tiny-base-preview-Q8_0-GGUF

7B • Updated Jul 17, 2025 • 20

elichen-skymizer/granite-4.0-tiny-base-preview-Q6_K-GGUF

7B • Updated Jul 17, 2025 • 16

elichen-skymizer/granite-4.0-tiny-base-preview-Q5_K_M-GGUF

7B • Updated Jul 17, 2025 • 19

elichen-skymizer/granite-4.0-tiny-base-preview-Q4_K_M-GGUF

7B • Updated Jul 17, 2025 • 12

elichen-skymizer/granite-4.0-tiny-base-preview-Q3_K_M-GGUF

7B • Updated Jul 17, 2025 • 11

Mungert/granite-4.0-tiny-preview-GGUF

Text Generation • 7B • Updated Sep 24, 2025 • 1.09k • 6

ibm-granite/granite-4.0-tiny-preview-GGUF

Text Generation • 7B • Updated Aug 12, 2025 • 1.1k • 6

ibm-granite/granite-4.0-tiny-base-preview-GGUF

7B • Updated Aug 12, 2025 • 396 • 2

mlx-community/granite-4.0-tiny-preview-8bit

Text Generation • 7B • Updated Sep 10, 2025 • 10 • 1

mlx-community/granite-4.0-tiny-preview-4bit

Text Generation • 7B • Updated Sep 10, 2025 • 77

ibm-granite/granite-4.0-h-micro

Text Generation • 3B • Updated Nov 3, 2025 • 10.7k • 148

ibm-granite/granite-4.0-micro

Text Generation • 3B • Updated Nov 3, 2025 • 46.7k • 275

ibm-granite/granite-4.0-h-small

Text Generation • 32B • Updated Nov 3, 2025 • 22.9k • 309

ibm-granite/granite-4.0-h-tiny

Text Generation • 7B • Updated Nov 3, 2025 • 52.5k • 208

ibm-granite/granite-4.0-h-micro-base

Text Generation • 3B • Updated Nov 3, 2025 • 1.25k • 35

ibm-granite/granite-4.0-h-tiny-base

Text Generation • 7B • Updated Nov 3, 2025 • 439 • 34

ibm-granite/granite-4.0-h-small-base

32B • Updated Nov 3, 2025 • 215 • 47

ibm-granite/granite-4.0-micro-base

Text Generation • 3B • Updated Nov 3, 2025 • 1.29k • 40

ibm-granite/granite-4.0-micro-GGUF

3B • Updated Apr 23 • 6.83k • 22

ibm-granite/granite-4.0-h-micro-GGUF

3B • Updated Apr 23 • 2.9k • 20

ibm-granite/granite-4.0-h-tiny-GGUF

7B • Updated Apr 23 • 4.01k • 28