Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,563

Base only

Active filters: granite

mradermacher/granite-3b-code-instruct-i1-GGUF

3B • Updated Mar 3, 2025 • 5.79k • 1

mradermacher/granite-8b-code-base-i1-GGUF

8B • Updated Dec 16, 2024 • 1.75k • 1

mradermacher/granite-20b-code-instruct-i1-GGUF

20B • Updated Dec 16, 2024 • 5.38k

mradermacher/granite-34b-code-instruct-i1-GGUF

34B • Updated Dec 16, 2024 • 2.87k

mradermacher/granite-8b-code-instruct-i1-GGUF

8B • Updated Dec 16, 2024 • 5.35k • 1

ibm-granite/granite-3b-code-instruct-128k

Text Generation • 3B • Updated Apr 25 • 805 • 13

ibm-granite/granite-8b-code-instruct-128k

Text Generation • 8B • Updated Apr 25 • 1.38k • 25

QuantFactory/granite-7b-lab-GGUF

Text Generation • 7B • Updated Jul 20, 2024 • 933 • 1

mradermacher/granite-8b-code-instruct-128k-GGUF

8B • Updated Jul 29, 2024 • 1.13k • 1

aifoundry-org/granite-8b-code-instruct-128k-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 1, 2024 • 56 • 1

charlescai2016/granite-8b-code-instruct-128k-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 3, 2024 • 51

sdalemorrey/granite-8b-code-instruct-128k-Q8_0-GGUF

Text Generation • 8B • Updated Aug 5, 2024 • 18

TobDeBer/granite-8b-code-instruct-128k-Q4_K_M-GGUF

Text Generation • 8B • Updated Aug 8, 2024 • 33

ibm-research/PowerLM-3b

Text Generation • 4B • Updated Sep 16, 2024 • 37.6k • 21

mradermacher/granite-20b-code-base-GGUF

20B • Updated Dec 16, 2024 • 1.98k

mradermacher/granite-20b-code-base-i1-GGUF

20B • Updated Dec 16, 2024 • 1.91k • 1

legraphista/granite-20b-code-instruct-IMat-GGUF

Text Generation • 20B • Updated Sep 1, 2024 • 2.91k

mradermacher/granite-3b-code-base-128k-GGUF

3B • Updated Sep 4, 2024 • 804

mradermacher/granite-3b-code-base-2k-GGUF

3B • Updated Sep 3, 2024 • 2.49k

mradermacher/granite-3b-code-instruct-2k-GGUF

3B • Updated Sep 4, 2024 • 2.76k

mradermacher/granite-3b-code-base-2k-i1-GGUF

3B • Updated Sep 3, 2024 • 4.4k

mradermacher/granite-8b-code-base-128k-GGUF

8B • Updated Sep 3, 2024 • 2.99k

mradermacher/granite-8b-code-base-128k-i1-GGUF

8B • Updated Sep 4, 2024 • 5.98k • 1

mradermacher/granite-8b-code-base-4k-GGUF

8B • Updated Sep 4, 2024 • 1.31k

mradermacher/granite-8b-code-instruct-4k-GGUF

8B • Updated Feb 3, 2025 • 2.06k

mradermacher/granite-20b-code-base-8k-GGUF

20B • Updated Sep 4, 2024 • 2.38k

mradermacher/granite-20b-code-instruct-8k-GGUF

20B • Updated Sep 3, 2024 • 2.65k

mradermacher/granite-20b-code-instruct-8k-i1-GGUF

20B • Updated Sep 6, 2024 • 4.83k

mradermacher/granite-34b-code-base-8k-GGUF

34B • Updated Sep 4, 2024 • 1.75k

mradermacher/granite-3b-code-base-128k-i1-GGUF

3B • Updated Sep 4, 2024 • 2.75k