Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

1,531

Base only

Active filters: auto-round

fbaldassarri/HuggingFaceTB_SmolLM2-1.7B-Instruct-auto_gptq-int4-gs128-sym

Text Generation • 2B • Updated Jan 4, 2025 • 18

OPEA/Meta-Llama-3.1-70B-Instruct-int4-asym-inc

11B • Updated Apr 30, 2025 • 6 • 1

OPEA/Qwen2.5-32B-Instruct-int4-sym-mixed-inc

6B • Updated Apr 30, 2025 • 142 • 1

OPEA/Qwen2.5-14B-Instruct-int4-sym-inc

3B • Updated Apr 30, 2025 • 100

OPEA/Meta-Llama-3.1-8B-Instruct-int4-sym-inc

2B • Updated Jun 5, 2025 • 66

OPEA/Qwen2-VL-7B-Instruct-int4-sym-inc

3B • Updated Jun 5, 2025 • 99 • 1

OPEA/Phi-3.5-vision-instruct-int4-sym-inc

Updated Apr 30, 2025 • 20

OPEA/Qwen2.5-7B-Instruct-int4-sym-inc

2B • Updated Apr 30, 2025 • 28 • 1

OPEA/Llama-3.2-11B-Vision-Instruct-int4-sym-inc

3B • Updated Jun 5, 2025 • 181 • 2

OPEA/llava-v1.5-7b-int4-sym-inc

1B • Updated Jul 18, 2025 • 24 • 1

OPEA/Qwen2.5-72B-Instruct-int4-sym-inc

12B • Updated Apr 30, 2025 • 11 • 1

OPEA/Llama-3.2-90B-Vision-Instruct-int4-sym-inc

14B • Updated Jul 18, 2025 • 25

OPEA/Qwen2.5-0.5B-Instruct-int4-sym-inc

0.2B • Updated Sep 11, 2025 • 30.7k

OPEA/Qwen2.5-1.5B-Instruct-int4-sym-inc

0.4B • Updated Sep 23, 2025 • 615

OPEA/Qwen2.5-3B-Instruct-int4-sym-inc

0.7B • Updated Apr 30, 2025 • 7

OPEA/QwQ-32B-Preview-int4-sym-mixed-inc

6B • Updated Apr 30, 2025 • 6 • 8

OPEA/glm-4-9b-chat-int4-sym-inc

2B • Updated Apr 30, 2025 • 12

OPEA/Meta-Llama-3.1-70B-Instruct-int4-sym-inc

11B • Updated Apr 24, 2025 • 9 • 1

OPEA/glm-4-9b-chat-int4-sym-lm-head-inc

2B • Updated Apr 30, 2025 • 16

OPEA/internlm2_5-7b-chat-int4-sym-inc

2B • Updated Apr 30, 2025 • 6

OPEA/Marco-o1-int4-sym-inc

2B • Updated Apr 30, 2025 • 5

OPEA/SmolVLM-Instruct-int4-sym-inc

0.9B • Updated Jul 18, 2025 • 45 • 3

OPEA/Phi-3.5-vision-instruct-qvision-int4-sym-inc

Updated Apr 30, 2025 • 25 • 1

OPEA/Llama-3.2-11B-Vision-Instruct-qvision-int4-sym-inc

2B • Updated Jul 18, 2025 • 149 • 1

OPEA/cogvlm2-llama3-chat-19B-qvision-int4-sym-inc

4B • Updated Jul 18, 2025 • 15 • 1

OPEA/DeepSeek-V2-Lite-int4-sym-inc

3B • Updated Apr 30, 2025 • 70 • 1

OPEA/glm-4v-9b-int4-sym-inc

7B • Updated Jul 18, 2025 • 7

OPEA/OLMo-2-1124-13B-Instruct-int4-sym-inc

3B • Updated Apr 30, 2025 • 6

OPEA/OLMo-2-1124-7B-Instruct-int4-sym-inc

2B • Updated Apr 30, 2025 • 11

OPEA/Llama-3.1-Nemotron-70B-Instruct-HF-int4-sym-inc

11B • Updated Apr 24, 2025 • 10