Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

142

Base only

Active filters: ONNX

smcleod/multitalker-parakeet-streaming-0.6b-v1-onnx-int8

Updated Feb 20 • 5

pltobing/streaming-speech-translation

Audio-to-Audio • 4B • Updated 26 days ago • 1 • 5

Intel/gpt-j-6B-int8-dynamic-inc

Text Generation • Updated Apr 19, 2023 • 9 • 16

Intel/gpt-j-6B-int8-static-inc

Text Generation • Updated Apr 19, 2023 • 14 • 9

funasr/Paraformer-large

Automatic Speech Recognition • Updated 17 days ago • 173 • 61

Neus/Onnx_DeepDanbooru

Text-to-Image • Updated Jul 9, 2023 • 1

Neus/GFPGANv1.4

Text-to-Image • Updated Jul 9, 2023 • 5

Neus/CommonModels

Text-to-Image • Updated Dec 3, 2023 • 2

vgorce/distilbert-base-multi-cased-ner

Token Classification • Updated Dec 8, 2023 • 5 • 1

amd/HRNet

Image Segmentation • Updated Jan 9, 2024 • 3

amd/retinaface

Updated Mar 29, 2024 • 15

yilunzhang/all-mpnet-base-v2-onnx

Sentence Similarity • Updated Jan 4, 2024 • 5

philipchung/bge-m3-onnx

Feature Extraction • Updated Apr 4, 2024 • 85 • 2

microsoft/Phi-3-mini-4k-instruct-onnx

Text Generation • Updated Dec 10, 2025 • 255 • 146

microsoft/Phi-3-mini-128k-instruct-onnx

Text Generation • Updated May 30, 2025 • 81 • 193

renwoshin/Phi-3-mini-128k-instruct-onnx-tf

Text Generation • Updated Apr 26, 2024 • 17 • 1

Xenova/Phi-3-mini-4k-instruct

Text Generation • Updated Mar 6, 2025 • 513 • 22

Xenova/Phi-3-mini-4k-instruct_fp16

Text Generation • Updated Mar 6, 2025 • 118 • 5

microsoft/Phi-3-mini-4k-instruct-onnx-web

Text Generation • Updated May 30, 2024 • 137 • 27

FusionQuill/Phi-3-mini-128k-instruct-onnx

Text Generation • Updated May 17, 2024 • 3

microsoft/Phi-3-small-8k-instruct-onnx-cuda

Text Generation • Updated Jan 23 • 49 • 14

microsoft/Phi-3-medium-4k-instruct-onnx-cpu

Text Generation • Updated Jan 23 • 51 • 7

microsoft/Phi-3-medium-4k-instruct-onnx-cuda

Text Generation • Updated Jan 23 • 51 • 11

microsoft/Phi-3-medium-4k-instruct-onnx-directml

Text Generation • Updated Jan 23 • 51 • 10

microsoft/Phi-3-medium-128k-instruct-onnx-cpu

Text Generation • Updated Jan 23 • 58 • 14

microsoft/Phi-3-medium-128k-instruct-onnx-cuda

Text Generation • Updated Jan 23 • 76 • 24

microsoft/Phi-3-medium-128k-instruct-onnx-directml

Text Generation • Updated Jan 23 • 47 • 6

microsoft/Phi-3-vision-128k-instruct-onnx-cpu

Text Generation • Updated Nov 14, 2024 • 74 • 30

microsoft/Phi-3-vision-128k-instruct-onnx-cuda

Updated Nov 14, 2024 • 51 • 27

microsoft/Phi-3-vision-128k-instruct-onnx-directml

Text Generation • Updated Nov 14, 2024 • 49 • 8