Edit Models filters

Model Tree

Apps

Docker Model Runner

Inference Providers

OVHcloud AI Endpoints

HF Inference API

Misc

preference-optimization

Inference Endpoints

text-generation-inference

Eval Results (legacy)

text-embeddings-inference

4-bit precision

8-bit precision

Mixture of Experts

Carbon Emissions

Models

120

Base only

Active filters: preference-optimization

Nishef/SmolLM2-360M-Full_KNOWLEDGE_RETAINING_ENHANCED_KTO_20251227_151509-merged

Text Generation • 0.4B • Updated Dec 27, 2025 • 3

mjun/Qwen3-4B-KRX-Finance

LucyxDQ/SmolLM2-360M-Full_ORPO_20251225_062447-merged-Q4_K_M-GGUF

Text Generation • 0.4B • Updated Jan 18 • 13

AQ-MedAI/PulseMind-72B

Image-Text-to-Text • 73B • Updated Jan 30 • 8 • 2

mradermacher/PulseMind-72B-GGUF

Reinforcement Learning • 73B • Updated Jan 30 • 146

mradermacher/PulseMind-72B-i1-GGUF

Reinforcement Learning • 73B • Updated Jan 30 • 242 • 2

AnjanSB/Qwen2.5-3B-Instruct-NQ-RAG-DPO-LoRA

Text Generation • Updated Feb 17 • 14

marioparreno/emojify-dpo

Text Generation • 0.3B • Updated Feb 27 • 13

Auroraventures/cipher-simpo-merged

Text Generation • 33B • Updated Apr 18 • 4

stukenov/sozkz-fix-qwen-500m-kk-gec-v4

Text Generation • 0.4B • Updated Apr 26

joshuasundance/mypo-qwen2.5-coder-1.5b-dpo-v2

Text Generation • Updated Apr 23 • 26

joshuasundance/mypo-qwen2.5-coder-1.5b-dpo-v3

Text Generation • 2B • Updated Apr 23 • 14

cbyabush/gpt2-dpo-ultrafeedback

Text Generation • 0.1B • Updated May 30 • 6

ephrata123/tenacious-orpo-adapter

eyorg/tenacious-orpo-qwen25-7b

Text Generation • Updated May 2

bonneyjr/tenacious-judge-lora-v0.1

Text Generation • Updated May 2

Birkity/tenacious-judge

Text Generation • Updated May 2 • 2

nahdes/tenacious-critic-qwen3-1-7b-simpo-seed11

Text Generation • Updated May 2 • 3

eyobed7b/tenacious-bench-simpo-judge-v1

Dhanjo/llama2-security-dpo-merged-Q4_K_M-GGUF

Text Generation • 7B • Updated May 4 • 15

sageflow41/lfm2.5-350M-APEX-FINAL

0.4B • Updated May 8 • 1

plumliu/qwen35-9b-kuairand-recexplain-lora

Updated 22 days ago • 39 • 1

kjy84kjy/CAS4133_Assignment2_SimPO

1B • Updated May 21 • 1

Riacrdo/assn2-dpo-qwen2.5-1.5b-lora

Riacrdo/assn2-simpo-qwen2.5-1.5b-lora

Updated May 19 • 1

Riacrdo/assn2-simpo-qwen2.5-1.5b-merged

2B • Updated May 20 • 1

syntropy-ai/Soren-1-Small

Text Generation • 2B • Updated May 31 • 171 • 36

hihihikei/assn2-simpo

1B • Updated May 21 • 1

hwanuk16/assn2-dpo-best

Text Generation • 1B • Updated May 21 • 11

climba/hipster-flux-lora-artifacts

Text-to-Image • Updated May 22 •