Edit Models filters

Model Tree

Apps

Docker Model Runner

Unsloth Desktop

Inference Providers

OVHcloud AI Endpoints

HF Inference API

One-click Deployment

Inference Endpoints

Microsoft Foundry

Amazon SageMaker AI

Misc

Mixture of Experts

4-bit precision

8-bit precision

Carbon Emissions

Models

13,680

Base only

Active filters: dpo

NU-World-Model-Embodied-AI/phyworld

Video-to-Video • Updated Aug 7 • 22

mradermacher/Qwen2.5-Coder-1.5B-Unsensored-DPO-GGUF

2B • Updated Feb 4 • 1.21k • 2

CEIA-RL/energy-exp1-dpo-offline

Text Generation • 4B • Updated May 31 • 187 • 8

ewin-reg/MiniCPM5-1B-Agentic-Tooluse-GGUF

Text Generation • 1B • Updated Jul 29 • 1.53k • 91

ewin-reg/MiniCPM-V-4.7-1B-Agentic-FwS

Image-Text-to-Text • 2B • Updated about 20 hours ago • 163 • 2

mradermacher/tinybrainbot-360m-a75m-v5-instruct-GGUF

0.4B • Updated 4 days ago • 222 • 2

Phase-Technologies/Densy-330M-Chat

Text Generation • 0.5B • Updated 3 days ago • 47 • 2

wxzhang/dpo-selective-redteaming

Text Generation • 7B • Updated May 19, 2024 • 120 • 6

mlabonne/NeuralDaredevil-8B-abliterated

Text Generation • 8B • Updated Jan 23 • 15.4k • • 298

F16/z-image-turbo-flow-dpo

Feature Extraction • Updated Apr 9 • 206

danielcherubini/Qwen3.5-DeltaCoder-9B-GGUF

Text Generation • 9B • Updated Apr 1 • 2.97k • 20

BugTraceAI/BugTraceAI-Apex-G4-26B-Q4

25B • Updated May 11 • 1.34k • 99

Kyleyee/DrDPO_hh-seed3

Text Generation • 2B • Updated Apr 28 • 13 • 1

duarteocarmo/AMALIA-9B-0626-DPO-GGUF

Text Generation • 9B • Updated Jul 1 • 377 • 8

c4tdr0ut/grok-oss-Apollyon-24B

Text Generation • 24B • Updated Jul 9 • 2.27k • • 13

c4tdr0ut/grok-oss-Apollyon-8B

Text Generation • 8B • Updated Jul 9 • 5.52k • • 14

prism-drift/qwen35-m0-v4-postfix-rl-checkpoints

Reinforcement Learning • Updated Aug 30 • 1

mradermacher/DPO-trained-Qwen2.5-Python-Coder-7B-i1-GGUF

8B • Updated Sep 17 • 2.95k • 1

Atharva31/indicslm-from-scratch

Text Generation • Updated 26 days ago • 318 • 1

KeyFicller/tiny-llm-pipeline-29m

Text Generation • Updated 4 days ago • 1

SwapnilS-15/qwen2.5-0.5b-instructv2-fc

Text Generation • 0.5B • Updated 11 days ago • 26 • 1

wesjos/Qwen3.5-4B-StreetTalk-GGUF

Text Generation • 4B • Updated 7 days ago • 205 • 1

zaydsyed/TactLM-Instruction-DPO-Qwen2.5-0.5B

Text Generation • 0.5B • Updated 3 days ago • 29 • 1

zaydsyed/TactLM-Instruction-DPO-GRPO-Qwen2.5-0.5B

Text Generation • 0.5B • Updated 3 days ago • 35 • 1

hokseng789/Qwen3-0.6B-French-DPO

Text Generation • 0.6B • Updated 6 days ago • 29 • 1

nkthebass/tinybrainbot-360m-a75m-v5-instruct

Text Generation • 0.4B • Updated 5 days ago • 88 • 1

aaronr43210/MiniSEAL

Text Generation • Updated 5 days ago • 1

lyogavin/Anima33B-DPO-Belle-1k

Text Generation • Updated Jul 2, 2023 • 1

lyogavin/Anima33B-DPO-Belle-1k-merged

Text Generation • Updated Jul 2, 2023 • 182 • 12

daekeun-ml/Llama-2-ko-DPO-13B

Text Generation • 13B • Updated Oct 31, 2023 • 29 • 19