Models

11,617

Full-text search

Active filters: dpo

ToastyPigeon/Qwen3.5-27B-Marvin-DPO-V2

Text Generation • 28B • Updated 7 days ago • 112 • 11

sweepai/sweep-next-edit-v2-7B

Text Generation • 8B • Updated 7 days ago • 97 • 14

jpacifico/Chocolatine-2-4B-Instruct-DPO-v2.1

Text Generation • 4B • Updated about 4 hours ago • 1.97k • 7

F16/z-image-turbo-flow-dpo

Feature Extraction • Updated Mar 4 • 160

mlabonne/NeuralDaredevil-8B-abliterated

Text Generation • 8B • Updated Jan 23 • 16.3k • • 267

danielcherubini/Qwen3.5-DeltaCoder-9B-GGUF

Text Generation • 9B • Updated 6 days ago • 6.86k • 7

intrect/VELA

Text Generation • 8B • Updated 6 days ago • 681 • 2

nivvis/Qwen3.5-35B-A3B-EQ-v5

Text Generation • 35B • Updated 10 days ago • 1.15k • 5

bartowski/NeuralDaredevil-8B-abliterated-GGUF

Text Generation • 8B • Updated Jun 5, 2024 • 1.14k • 12

mlabonne/TwinLlama-3.1-8B-DPO

Text Generation • 8B • Updated Oct 6, 2024 • 22 • 22

ConicCat/Role-mo-V2-7B

Text Generation • 7B • Updated Jan 29 • 12 • 4

mradermacher/Role-mo-V2-7B-i1-GGUF

7B • Updated Jan 31 • 100 • 2

HuiyuWang/dpo-qwen-cot-merged

Text Generation • 4B • Updated Mar 1 • 49 • 1

mradermacher/G-Health-14B-instruct-i1-GGUF

15B • Updated 27 days ago • 15.8k • 1

MerlinSafety/HybridIntelligence-0.5B

Text Generation • 0.5B • Updated 24 days ago • 42 • 6

mradermacher/Qwen3.5-35B-A3B-heretic-v2-eq-v1-GGUF

35B • Updated 9 days ago • 2.15k • 1

pathcosmos/EVAFRILL-Mo-3B

Text Generation • Updated 12 days ago • 3.87k • 1

danielcherubini/Qwen3.5-DeltaCoder-9B

Text Generation • Updated 6 days ago • 252 • 3

empero-ai/openNemo-9B-Claude-Opus-4.6-distill

Text Generation • Updated 6 days ago • 2.76k • 2

abcsk123/Code-Centric-Align

Updated 13 days ago • 52 • 2

WYNN747/burmese-coder-4b-gguf

Text Generation • 7B • Updated 7 days ago • 313 • 2

Shubhamw11/gemma-3-270m-dpo-negative

Updated 5 days ago • 54 • 1

lyogavin/Anima33B-DPO-Belle-1k

Text Generation • Updated Jul 2, 2023 • 1

lyogavin/Anima33B-DPO-Belle-1k-merged

Text Generation • Updated Jul 2, 2023 • 5 • 12

daekeun-ml/Llama-2-ko-DPO-13B

Text Generation • 13B • Updated Oct 31, 2023 • 7 • 19

lewtun/zephyr-7b-dpo-full

Text Generation • 7B • Updated Jan 5, 2024 • 5

alignment-handbook/zephyr-7b-dpo-full

Text Generation • 7B • Updated Jan 10, 2024 • 29 • 3

alignment-handbook/zephyr-7b-dpo-qlora

Updated Jan 9, 2024 • 15 • 9

argilla/notus-7b-v1-lora

Text Generation • Updated Dec 4, 2023 • 6 • 7

argilla/notus-7b-v1-lora-adapter

Text Generation • Updated Dec 4, 2023 • 3