Models

11,731

Full-text search

Active filters: dpo

BugTraceAI/BugTraceAI-Apex-G4-26B-Q4

25B • Updated 1 day ago • 16.4k • 32

F16/z-image-turbo-flow-dpo

Feature Extraction • Updated 7 days ago • 167

danielcherubini/Qwen3.5-DeltaCoder-9B-GGUF

Text Generation • 9B • Updated 15 days ago • 8.65k • 11

VladShash/deepseek-math-7b-lean-prover-dpo-olmo-3

Text Generation • 7B • Updated 3 days ago • 3.69k • 3

sweepai/sweep-next-edit-v2-7B

Text Generation • 8B • Updated 17 days ago • 201 • 16

F16/z-image-turbo-masked-dpo

Text-to-Image • Updated 7 days ago • • 13

davidquicast/SmolLM2-FT-DPO-Medicina_es

Text Generation • 0.1B • Updated Jan 9, 2025 • 4 • 1

Chishui-Chen/robert-llm

Text Generation • Updated Jan 13 • 1

trentmkelly/gpt-4o-distil-Llama-3.3-70B-Instruct

Text Generation • Updated Feb 2 • 11 • 1

Yana/compass-vlm-phase2

Image-Text-to-Text • 9B • Updated about 4 hours ago • 1

Yana/compass-vlm

Image-Text-to-Text • 9B • Updated about 4 hours ago • 1

mradermacher/Qwen3.5-35B-A3B-heretic-v2-eq-v1-GGUF

35B • Updated 18 days ago • 2.53k • 2

danielcherubini/Qwen3.5-DeltaCoder-9B

Text Generation • Updated 15 days ago • 252 • 4

Fintacorp55/football-llm-q4

Text Generation • 8B • Updated 12 days ago • 636 • 2

piotreknow02/BugTraceAI-Apex-G4-26B-Master-GGUF

Text Generation • 25B • Updated 2 days ago • 2.97k • 1

rhemabible/BibleAI

Text Generation • 8B • Updated 1 day ago • 1.96k • 1

francescofiamingo1/FF_3.1

Text Generation • Updated about 5 hours ago • 1

mradermacher/gpt-4o-distil-Llama-3.1-8B-Instruct-PaperWitch-heresy-GGUF

8B • Updated Feb 19 • 755 • 5

BugTraceAI/BugTraceAI-Apex-G4-26B-Master-f16

25B • Updated 5 days ago • 96 • 1

lyogavin/Anima33B-DPO-Belle-1k

Text Generation • Updated Jul 2, 2023 • 1

lyogavin/Anima33B-DPO-Belle-1k-merged

Text Generation • Updated Jul 2, 2023 • 7 • 12

daekeun-ml/Llama-2-ko-DPO-13B

Text Generation • 13B • Updated Oct 31, 2023 • 8 • 19

lewtun/zephyr-7b-dpo-full

Text Generation • 7B • Updated Jan 5, 2024 • 3

alignment-handbook/zephyr-7b-dpo-full

Text Generation • 7B • Updated Jan 10, 2024 • 17 • 3

alignment-handbook/zephyr-7b-dpo-qlora

Updated Jan 9, 2024 • 7 • 9

argilla/notus-7b-v1-lora

Text Generation • Updated Dec 4, 2023 • 11 • 7

argilla/notus-7b-v1-lora-adapter

Text Generation • Updated Dec 4, 2023 • 3

argilla/notus-7b-v1

Text Generation • 7B • Updated Dec 5, 2023 • 155 • 123

ContextualAI/archangel_sft_pythia1-4b

Text Generation • 1B • Updated Jan 11, 2024 • 9

ContextualAI/archangel_sft_pythia2-8b

Text Generation • 3B • Updated Jan 11, 2024 • 6 • 1