Models

bartowski/Faro-Yi-9B-DPO-GGUF

Text Generation • Updated May 24, 2024 • 320 • 4

vikarti-anatra/Faro-Yi-9B-DPO-gguf

Text Generation • 9B • Updated May 25, 2024 • 55 • 1

ggalmeida0/Faro-Yi-9B-DPO-Q8_0-GGUF

Text Generation • 9B • Updated May 26, 2024 • 4

StefanKrsteski/Phi-3-mini-4k-instruct-DPO-EPFL

Updated Jun 4, 2024 • 5

AliE02/NaturalLanguagePioneersDPO

Text Generation • 4B • Updated May 30, 2024 • 8

allenai/llama-3-tulu-2-dpo-70b

Text Generation • 71B • Updated Aug 5, 2024 • 69

allenai/llama-3-tulu-2-dpo-8b

Text Generation • Updated Aug 9, 2024 • 66 • 1

MoxoffSrL/Moxoff-Phi3Mini-KTO

Text Generation • 4B • Updated Jun 27, 2024 • 2.01k

MoxoffSrL/Moxoff-Phi3Mini-DPO

Text Generation • 4B • Updated Jun 27, 2024 • 2.04k

MoxoffSrL/Moxoff-Phi3Mini-ORPO

Text Generation • 4B • Updated Jun 27, 2024 • 2.03k

MoxoffSrL/Moxoff-Phi3Mini-PPO

Text Generation • 4B • Updated Jun 27, 2024 • 2.02k

hamishivi/OLMo-1B-0724-Instruct-hf

Text Generation • Updated Jul 17, 2024 • 9

mradermacher/llama-3-tulu-2-dpo-70b-GGUF

71B • Updated Jul 19, 2024 • 177

mradermacher/llama-3-tulu-2-dpo-8b-GGUF

8B • Updated Jul 20, 2024 • 205

mradermacher/llama-3-tulu-2-dpo-70b-i1-GGUF

71B • Updated Aug 2, 2024 • 273

mradermacher/llama-3-tulu-2-dpo-8b-i1-GGUF

8B • Updated Aug 2, 2024 • 226

allenai/llama-3.1-tulu-2-dpo-70b

71B • Updated Aug 15, 2024 • 61

allenai/llama-3.1-tulu-2-dpo-8b

8B • Updated Aug 15, 2024 • 68 • 2

depurator/llama-3.1-tulu-2-dpo-8b-Q4_K_M-GGUF

8B • Updated Aug 28, 2024 • 4

AINovice2005/ElEmperador

Text Generation • 7B • Updated Oct 16, 2024 • 20

mradermacher/ElEmperador-GGUF

7B • Updated Oct 14, 2024 • 193

miulab/llama2-7b-ultrafeedback-rm

Text Classification • 7B • Updated Oct 3, 2024 • 17 • 1

mradermacher/DPO_mistral_v01_7b_ultra_0131_1k_1epoch-GGUF

7B • Updated Nov 7, 2024 • 143

mradermacher/DPO_mistral_v01_7b_ultra_0130_1k-GGUF

7B • Updated Nov 7, 2024 • 153

tensorblock/Faro-Yi-9B-DPO-GGUF

Text Generation • 9B • Updated Jul 8 • 265

tensorblock/Moxoff-Phi3Mini-PPO-GGUF

4B • Updated Jul 8 • 170

tensorblock/Moxoff-Phi3Mini-ORPO-GGUF

4B • Updated Jul 8 • 161

tensorblock/Moxoff-Phi3Mini-KTO-GGUF

4B • Updated Jul 8 • 128

mradermacher/dolphin-2.6-mistral-7b-dpo-GGUF

7B • Updated Jul 15 • 193

mradermacher/dolphin-2.6-mistral-7b-dpo-i1-GGUF

7B • Updated Jul 15 • 437