Edit Models filters

Tasks

Text Generation

Image-Text-to-Text

Parameters

Libraries

Transformers.js

sentence-transformers

Apps

Inference Providers

Models

173,607

Base only

Active filters: llama.cpp

NikolayKozloff/Mistral-Nemo-Instruct-2407-Q5_K_M-GGUF

12B • Updated Jul 22, 2024 • 132 • 2

YorkieOH10/Meta-Llama-3.1-8B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Jul 23, 2024 • 1.86k • 10

mlabonne/Meta-Llama-3.1-8B-Instruct-abliterated-GGUF

8B • Updated Aug 3, 2024 • 47.7k • 182

Lewdiculous/Lumimaid-v0.2-8B-GGUF-IQ-Imatrix

8B • Updated Dec 14, 2024 • 728 • 41

Lewdiculous/Lumimaid-v0.2-12B-GGUF-IQ-Imatrix

12B • Updated Dec 14, 2024 • 841 • 30

TheDrummer/Gemmasutra-Mini-2B-v1-GGUF

3B • Updated Aug 4, 2024 • 98.2k • 73

NousResearch/Hermes-3-Llama-3.1-8B-GGUF

8B • Updated Aug 23, 2024 • 24.7k • 150

bartowski/magnum-12b-v2.5-kto-GGUF

Text Generation • 12B • Updated Aug 15, 2024 • 2.64k • 9

PrunaAI/HiroseKoichi-L3-8B-Lunar-Stheno-GGUF-smashed

8B • Updated Mar 25 • 376 • 3

abetlen/Phi-3.5-vision-instruct-gguf

4B • Updated Oct 1, 2024 • 1.27k • 31

DavidAU/L3-Dark-Planet-8B-GGUF

Text Generation • 8B • Updated Dec 18, 2025 • 1.82k • 52

lmstudio-community/Yi-Coder-9B-Chat-GGUF

Text Generation • 9B • Updated Sep 5, 2024 • 539 • 18

bartowski/Qwen2.5-7B-Instruct-GGUF

Text Generation • 8B • Updated Sep 19, 2024 • 87.4k • 60

bartowski/OLMoE-1B-7B-0924-Instruct-GGUF

Text Generation • 7B • Updated Sep 17, 2024 • 1.92k • 10

bartowski/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • 8B • Updated Sep 19, 2024 • 76.2k • 52

Qwen/Qwen2.5-Coder-7B-Instruct-GGUF

Text Generation • 8B • Updated Nov 12, 2024 • 147k • 259

Qwen/Qwen2.5-Coder-1.5B-Instruct-GGUF

Text Generation • 2B • Updated Nov 12, 2024 • 75k • 52

smcleod/Qwen2.5-Coder-7B-Instruct-Q8_0-GGUF

Text Generation • 8B • Updated Sep 19, 2024 • 439 • 6

QuantFactory/Qwen2.5-0.5B-Instruct-GGUF

Text Generation • 0.5B • Updated Sep 19, 2024 • 981 • 3

TouchNight/Qwen2.5-14B_Uncencored-Q4_K_M-GGUF

Text Generation • 15B • Updated Sep 19, 2024 • 145 • 2

MaziyarPanahi/Llama-3.2-1B-Instruct-GGUF

Text Generation • 1B • Updated Sep 25, 2024 • 146k • 19

bartowski/Mistral-Small-22B-ArliAI-RPMax-v1.1-GGUF

Text Generation • 22B • Updated Sep 26, 2024 • 3.76k • 32

gpustack/bge-reranker-v2-m3-GGUF

Text Classification • 0.6B • Updated Sep 29, 2024 • 9.01k • 34

yannelli/Laravel-11-Llama-3.2-1B-Instruct-GGUF

Text Generation • 1B • Updated Oct 7, 2024 • 636 • 4

yannelli/Laravel-11-Llama-3.1-8B-Instruct-GGUF

Text Generation • 8B • Updated Oct 7, 2024 • 27 • 2

DavidAU/L3-DARKEST-PLANET-16.5B-GGUF

Text Generation • 17B • Updated Apr 28 • 4.23k • 88

bartowski/Mistral-NeMo-Minitron-8B-Instruct-GGUF

Text Generation • 8B • Updated Oct 10, 2024 • 2.63k • 10

mradermacher/LLAMA-3.2-1B-OpenHermes2.5-GGUF

1B • Updated Oct 28, 2024 • 199 • 1

MaziyarPanahi/Llama-3.2-3B-Instruct-uncensored-GGUF

Text Generation • 4B • Updated Oct 20, 2024 • 1.33k • 4

IlyaGusev/saiga_nemo_12b_gguf

12B • Updated Nov 19, 2024 • 2.62k • 104