-
-
-
-
-
-
Inference Providers
Active filters:
8-bit
nhotin/vistral7B-legalbizai-q8-gguf
Text Generation
•
7B
•
Updated
•
4
XelotX/WizardLM-2-8x22B-XelotX-iQuants
Text Generation
•
141B
•
Updated
•
208
RedHatAI/Qwen2-0.5B-Instruct-quantized.w8a8
Text Generation
•
0.6B
•
Updated
•
132
RedHatAI/Qwen2-7B-Instruct-quantized.w8a8
Text Generation
•
8B
•
Updated
•
28
PrunaAI/In2Training-FILM-7B-bnb-4bit-smashed
4B
•
Updated
•
7
Xu-Ouyang/pythia-160m-deduped-int8-step36000-GPTQ-wikitext2
Text Generation
•
99.5M
•
Updated
•
4
Xu-Ouyang/pythia-160m-deduped-int8-step71000-GPTQ-wikitext2
Text Generation
•
99.5M
•
Updated
•
5
Xu-Ouyang/pythia-160m-deduped-int8-step107000-GPTQ-wikitext2
Text Generation
•
99.5M
•
Updated
•
3
Xu-Ouyang/pythia-160m-deduped-int8-step110000-GPTQ-wikitext2
Text Generation
•
99.5M
•
Updated
•
4
Xu-Ouyang/pythia-160m-deduped-int8-step143000-GPTQ-wikitext2
Text Generation
•
99.5M
•
Updated
•
5
Xu-Ouyang/pythia-1b-deduped-int8-step36000-GPTQ-wikitext2
Text Generation
•
0.4B
•
Updated
•
3
Xu-Ouyang/pythia-1b-deduped-int8-step71000-GPTQ-wikitext2
Text Generation
•
0.4B
•
Updated
•
3
Xu-Ouyang/pythia-1b-deduped-int8-step107000-GPTQ-wikitext2
Text Generation
•
0.4B
•
Updated
•
5
Xu-Ouyang/pythia-1b-deduped-int8-step110000-GPTQ-wikitext2
Text Generation
•
0.4B
•
Updated
•
4
Xu-Ouyang/pythia-1b-deduped-int8-step143000-GPTQ-wikitext2
Text Generation
•
0.4B
•
Updated
•
6
myrulezzzz/newdata_mistral4bit
Text Generation
•
4B
•
Updated
•
4
ZeZanZiet/blip2_image_captioning_v1
Updated
•
20
bullerwins/Big-Tiger-Gemma-27B-v1-exl2_8.0bpw
Text Generation
•
Updated
•
3
•
1
smokxy/agri_bert_classifier_quantized
Text Classification
•
0.1B
•
Updated
•
6
RedHatAI/Meta-Llama-3-70B-Instruct-quantized.w8a8
Text Generation
•
71B
•
Updated
•
23
smokxy/roberta-base-squad2-quantized
Question Answering
•
0.1B
•
Updated
•
7
Aung2024/labour_law
Text Generation
•
0.7B
•
Updated
•
7
dphn/dolphin-2.9.2-qwen2-72b-eetq
Text Generation
•
73B
•
Updated
•
9
•
1
HRuiii/Llama-2-7b-GPTQ-8bit
Text Generation
•
Updated
•
3
Ksgk-fy/maria_v113_gptq_prompt
Text Generation
•
3B
•
Updated
•
4
FuturisticVibes/Llama-3-Chatty-2x8B-8.0bpw-h8-exl2
Text Generation
•
Updated
•
3
FuturisticVibes/Nous-Hermes-2-Mixtral-8x7B-DPO-8.0bpw-h8-exl2
Text Generation
•
Updated
•
4
FuturisticVibes/Nous-Hermes-2-Mixtral-8x7B-SFT-8.0bpw-h8-exl2
Text Generation
•
Updated
•
5
MaziyarPanahi/mathstral-7B-v0.1-GGUF
Text Generation
•
7B
•
Updated
•
96.7k
•
7
bullerwins/mathstral-7B-v0.1-exl2_8.0bpw
Text Generation
•
Updated
•
8