Inference Providers
Active filters: Int4
AXERA-TECH/DeepSeek-R1-Distill-Qwen-1.5B-GPTQ-Int4
Updated • 12
• 1
AXERA-TECH/DeepSeek-R1-Distill-Qwen-7B-GPTQ-Int4
Updated • 8
• 1
AXERA-TECH/Qwen2.5-1.5B-Instruct-GPTQ-Int4
Text Generation
• Updated • 88
AXERA-TECH/Qwen2.5-3B-Instruct-GPTQ-Int4
AXERA-TECH/Qwen2.5-0.5B-Instruct-GPTQ-Int4
Text Generation
• Updated • 3
AXERA-TECH/Qwen2.5-7B-Instruct-GPTQ-Int4
JunHowie/Qwen3-0.6B-GPTQ-Int4
Text Generation
• 0.6B • Updated • 108
• 1
JunHowie/Qwen3-1.7B-GPTQ-Int4
Text Generation
• 2B • Updated • 129
• 1
JunHowie/Qwen3-32B-GPTQ-Int4
Text Generation
• 33B • Updated • 28.2k
• 4
JunHowie/Qwen3-30B-A3B-GPTQ-Int4
Text Generation
• 5B • Updated • 47
• 1
JunHowie/Qwen3-14B-GPTQ-Int4
Text Generation
• 15B • Updated • 4.69k
• 4
JunHowie/Qwen3-8B-GPTQ-Int4
Text Generation
• 8B • Updated • 772
• 4
JunHowie/Qwen3-4B-GPTQ-Int4
Text Generation
• 4B • Updated • 836
• 1
JunHowie/Qwen3-4B-Instruct-2507-GPTQ-Int4
Text Generation
• 4B • Updated • 93.8k
• 3
JunHowie/Qwen3-4B-Thinking-2507-GPTQ-Int4
Text Generation
• 4B • Updated • 29
• 1
JunHowie/Qwen3-30B-A3B-Instruct-2507-GPTQ-Int4
Text Generation
• 31B • Updated • 10.7k
JunHowie/Qwen3-30B-A3B-Thinking-2507-GPTQ-Int4
Text Generation
• 31B • Updated • 20
JunHowie/Qwen2-7B-Instruct-GPTQ-Int4
Text Generation
• 8B • Updated • 4
JunHowie/Seed-OSS-36B-Instruct-GPTQ-Int4
Text Generation
• 36B • Updated • 6
QuantTrio/KAT-Dev-GPTQ-Int4
Text Generation
• 33B • Updated • 4
• 1
QuantTrio/Kimi-Dev-72B-GPTQ-Int4
Text Generation
• 73B • Updated • 36
• 2
AXERA-TECH/Qwen3-VL-2B-Instruct-GPTQ-Int4
Image-Text-to-Text
• Updated • 67
• 1
AXERA-TECH/Qwen3-VL-4B-Instruct-GPTQ-Int4
Image-Text-to-Text
• Updated • 37
AXERA-TECH/Qwen3-VL-8B-Instruct-GPTQ-Int4
Image-Text-to-Text
• Updated • 24
• 1
AXERA-TECH/Qwen3-VL-2B-Instruct-GPTQ-Int4-AX630C
Image-Text-to-Text
• Updated • 5
AXERA-TECH/Qwen3-VL-2B-Instruct-GPTQ-Int4-AX630C-P256-CTX384
Image-Text-to-Text
• Updated • 4
AXERA-TECH/Qwen3-VL-2B-Instruct-GPTQ-Int4-AX630C-P320-CTX448
Image-Text-to-Text
• Updated • 33
AXERA-TECH/Xiaomi-MiMo-VL-Miloco-7B-AX650-GPTQ-Int4
Image-Text-to-Text
• Updated • 4
AXERA-TECH/Qwen2.5-VL-3B-Instruct-GPTQ-Int4
Image-Text-to-Text
• Updated • 6
AXERA-TECH/Qwen3-4B-Instruct-2507-GPTQ-Int4
Text Generation
• Updated • 4