INT4 LLMs for vLLM
Collection
Accurate INT4 quantized models by Neural Magic, ready for use with vLLM! • 16 items • Updated
• 12
David R
dr-e
·
AI & ML interests
None yet
Recent Activity
new activity
1 day ago
cyankiwi/NVIDIA-Nemotron-3-Super-120B-A12B-AWQ-4bit:Error loading the model new activity
about 1 month ago
Qwen/Qwen3-Coder-Next:AWQ quantization liked
a model 3 months ago
unsloth/Devstral-2-123B-Instruct-2512-GGUF Organizations
upvoted a collection over 1 year ago