GGUF quants of https://huggingface.co/concedo/CabbageSoup-24B. I didn't bother making all the other quants but feel free to PR them from the BF16 one.
GGUF quants of https://huggingface.co/concedo/CabbageSoup-24B. I didn't bother making all the other quants but feel free to PR them from the BF16 one.