Inference Optimized Checkpoints (with Model Optimizer) Collection A collection of generative models quantized and optimized for inference with Model Optimizer. • 54 items • Updated about 4 hours ago • 117
Running on A10G 1.88k GGUF My Repo 🦙 1.88k Quantize a Hugging Face model to GGUF and create a repo