leon-se
/

gemma-3-27b-it-FP8-Dynamic

compressed-tensors

Model card Files Files and versions

leon-se commited on Mar 13

Commit

423943d

·

verified ·

1 Parent(s): 9ec912c

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -5,5 +5,5 @@ base_model:
 ---
 FP8-Dynamic quantization using llmcompressor. Run with:
 ```bash
-vllm serve leon-se/gemma-3-12b-it-FP8-Dynamic --max-model-len 4096
 ```

 ---
 FP8-Dynamic quantization using llmcompressor. Run with:
 ```bash
+vllm serve leon-se/gemma-3-27b-it-FP8-Dynamic --max-model-len 4096
 ```