DeepSeek-R1-W4AFP8 / hf_quant_config.json
Barry Kang
DeepSeek-R1 W4AFP8
fd74c3f
raw
history blame contribute delete
108 Bytes
{
"quantization": {
"quant_algo": "MIXED_PRECISION",
"kv_cache_quant_algo": null
}
}