inference-optimization
/

Llama-3.1-8B-Instruct-QKV-Cache-FP8-Per-Head

compressed-tensors

Model card Files Files and versions

krishnateja95 commited on Dec 5, 2025

Commit

4b13fac

·

verified ·

1 Parent(s): ca74a77

Update README.md

Files changed (1) hide show

README.md +1 -0

README.md CHANGED Viewed

@@ -61,6 +61,7 @@ base_model:
       <td>100.00</td>
       <td>100.00</td>
     </tr>
     <tr>
       <td rowspan="5"><b>NIAH<br>Single 3</b></td>
       <td>4096</td>

       <td>100.00</td>
       <td>100.00</td>
     </tr>
+    <br>
     <tr>
       <td rowspan="5"><b>NIAH<br>Single 3</b></td>
       <td>4096</td>