RedHatAI
/

granite-3.1-8b-instruct-quantized.w4a16

Text Generation

compressed-tensors

Model card Files Files and versions

nm-research commited on Jan 30

Commit

3930a40

·

verified ·

1 Parent(s): 9c6563a

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -636,7 +636,7 @@ guidellm --model neuralmagic/granite-3.1-8b-instruct-quantized.w4a16 --target "h
     <td>0.8</td>
   </tr>
   <tr>
-    <td>granite-3.1-2b-instruct-quantized.w4a16<br>(this model)</td>
     <td>1.29</td>
     <td>2.4</td>
     <td>8.9</td>

     <td>0.8</td>
   </tr>
   <tr>
+    <td>granite-3.1-8b-instruct-quantized.w4a16<br>(this model)</td>
     <td>1.29</td>
     <td>2.4</td>
     <td>8.9</td>