RedHatAI
/

Phi-3-mini-128k-instruct-FP8

Text Generation

text-generation-inference

compressed-tensors

Model card Files Files and versions

Lin-K76 commited on Jul 8, 2024

Commit

88a75a4

·

verified ·

1 Parent(s): 3f04528

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -96,7 +96,7 @@ done
 Evaluated on the Open LLM Leaderboard evaluations through vLLM.
 ### Open LLM Leaderboard evaluation scores
-|                      | Phi-3-mini-128k-instruct-FP8       | neuralmagic/Phi-3-mini-128k-instruct-FP8<br>(this model) |
 | :------------------: | :----------------------: | :------------------------------------------------: |
 | arc-c<br>25-shot     | 63.65                    | 64.24                                              |
 | hellaswag<br>10-shot | 79.76                    | 79.79                                              |

 Evaluated on the Open LLM Leaderboard evaluations through vLLM.
 ### Open LLM Leaderboard evaluation scores
+|                      | Phi-3-mini-128k-instruct       | neuralmagic/Phi-3-mini-128k-instruct-FP8<br>(this model) |
 | :------------------: | :----------------------: | :------------------------------------------------: |
 | arc-c<br>25-shot     | 63.65                    | 64.24                                              |
 | hellaswag<br>10-shot | 79.76                    | 79.79                                              |