abhinavkulkarni
/

codellama-CodeLlama-13b-Python-hf-w4-g128-awq

Text Generation

text-generation-inference

Model card Files Files and versions

abhinavkulkarni commited on Sep 7, 2023

Commit

85c74ab

·

1 Parent(s): 8cd6a4d

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -100,7 +100,7 @@ This evaluation was done using OpenAI [HumanEval](https://github.com/openai/huma
 |  Task   |Version|    Metric     |  Value  |   |Stderr|
 |---------|------:|---------------|--------:|---|------|
-|HumanEval|      1|pass@1         |   TBD   |   |      |
 [CodeLlama-13b-Python-hf (4-bit 128-group AWQ)](https://huggingface.co/abhinavkulkarni/codellama-CodeLlama-13b-Python-hf-w4-g128-awq)

 |  Task   |Version|    Metric     |  Value  |   |Stderr|
 |---------|------:|---------------|--------:|---|------|
+|HumanEval|      1|pass@1         |35.9756% |   |      |
 [CodeLlama-13b-Python-hf (4-bit 128-group AWQ)](https://huggingface.co/abhinavkulkarni/codellama-CodeLlama-13b-Python-hf-w4-g128-awq)