Update README.md
Browse files
README.md
CHANGED
|
@@ -53,8 +53,11 @@ To simplify the comparison, we chosed the Pass@1 metric for the Python language,
|
|
| 53 |
| --- |----------------------------------------------------------------------------- |
|
| 54 |
| starcoder | 35.98%|
|
| 55 |
| opencsg-starcoder-v0.1| **42.68%** |
|
|
|
|
| 56 |
| opencsg-starcoder2-3b-v0.1| **45.12%** |
|
|
|
|
| 57 |
| opencsg-starcoder2-7b-v0.1| **51.22%** |
|
|
|
|
| 58 |
| opencsg-starcoder2-15b-v0.1| **59.15%** |
|
| 59 |
|
| 60 |
**TODO**
|
|
@@ -172,8 +175,11 @@ HumanEval 是评估模型在代码生成方面性能的最常见的基准，尤
|
|
| 172 |
| --- |----------------------------------------------------------------------------- |
|
| 173 |
| starcoder | 35.98%|
|
| 174 |
| opencsg-starcoder-v0.1| **42.68%** |
|
|
|
|
| 175 |
| opencsg-starcoder2-3b-v0.1| **45.12%** |
|
|
|
|
| 176 |
| opencsg-starcoder2-7b-v0.1| **51.22%** |
|
|
|
|
| 177 |
| opencsg-starcoder2-15b-v0.1| **59.15%** |
|
| 178 |
|
| 179 |
**TODO**
|
|
|
|
| 53 |
| --- |----------------------------------------------------------------------------- |
|
| 54 |
| starcoder | 35.98%|
|
| 55 |
| opencsg-starcoder-v0.1| **42.68%** |
|
| 56 |
+
| starcoder2-3b | 32.93%|
|
| 57 |
| opencsg-starcoder2-3b-v0.1| **45.12%** |
|
| 58 |
+
| starcoder2-7b | 35.37%|
|
| 59 |
| opencsg-starcoder2-7b-v0.1| **51.22%** |
|
| 60 |
+
| starcoder2-15b | 45.12%|
|
| 61 |
| opencsg-starcoder2-15b-v0.1| **59.15%** |
|
| 62 |
|
| 63 |
**TODO**
|
|
|
|
| 175 |
| --- |----------------------------------------------------------------------------- |
|
| 176 |
| starcoder | 35.98%|
|
| 177 |
| opencsg-starcoder-v0.1| **42.68%** |
|
| 178 |
+
| starcoder2-3b | 32.93%|
|
| 179 |
| opencsg-starcoder2-3b-v0.1| **45.12%** |
|
| 180 |
+
| starcoder2-7b | 35.37%|
|
| 181 |
| opencsg-starcoder2-7b-v0.1| **51.22%** |
|
| 182 |
+
| starcoder2-15b | 45.12%|
|
| 183 |
| opencsg-starcoder2-15b-v0.1| **59.15%** |
|
| 184 |
|
| 185 |
**TODO**
|