Mehdi Challakh commited on
Commit
4ff695a
·
verified ·
1 Parent(s): af1cc91

updated with gpt4-o evaluation entries

Browse files
Files changed (1) hide show
  1. README.md +9 -9
README.md CHANGED
@@ -101,15 +101,15 @@ print(answer)
101
 
102
  ## Performance
103
 
104
- | Metric | stable-code-instruct-3b | stable-cypher-instruct-3b |
105
- | ------------ | ----------------------- | ------------------------- |
106
- | BLEU-4 | 19.07 | 88.63 |
107
- | ROUGE-1 | 39.49 | 95.09 |
108
- | ROUGE-2 | 24.82 | 90.71 |
109
- | ROUGE-L | 29.63 | 91.51 |
110
- | Jaro-Winkler | 52.21 | 95.69 |
111
- | Jaccard | 25.55 | 90.78 |
112
- | Pass@1 | 0.0 | 51.8 |
113
 
114
  ### Example
115
 
 
101
 
102
  ## Performance
103
 
104
+ | Metric | stable-code-instruct-3b | gpt4-o | stable-cypher-instruct-3b |
105
+ | ------------ | ----------------------- | ------ | ------------------------- |
106
+ | BLEU-4 | 19.07 | 32.35 | 88.63 |
107
+ | ROUGE-1 | 39.49 | 69.17 | 95.09 |
108
+ | ROUGE-2 | 24.82 | 46.97 | 90.71 |
109
+ | ROUGE-L | 29.63 | 65.24 | 91.51 |
110
+ | Jaro-Winkler | 52.21 | 86.38 | 95.69 |
111
+ | Jaccard | 25.55 | 72.80 | 90.78 |
112
+ | Pass@1 | 0.00 | 0.00 | 51.80 |
113
 
114
  ### Example
115