legolasyiu commited on
Commit
323db19
·
verified ·
1 Parent(s): 748d84b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -0
README.md CHANGED
@@ -175,6 +175,12 @@ hf (pretrained=EpistemeAI/ReasoningCore-3B-R01), gen_kwargs: (None), limit: None
175
  | | |none | 5|acc_norm|↑ |0.7087|± |0.0045|
176
  |winogrande | 1|none | 5|acc |↑ |0.6811|± |0.0131|
177
 
 
 
 
 
 
 
178
 
179
  # Uploaded model
180
 
 
175
  | | |none | 5|acc_norm|↑ |0.7087|± |0.0045|
176
  |winogrande | 1|none | 5|acc |↑ |0.6811|± |0.0131|
177
 
178
+ hf (pretrained=EpistemeAI/ReasoningCore-3B-R01), gen_kwargs: (None), limit: None, num_fewshot: 5, batch_size: 8
179
+ | Tasks |Version|Filter|n-shot| Metric | |Value | |Stderr|
180
+ |---------------------|------:|------|-----:|--------|---|-----:|---|-----:|
181
+ |gpqa_diamond_zeroshot| 1|none | 0|acc |↑ |0.3182|± |0.0332|
182
+ | | |none | 0|acc_norm|↑ |0.3182|± |0.0332|
183
+
184
 
185
  # Uploaded model
186