ArtusDev commited on
Commit
5010a93
·
verified ·
1 Parent(s): 8067345

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +109 -0
README.md CHANGED
@@ -2,6 +2,115 @@
2
  base_model: Trappu/Magnum-Picaro-0.7-v2-12b
3
  base_model_relation: quantized
4
  quantized_by: ArtusDev
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  ---
6
 
7
  ## EXL3 Quants of Trappu/Magnum-Picaro-0.7-v2-12b
 
2
  base_model: Trappu/Magnum-Picaro-0.7-v2-12b
3
  base_model_relation: quantized
4
  quantized_by: ArtusDev
5
+ tags:
6
+ - merge
7
+ - mergekit
8
+ - lazymergekit
9
+ - anthracite-org/magnum-v2-12b
10
+ - Trappu/Nemo-Picaro-12B
11
+ - exl3
12
+ model-index:
13
+ - name: Magnum-Picaro-0.7-v2-12b
14
+ results:
15
+ - task:
16
+ type: text-generation
17
+ name: Text Generation
18
+ dataset:
19
+ name: IFEval (0-Shot)
20
+ type: HuggingFaceH4/ifeval
21
+ args:
22
+ num_few_shot: 0
23
+ metrics:
24
+ - type: inst_level_strict_acc and prompt_level_strict_acc
25
+ value: 30.03
26
+ name: strict accuracy
27
+ source:
28
+ url: >-
29
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Trappu/Magnum-Picaro-0.7-v2-12b
30
+ name: Open LLM Leaderboard
31
+ - task:
32
+ type: text-generation
33
+ name: Text Generation
34
+ dataset:
35
+ name: BBH (3-Shot)
36
+ type: BBH
37
+ args:
38
+ num_few_shot: 3
39
+ metrics:
40
+ - type: acc_norm
41
+ value: 35.75
42
+ name: normalized accuracy
43
+ source:
44
+ url: >-
45
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Trappu/Magnum-Picaro-0.7-v2-12b
46
+ name: Open LLM Leaderboard
47
+ - task:
48
+ type: text-generation
49
+ name: Text Generation
50
+ dataset:
51
+ name: MATH Lvl 5 (4-Shot)
52
+ type: hendrycks/competition_math
53
+ args:
54
+ num_few_shot: 4
55
+ metrics:
56
+ - type: exact_match
57
+ value: 4.76
58
+ name: exact match
59
+ source:
60
+ url: >-
61
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Trappu/Magnum-Picaro-0.7-v2-12b
62
+ name: Open LLM Leaderboard
63
+ - task:
64
+ type: text-generation
65
+ name: Text Generation
66
+ dataset:
67
+ name: GPQA (0-shot)
68
+ type: Idavidrein/gpqa
69
+ args:
70
+ num_few_shot: 0
71
+ metrics:
72
+ - type: acc_norm
73
+ value: 9.73
74
+ name: acc_norm
75
+ source:
76
+ url: >-
77
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Trappu/Magnum-Picaro-0.7-v2-12b
78
+ name: Open LLM Leaderboard
79
+ - task:
80
+ type: text-generation
81
+ name: Text Generation
82
+ dataset:
83
+ name: MuSR (0-shot)
84
+ type: TAUR-Lab/MuSR
85
+ args:
86
+ num_few_shot: 0
87
+ metrics:
88
+ - type: acc_norm
89
+ value: 19.56
90
+ name: acc_norm
91
+ source:
92
+ url: >-
93
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Trappu/Magnum-Picaro-0.7-v2-12b
94
+ name: Open LLM Leaderboard
95
+ - task:
96
+ type: text-generation
97
+ name: Text Generation
98
+ dataset:
99
+ name: MMLU-PRO (5-shot)
100
+ type: TIGER-Lab/MMLU-Pro
101
+ config: main
102
+ split: test
103
+ args:
104
+ num_few_shot: 5
105
+ metrics:
106
+ - type: acc
107
+ value: 28.67
108
+ name: accuracy
109
+ source:
110
+ url: >-
111
+ https://huggingface.co/spaces/open-llm-leaderboard/open_llm_leaderboard?query=Trappu/Magnum-Picaro-0.7-v2-12b
112
+ name: Open LLM Leaderboard
113
+ license: apache-2.0
114
  ---
115
 
116
  ## EXL3 Quants of Trappu/Magnum-Picaro-0.7-v2-12b