rachittshah commited on
Commit
b192336
·
1 Parent(s): d70c457

Upload folder using huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +31 -0
README.md ADDED
@@ -0,0 +1,31 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - merge
5
+ - mergekit
6
+ - lazymergekit
7
+ - kaist-ai/prometheus-7b-v1.0
8
+ ---
9
+
10
+ # evalistral
11
+
12
+ evalistral is a merge of the following models using [mergekit](https://github.com/cg123/mergekit):
13
+ * [kaist-ai/prometheus-7b-v1.0](https://huggingface.co/kaist-ai/prometheus-7b-v1.0)
14
+
15
+ ## 🧩 Configuration
16
+
17
+ ```yaml
18
+ models:
19
+ - model: mistralai/Mistral-7B-v0.1
20
+ # no parameters necessary for base model
21
+ - model: kaist-ai/prometheus-7b-v1.0
22
+ parameters:
23
+ density: 0.5
24
+ weight: 0.5
25
+ merge_method: ties
26
+ base_model:
27
+ parameters:
28
+ normalize: true
29
+ dtype: float16
30
+
31
+ ```