metadata
base_model:
- Tarek07/Scripturient-V1.3-LLaMa-70B
library_name: transformers
tags:
- mergekit
- merge
Script_brain
This is a merge of pre-trained language models created using mergekit.
Merge Details
Merge Method
This model was merged using the SLERP merge method.
Models Merged
The following models were included in the merge:
- D:\mergekit\LORAs\applied\Script_r128
- Tarek07/Scripturient-V1.3-LLaMa-70B
Configuration
The following YAML configuration was used to produce this model:
models:
- model: D:\mergekit\LORAs\applied\Script_r128
- model: Tarek07/Scripturient-V1.3-LLaMa-70B
merge_method: slerp
base_model: Tarek07/Scripturient-V1.3-LLaMa-70B
dtype: float32
out_dtype: bfloat16
parameters:
t: [
0.3, 0.8, 0.9, 0.9, 0.7, 0.7, 0.2
]