mergekit-dare_ties-woeufhp / mergekit_config.yml
chargoddard's picture
Upload folder using huggingface_hub
4bd83b9 verified
raw
history blame contribute delete
353 Bytes
models:
- model: unsloth/Llama-3.3-70B-Instruct
parameters:
density: 0.30
weight: 0.50
- model: nvidia/Llama-3.1-Nemotron-70B-Instruct-HF
parameters:
density: 0.50
weight: 0.75
merge_method: dare_ties
base_model: nvidia/Llama-3.1-Nemotron-70B-Instruct-HF
parameters:
normalize: true
int8_mask: true
dtype: float16