Functionality-Oriented LLM Merging on the Fisher--Rao Manifold
Paper • 2603.04972 • Published • 2
This is a merge of pre-trained language models created using mergekit.
This model was merged using the Karcher Mean merge method.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
models:
- model: Snowflake/Qwen-2.5-coder-Arctic-ExCoT-32B
- model: open-thoughts/OpenThinker2-32B
- model: huihui-ai/QwQ-32B-abliterated
- model: Qwen/Qwen2.5-Coder-32B-Instruct
merge_method: karcher
dtype: bfloat16
Functionality-Oriented LLM Merging on the Fisher-Rao Manifold