Model Stock: All we need is just a few fine-tuned models
Paper • 2403.19522 • Published • 14
This is a merge of pre-trained language models created using mergekit.
This model was merged using the Model Stock merge method using Qwen/Qwen2.5-7B-Instruct as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
merge_method: model_stock
base_model: Qwen/Qwen2.5-7B-Instruct
models:
- model: marcuscedricridia/Yell-Qwen2.5-7B-Coder
- model: Cran-May/T.E-8.1
- model: deepseek-ai/DeepSeek-R1-Distill-Qwen-7B
- model: huihui-ai/DeepSeek-R1-Distill-Qwen-7B-abliterated-v2
dtype: bfloat16
tokenizer_source: base
int8_mask: true
normalize: true
name: Yell-Qwen2.5-7B-Stock