Model Stock: All we need is just a few fine-tuned models
Paper • 2403.19522 • Published • 14
This is a merge of pre-trained language models created using mergekit.
This model was merged using the Model Stock merge method using deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B as a base.
The following models were included in the merge:
The following YAML configuration was used to produce this model:
models:
- model: brayene/DPO-Qwen2-1.5B-Instruct-Human-like
- model: Qwen/Qwen2.5-Math-1.5B
- model: prithivMLmods/QwQ-R1-Distill-1.5B-CoT
- model: MadeAgents/Hammer2.1-1.5b
- model: nirusanan/Qwen2.5-1.5B-NextJs-code
- model: Kukedlc/Qwen2.5-1.5B-Spanish-1.0-DPO
merge_method: model_stock
base_model: deepseek-ai/DeepSeek-R1-Distill-Qwen-1.5B
parameters:
normalize: false
int8_mask: true
dtype: float16