Model Stock: All we need is just a few fine-tuned models
Paper • 2403.19522 • Published • 14
This is a merge of pre-trained language models created using mergekit.
This model was merged using the Model Stock merge method using PocketDoc/Dans-SakuraKaze-V1.0.0-12b as a base.
you need to use chatml.
here are direct download link to all ggufs:
here are all the links if you want to download frim oobabooga/text-generation-webui
The following models were included in the merge:
The following YAML configuration was used to produce this model:
merge_method: model_stock
base_model: PocketDoc/Dans-SakuraKaze-V1.0.0-12b
parameters:
models:
- model: Nitral-AI/Captain-Eris_Violet-V0.420-12B
- model: Epiculous/Violet_Twilight-v0.2
- model: Epiculous/Azure_Dusk-v0.2
- model: Epiculous/Crimson_Dawn-v0.2
dtype: bfloat16