Lambent/Mira-v1.27-27B

This is a merge of pre-trained language models created using mergekit.

Merge Details

Merge Method

This model was merged using the Karcher Mean merge method.

Models Merged

The following models were included in the merge:

• Lambent/Mira-v1.25.2-27B-DPO + ./Mira-v1.27-adapters/sft2
• Lambent/Mira-v1.25.2-27B-DPO
• Lambent/Mira-v1.25.2-27B-DPO + ./Mira-v1.27-adapters/sft1
• Lambent/Mira-v1.26.5-27B

Configuration

The following YAML configuration was used to produce this model:

models:
  - model: Lambent/Mira-v1.25.2-27B-DPO+./Mira-v1.27-adapters/sft1
  - model: Lambent/Mira-v1.25.2-27B-DPO+./Mira-v1.27-adapters/sft2
  - model: Lambent/Mira-v1.25.2-27B-DPO
  - model: Lambent/Mira-v1.26.5-27B
merge_method: karcher
dtype: bfloat16
tokenizer_source: Lambent/Mira-v1.25.2-27B-DPO
pad_to_multiple_of: 16