| --- |
| license: unknown |
| library_name: transformers |
| pipeline_tag: text-generation |
| base_model: |
| - unsloth/llama-2-13b |
| - layoric/llama-2-13b-code-alpaca |
| - vanillaOVO/WizardMath-13B-V1.0 |
| - WizardLMTeam/WizardLM-13B-V1.2 |
| tags: |
| - merge |
| --- |
| |
| # AIM Paper Checkpoints Uploaded For Replication |
| This repository includes one of the checkpoints used in the paper "Activation-Informed Merging of Large Language Models". Specifics of this model are as follows: |
|
|
| - **Merging Method:** WIDEN |
| - **Models Used In Merging** |
| - ***Base Model:*** unsloth/llama-2-13b |
| - ***Code:*** layoric/llama-2-13b-code-alpaca |
| - ***Math:*** vanillaOVO/WizardMath-13B-V1.0 |
| - ***Instruction Tuned:*** WizardLMTeam/WizardLM-13B-V1.2 |
| - **AIM:** True |
|
|
| Benchmark results and paper details can be found at the official [GitHub](https://github.com/ahnobari/ActivationInformedMerging.git). |
