README.md

---
base_model:
- Qwen/Qwen3.5-9B
license: mit
library_name: transformers
pipeline_tag: text-generation
---

# Distillation-Expert-Qwen3.5-9B

[🌐 Project Page](https://recursivemas.github.io) | [💻 Code](https://github.com/RecursiveMAS/RecursiveMAS) | [📄 Paper](https://arxiv.org/abs/2604.25917)

We introduce **RecursiveMAS**, a multi-agent framework that scales agent collaboration through **latent-space recursion**. 
RecursiveMAS treats a multi-agent system as a unified recursive computation, where heterogeneous agents iteratively exchange, refine, and evolve their latent states across recursion rounds. In the Distillation-Style setting, the Expert Agent provides high-quality guidance to the Learner Agent, supporting recursive latent-space collaboration for improved task solving.

## Model Details

| Item | Description |
|---|---|
| Model | Distillation-Expert-Qwen3.5-9B |
| Collaboration Style | Distillation-Style |
| Agent Role | Expert Agent |
| Base Model | Qwen3.5-9B |

⚠️ **Note:** This checkpoint is a **role-specific agent** in [**RecursiveMAS**](https://arxiv.org/abs/2604.25917), rather than a standalone model intended for plain-text generation.  

## Usage

To load this agent as part of a RecursiveMAS system, you can use the loader provided in the [official codebase](https://github.com/RecursiveMAS/RecursiveMAS):

```python
from system_loader import load_mas_system

# Load the distillation-style system
mas = load_mas_system(
    style="distillation",
    device="cuda",
    trust_remote_code=True,
)

# Access the expert and learner agents
expert = mas.agents["expert"].model
learner = mas.agents["learner"].model
```

For detailed usage instructions and the full inference pipeline, please refer to the [GitHub repository](https://github.com/RecursiveMAS/RecursiveMAS).

## Model Collections for RecursiveMAS

| Style | Model Collection |
|---|---|
| Sequential-Style | [🤗 HuggingFace](https://huggingface.co/collections/RecursiveMAS/sequential-style-recursivemas) |
| Mixture-Style | [🤗 HuggingFace](https://huggingface.co/collections/RecursiveMAS/mixture-style-recursivemas) |
| Distillation-Style | [🤗 HuggingFace](https://huggingface.co/collections/RecursiveMAS/distillation-style-recursivemas) |
| Deliberation-Style | [🤗 HuggingFace](https://huggingface.co/collections/RecursiveMAS/deliberation-style-recursivemas) |

## Experiment Results

<p align="center">
  <img src="https://raw.githubusercontent.com/RecursiveMAS/RecursiveMAS/main/assets/hero_fig.png" width="95%" alt="RecursiveMAS Experiment Results">
</p>

## Citation

```bibtex
@misc{recursivemas,
      title={Recursive Multi-Agent Systems}, 
      author={Xiyuan Yang and Jiaru Zou and Rui Pan and Ruizhong Qiu and Pan Lu and Shizhe Diao and Jindong Jiang and Hanghang Tong stones and Tong Zhang and Markus J. Buehler and Jingrui He and James Zou},
      year={2026},
      eprint={2604.25917},
      archivePrefix={arXiv},
      primaryClass={cs.AI},
      url={https://arxiv.org/abs/2604.25917}, 
}
```