README.md

---
base_model:
- meta-llama/Llama-3.2-1B-Instruct
license: mit
pipeline_tag: text-generation
library_name: transformers
---

# Sequential-Light-Critic-Llama3.2-1B

[🌐 Project Page](https://recursivemas.github.io) | [💻 Code](https://github.com/RecursiveMAS/RecursiveMAS) | [📄 Paper](https://arxiv.org/abs/2604.25917)

We introduce RecursiveMAS, a multi-agent framework that scales agent collaboration through latent-space recursion.
RecursiveMAS treats a multi-agent system as a unified recursive computation, where heterogeneous agents iteratively exchange, refine, and evolve their latent states across recursion rounds. In the Sequential-Light setting, the Critic Agent is responsible for reviewing and refining the initial plan produced by the Planner Agent, which is then passed to the Solver Agent for final solution generation.

## Model Details

| Item | Description |
|---|---|
| Model | Sequential-Light-Critic-Llama3.2-1B |
| Collaboration Style | Sequential-Light |
| Agent Role | Critic Agent |
| Base Model | Llama3.2-1B |

⚠️ **Note:** This checkpoint is a **role-specific agent** in [**RecursiveMAS**](https://arxiv.org/abs/2604.25917), rather than a standalone model intended for plain-text generation.  

## Sample Usage

You can load the entire MAS pipeline using the code provided in the [GitHub repository](https://github.com/RecursiveMAS/RecursiveMAS):

```python
from system_loader import load_mas_system

mas = load_mas_system(
    style="sequential_light",
    device="cuda",
    trust_remote_code=True,
)

planner = mas.agents["planner"].model
critic = mas.agents["critic"].model
solver = mas.agents["solver"].model
```

For detailed usage instructions, please refer to the [GitHub repository](https://github.com/RecursiveMAS/RecursiveMAS).

## Model Collections for RecursiveMAS

| Style | Model Collection |
|---|---|
| Sequential-Style | [🤗 HuggingFace](https://huggingface.co/collections/RecursiveMAS/sequential-style-recursivemas) |
| Mixture-Style | [🤗 HuggingFace](https://huggingface.co/collections/RecursiveMAS/mixture-style-recursivemas) |
| Distillation-Style | [🤗 HuggingFace](https://huggingface.co/collections/RecursiveMAS/distillation-style-recursivemas) |
| Deliberation-Style | [🤗 HuggingFace](https://huggingface.co/collections/RecursiveMAS/deliberation-style-recursivemas) |

## Experiment Results

<p align="center">
  <img src="https://raw.githubusercontent.com/RecursiveMAS/RecursiveMAS/main/assets/hero_fig.png" width="95%" alt="RecursiveMAS Experiment Results">
</p>

## Citation

```bibtex
@misc{recursivemas,
      title={Recursive Multi-Agent Systems}, 
      author={Xiyuan Yang and Jiaru Zou and Rui Pan and Ruizhong Qiu and Pan Lu front and Shizhe Diao and Jindong Jiang and Hanghang Tong and Tong Zhang and Markus J. Buehler and Jingrui He and James Zou},
      year={2026},
      eprint={2604.25917},
      archivePrefix={arXiv},
      primaryClass={cs.AI},
      url={https://arxiv.org/abs/2604.25917}, 
}
```