README.md

---
pipeline_tag: robotics
library_name: peft
---

# Learning Action Manifold with Multi-view Latent Priors for Robotic Manipulation

This repository contains the weights for **Multi-view-VLA**, a Vision-Language-Action framework designed for robust and precise robotic manipulation.

[**Project Page**](https://junjxiao.github.io/Multi-view-VLA.github.io/) | [**Code**](https://github.com/junjxiao/Multi-view-VLA) | [**arXiv**](https://huggingface.co/papers/2605.11832)

## Introduction
Multi-view-VLA addresses the challenges of spatial perception and manipulation in Vision-Language-Action (VLA) models. Key features include:

- **Geometry-Guided Gated Transformer (G3T):** Addresses monocular depth ambiguity by leveraging multi-view diffusion priors to provide geometric guidance while adaptively filtering occlusion noise.
- **Action Manifold Learning (AML):** A direct action prediction mechanism that bypasses the limitations of traditional diffusion-based indirect noise/velocity regression, leading to more efficient action learning.

The model demonstrates superior success rates and robustness on benchmarks like LIBERO, RoboTwin 2.0, and real-world robotic tasks.

## Usage
For detailed instructions on installation, training, and evaluation, please refer to the [official GitHub repository](https://github.com/junjxiao/Multi-view-VLA).

## Citation
If you find this work useful, please consider citing:

```bibtex
@article{xiao2026learning,
    title={Learning Action Manifold with Multi-view Latent Priors for Robotic Manipulation}, 
    author={Junjin Xiao and Dongyang Li and Yandan Yang and Shuang Zeng and Tong Lin and Xinyuan Chang and Feng Xiong and Mu Xu and Xing Wei and Zhiheng Ma and Qing Zhang and Wei-Shi Zheng},
    year={2026},
    journal={arxiv:2605.11832},
}
```

## Acknowledgement
This project builds upon [starVLA](https://github.com/starVLA/starVLA), [Qwen3-VL](https://github.com/QwenLM/Qwen3-VL), [vggt](https://github.com/facebookresearch/vggt), [JiT](https://github.com/LTH14/JiT), [LeRobot](https://github.com/huggingface/lerobot), [Isaac-GR00T](https://github.com/NVIDIA/Isaac-GR00T) and [any4lerobot](https://github.com/Tavish9/any4lerobot).