jmercat commited on
Commit
459144b
·
verified ·
1 Parent(s): cd868d4

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +56 -0
README.md ADDED
@@ -0,0 +1,56 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ library_name: vla-foundry
4
+ tags:
5
+ - foundry
6
+ - vla_foundry
7
+ - vla
8
+ - robotics
9
+ - diffusion-policy
10
+ - flow-matching
11
+ pipeline_tag: robotics
12
+ ---
13
+
14
+ # Foundry-VLA-1.7B-real
15
+
16
+ A 1.7B parameter vision-language-action model for bimanual robotic manipulation, part of the [VLA Foundry](https://github.com/TRI-ML/vla_foundry) collection. Trained on real-world manipulation data only.
17
+
18
+ ## Model Description
19
+
20
+ - **Architecture:** Foundry-VLM-1.3B vision-language backbone + (condition on last 4 layers) flow-matching diffusion action head (24 layers, 1024 hidden dim, 16 heads)
21
+ - **Parameters:** 1.7B (non-embedding)
22
+ - **Action space:** 20-dim relative actions (bimanual xyz + 6D rotation + gripper)
23
+ - **Cameras:** 4 views (2 scene + 2 wrist)
24
+ - **Training data:** 102M samples from real-world bimanual manipulation tasks only
25
+ - **VLM backbone:** [Foundry-VLM-1.3B-200M](https://huggingface.co/TRI-ML/Foundry-VLM-1.3B-200M)
26
+
27
+ ## Evaluation Results
28
+
29
+ Success rates on 16 seen tasks and 3 unseen tasks (200 rollouts per task):
30
+
31
+ | Simulator | Seen (16 tasks) | Unseen (3 tasks) |
32
+ |---|---|---|
33
+ | CS | 1.0% | 0.3% |
34
+ | OSS | 2.2% | 4.5% |
35
+
36
+ Note: This model was trained on real-world data only and does not transfer well to simulation.
37
+
38
+ ## Usage
39
+
40
+ ```bash
41
+ git clone https://github.com/TRI-ML/vla_foundry.git
42
+ cd vla_foundry
43
+ pip install -e .
44
+ ```
45
+
46
+ ```python
47
+ from vla_foundry.models.base_model import BaseModel
48
+ model = BaseModel.from_pretrained("TRI-ML/Foundry-VLA-1.7B-real")
49
+ ```
50
+
51
+ ## Links
52
+
53
+ - **Project page:** [tri-ml.github.io/vla_foundry](https://tri-ml.github.io/vla_foundry/)
54
+ - **Paper:** [VLA Foundry (arXiv 2604.19728)](https://arxiv.org/abs/2604.19728)
55
+ - **Code:** [github.com/TRI-ML/vla_foundry](https://github.com/TRI-ML/vla_foundry)
56
+ - **Collection:** [VLA Foundry collection](https://huggingface.co/collections/TRI-ML/vla-foundry)