VadExylos commited on
Commit
4d8f970
·
verified ·
1 Parent(s): c732b3a

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +138 -5
README.md CHANGED
@@ -1,10 +1,143 @@
1
  ---
2
- title: README
3
- emoji: 📚
4
- colorFrom: pink
5
- colorTo: indigo
6
  sdk: static
7
  pinned: false
8
  ---
9
 
10
- Edit this `README.md` markdown file to author your organization card.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ title: EXYLOS
3
+ emoji: 🤖
4
+ colorFrom: blue
5
+ colorTo: gray
6
  sdk: static
7
  pinned: false
8
  ---
9
 
10
+ <p align="center">
11
+ <h1 align="center">EXYLOS</h1>
12
+ <p align="center"><strong>Robot-ready skill datasets for manipulation policy learning and evaluation.</strong></p>
13
+ </p>
14
+
15
+ ---
16
+
17
+ ## What we do
18
+
19
+ EXYLOS builds structured robot manipulation datasets for imitation learning, VLA models, policy training, and evaluation.
20
+
21
+ Raw videos show what happened, but policy learning also needs synchronized actions, states, task metadata, outcomes, and failure context. EXYLOS turns human-seeded manipulation workflows performed in our simulations into train-ready episodes with multi-view observations, trajectories, annotations, success/failure labels, and quality diagnostics.
22
+
23
+ ---
24
+
25
+ ## Public sample datasets
26
+
27
+ This organization hosts compact inspection samples for checking schema, loading data, inspecting trajectories, and evaluating whether the EXYLOS format fits a robotics ML stack.
28
+
29
+ | Dataset | Status | Contents |
30
+ |---|---:|---|
31
+ | [`ExylosAi/pick_and_place_sample`](https://huggingface.co/datasets/ExylosAi/pick_and_place_sample) | Available | 50 pick-and-place episodes, 21,412 frames, 5 RGB views, 9D Panda state/action, 30 success and 20 failure episodes. |
32
+ | [`ExylosAi/bimanual_table_spill_cleanup`](https://huggingface.co/datasets/ExylosAi/table_spill_cleanup_bimanual) | Available | 50 bimanual spill-cleanup episodes, 67,742 frames, 6 RGB views, 18D dual-Panda state/action, 35 success and 15 failure episodes. |
33
+
34
+ More contact-rich and recovery-heavy samples are planned.
35
+
36
+ ---
37
+
38
+ ## Dataset format
39
+
40
+ EXYLOS samples are packaged to be compatible with the LeRobot ecosystem whenever possible. A typical dataset contains:
41
+
42
+ ```text
43
+ README.md
44
+ LICENSE.txt
45
+ annotations.json
46
+ meta/
47
+ info.json
48
+ tasks.jsonl
49
+ episodes.jsonl
50
+ episodes_stats.jsonl
51
+ data/
52
+ chunk-000/
53
+ episode_000000.parquet
54
+ episode_000001.parquet
55
+ videos/
56
+ chunk-000/
57
+ observation.images.<camera_name>/
58
+ episode_000000.mp4
59
+ episode_000001.mp4
60
+ ```
61
+
62
+ Core signals:
63
+
64
+ | Category | Examples |
65
+ |---|---|
66
+ | Visual observations | Synchronized RGB wrist and scene views |
67
+ | Action and state | Robot state, action vectors, timestamps, frame indices |
68
+ | Labels | Success, failure reason, terminal flags, collisions, aborts, retries |
69
+ | Annotations | Phase boundaries, hand labels, object notes, scores, derived metrics |
70
+ | Metadata | Task description, duration, splits, feature schema, validation stats |
71
+
72
+ Exact fields vary by dataset, so each repository includes a dataset-specific card.
73
+
74
+ ---
75
+
76
+ ## Quick start
77
+
78
+ Install LeRobot and load one of the public samples:
79
+
80
+ ```bash
81
+ pip install lerobot
82
+ ```
83
+
84
+ ```python
85
+ from lerobot.datasets.lerobot_dataset import LeRobotDataset
86
+
87
+ dataset = LeRobotDataset("ExylosAi/pick_and_place_sample")
88
+
89
+ sample = dataset[0]
90
+ print(sample.keys())
91
+ print(sample["observation.state"].shape)
92
+ print(sample["action"].shape)
93
+ ```
94
+
95
+ Raw Parquet, MP4, and JSON files are also available in each dataset repository.
96
+
97
+ ---
98
+
99
+ ## Why EXYLOS datasets are different
100
+
101
+ - **Structured, not raw:** episodes include synchronized video, actions, state, metadata, annotations, and quality checks.
102
+ - **Skill-oriented:** each dataset is organized around a manipulation workflow rather than unrelated clips.
103
+ - **Failure-aware:** samples include failed attempts, aborts, collisions, incomplete task executions, and recovery-relevant labels when available.
104
+ - **LeRobot-oriented:** data is stored in open formats such as MP4, Parquet, JSON, and JSONL.
105
+ - **Transfer-minded:** workflows are captured from human intent in consumer VR and procedurally expanded, with added visual domain randomization for broader policy-learning experiments.
106
+
107
+ ---
108
+
109
+ ## Intended use
110
+
111
+ Public samples are suitable for:
112
+
113
+ - inspecting EXYLOS schema and annotation conventions
114
+ - testing LeRobot-compatible loaders and training pipelines
115
+ - running small imitation-learning experiments
116
+ - reviewing multi-view video, trajectories, and phase annotations
117
+ - evaluating whether a custom EXYLOS skill pack would fit your workflow
118
+
119
+ They are compact inspection datasets, not complete production-scale benchmarks.
120
+
121
+ ---
122
+
123
+ ## Commercial datasets and custom skill packs
124
+
125
+ EXYLOS can generate custom robot-ready skill datasets for pick-and-place, bimanual manipulation, spill cleanup, sorting, binning, object rearrangement, failure recovery, and evaluation/regression sets.
126
+
127
+ Commercial deliveries can add depth, segmentation masks, object states, event labels, custom cameras, larger episode volumes, stricter QA, and internal-pipeline packaging.
128
+
129
+ ---
130
+
131
+ ## License
132
+
133
+ Current public samples are released under Apache 2.0. Please check each dataset card and license file before using a sample in research, demos, training, or commercial workflows.
134
+
135
+ ---
136
+
137
+ ## Contact
138
+
139
+ - Website: [exylos.ai](https://exylos.ai)
140
+ - Email: contact@exylos.ai
141
+ - LinkedIn: [Exylos on LinkedIn](https://www.linkedin.com/company/exylos-ai/)
142
+
143
+ If you need structured skill data, send us the target task, robot, modalities, format, evaluation criteria, and timeline.