image2image
layer-decomposition
boomcheng commited on
Commit
f7b36b6
·
verified ·
1 Parent(s): a75fd4d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +8 -131
README.md CHANGED
@@ -48,19 +48,19 @@ tags:
48
  </div>
49
 
50
  <div>
51
- <a href="https://zhao0100.github.io/RevealLayer/" target="_blank">
52
  <img src="https://img.shields.io/static/v1?label=Project%20Page&message=Github&color=blue&logo=github-pages">
53
  </a>
54
 
55
- <a href="TODO_ARXIV_LINK" target="_blank">
56
  <img src="https://img.shields.io/static/v1?label=Paper&message=arXiv&color=red&logo=arxiv">
57
  </a>
58
 
59
- <a href="TODO_DATASET_LINK" target="_blank">
60
  <img src="https://img.shields.io/static/v1?label=Dataset&message=RevealLayer&color=green">
61
  </a>
62
 
63
- <a href="TODO_MODEL_LINK" target="_blank">
64
  <img src="https://img.shields.io/static/v1?label=Model&message=HuggingFace&color=yellow">
65
  </a>
66
  </div>
@@ -77,7 +77,7 @@ RevealLayer decomposes an RGB image into multiple RGBA layers, enabling precise
77
  <img style="width:100%" src="assets/demo1.png" alt="RevealLayer teaser">
78
  </div>
79
 
80
- For more visual results, go checkout our <a href="https://zhao0100.github.io/RevealLayer/" target="_blank">project page</a>.
81
 
82
  ---
83
 
@@ -85,9 +85,9 @@ For more visual results, go checkout our <a href="https://zhao0100.github.io/Rev
85
 
86
  ## ⭐ Update
87
 
88
- - **[2026.05]** We released the RevealLayer paper and inference code.
89
- - **[2026.05]** We released the RevealLayer checkpoint.
90
  - **[2026.05]** RevealLayer has been accepted by ICML 2026.
 
 
91
 
92
  ### ✅ TODO
93
 
@@ -114,133 +114,10 @@ RevealLayer focuses on occlusion-aware image layer decomposition, recovering vis
114
 
115
  We construct a large-scale multi-layer image decomposition dataset, including **RevealLayer-100K** for training and **RevealLayerBench** for evaluation. RevealLayer-100K contains 100K multi-layer natural image tuples with RGB images, background layers, RGBA foreground layers, and bounding boxes. RevealLayerBench contains 200 high-quality manually curated images, covering challenging cases such as complex occlusions, large-area objects, transparent materials, small foreground objects, and multi-layer scenes.
116
 
117
- 🔥 We will release **RevealLayer-100K** and **RevealLayerBench** on [Hugging Face](TODO_DATASET_LINK). We hope they can serve as useful training and evaluation resources for future research on occlusion-aware image layer decomposition.
118
 
119
  > 🚩 The datasets are intended for research use. Please follow the license and terms provided with the released dataset.
120
 
121
- ---
122
-
123
- ## 🔧 Quick Start
124
-
125
- ### 0. Experimental environment
126
-
127
- We tested our inference code with Python 3.10 and CUDA GPUs.
128
-
129
- ### 1. Setup repository and environment
130
-
131
- ```bash
132
- git clone https://github.com/Zhao0100/RevealLayer.git
133
- cd RevealLayer
134
-
135
- conda create -n reveallayer python=3.10
136
- conda activate reveallayer
137
-
138
- pip install -r requirements.txt
139
-
140
- pip install flash-attn --no-build-isolation
141
-
142
- cd diffusers
143
- pip install .
144
- cd ..
145
- ```
146
-
147
- ---
148
-
149
- ## 📦 Prepare the models
150
-
151
- Model files are hosted with Git LFS, so please enable Git LFS before cloning model repositories.
152
-
153
- ```bash
154
- git lfs install
155
- ```
156
-
157
- Download the RevealLayer checkpoint:
158
-
159
- ```bash
160
- git clone https://huggingface.co/qihoo360/RevealLayer models/RevealLayer
161
- ```
162
-
163
- Download FLUX.1-dev:
164
-
165
- ```bash
166
- git clone https://huggingface.co/black-forest-labs/FLUX.1-dev models/FLUX.1-dev
167
- ```
168
-
169
- The expected model directory structure is:
170
-
171
- ```text
172
- models
173
- ├── RevealLayer
174
- │ ├── pytorch_lora_weights.safetensors
175
- │ ├── layer_pe.pt
176
- │ ├── Refiner.pt
177
- │ ├── xvae
178
- │ │ └── transparent_decoder_ckpt.pth
179
- │ └── ...
180
- ├── FLUX.1-dev
181
- │ ├── transformer
182
- │ ├── vae
183
- │ ├── text_encoder
184
- │ ├── text_encoder_2
185
- │ ├── tokenizer
186
- │ ├── tokenizer_2
187
- │ └── ...
188
- ```
189
-
190
- If your local model directory is different, please modify the corresponding paths in the inference script.
191
-
192
- ---
193
-
194
- ## 🗂️ Prepare input JSON
195
-
196
- The input JSON should contain a list of samples. Each sample should include the input image path and detected bounding boxes.
197
-
198
- Example:
199
-
200
- ```json
201
- [
202
- {
203
- "imgid": "examples",
204
- "full_image": "RevealLayer-Bench/examples/full_image.png",
205
- "background": "RevealLayer-Bench/examples/background.png",
206
- "LayerInfoRaw": [
207
- "RevealLayer-Bench/examples/layer_0.png",
208
- "RevealLayer-Bench/examples/layer_1.png"
209
- ],
210
- "detections": [
211
- {
212
- "bbox": [x1, y1, x2, y2]
213
- },
214
- {
215
- "bbox": [x1, y1, x2, y2]
216
- }
217
- ]
218
- }
219
- ]
220
- ```
221
-
222
- The expected fields are:
223
-
224
- ```text
225
- imgid : sample id
226
- full_image : path to the input RGB image
227
- background : path to the background image, optional for inference
228
- LayerInfoRaw : paths to the ground-truth RGBA layers, optional for inference
229
- detections : detected foreground objects
230
- bbox : bounding box in [x1, y1, x2, y2] format
231
- ```
232
-
233
- ---
234
-
235
- ## ⚡ Inference
236
-
237
- Run inference with:
238
-
239
- ```bash
240
- bash infer.sh 0
241
- ```
242
-
243
- Before running, please make sure the paths in `infer.sh` and `infer_new.py` match your local model and data directories.
244
 
245
  ---
246
 
 
48
  </div>
49
 
50
  <div>
51
+ <a href="https://github.com/360CVGroup/RevealLayer/" target="_blank">
52
  <img src="https://img.shields.io/static/v1?label=Project%20Page&message=Github&color=blue&logo=github-pages">
53
  </a>
54
 
55
+ <a href="https://arxiv.org/abs/2605.11818" target="_blank">
56
  <img src="https://img.shields.io/static/v1?label=Paper&message=arXiv&color=red&logo=arxiv">
57
  </a>
58
 
59
+ <a href="https://huggingface.co/qihoo360/RevealLayer" target="_blank">
60
  <img src="https://img.shields.io/static/v1?label=Dataset&message=RevealLayer&color=green">
61
  </a>
62
 
63
+ <a href="https://huggingface.co/qihoo360/RevealLayer" target="_blank">
64
  <img src="https://img.shields.io/static/v1?label=Model&message=HuggingFace&color=yellow">
65
  </a>
66
  </div>
 
77
  <img style="width:100%" src="assets/demo1.png" alt="RevealLayer teaser">
78
  </div>
79
 
80
+ For more visual results, go checkout our <a href="https://360cvgroup.github.io/RevealLayer/" target="_blank">project page</a>.
81
 
82
  ---
83
 
 
85
 
86
  ## ⭐ Update
87
 
 
 
88
  - **[2026.05]** RevealLayer has been accepted by ICML 2026.
89
+ - **[2026.05]** We released the RevealLayer paper and inference code.
90
+ - **[2026.05]** We released the RevealLayer checkpoint on [Hugging Face](https://huggingface.co/qihoo360/RevealLayer).
91
 
92
  ### ✅ TODO
93
 
 
114
 
115
  We construct a large-scale multi-layer image decomposition dataset, including **RevealLayer-100K** for training and **RevealLayerBench** for evaluation. RevealLayer-100K contains 100K multi-layer natural image tuples with RGB images, background layers, RGBA foreground layers, and bounding boxes. RevealLayerBench contains 200 high-quality manually curated images, covering challenging cases such as complex occlusions, large-area objects, transparent materials, small foreground objects, and multi-layer scenes.
116
 
117
+ 🔥 We will release **RevealLayer-100K** and **RevealLayerBench** on [Hugging Face](https://huggingface.co/qihoo360/RevealLayer). We hope they can serve as useful training and evaluation resources for future research on occlusion-aware image layer decomposition.
118
 
119
  > 🚩 The datasets are intended for research use. Please follow the license and terms provided with the released dataset.
120
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
121
 
122
  ---
123