Update README.md
Browse files
README.md
CHANGED
|
@@ -13,19 +13,19 @@ This is the official repo for paper [StableMotion: Repurposing Diffusion-Based I
|
|
| 13 |
|
| 14 |
## StableMotion for Stitched Image Rectangling (SIR)
|
| 15 |
### Inference
|
| 16 |
-
0. Download the checkpoints of
|
| 17 |
-
1. Run
|
| 18 |
-
2. Run
|
| 19 |
|
| 20 |
### Training
|
| 21 |
0. Replicate [RecDiffusion](https://github.com/lhaippp/RecDiffusion) to get pseudo labels, i.e., the flow labels generated by [RecDiffusion](https://github.com/lhaippp/RecDiffusion) on the training set of [DIR-D](https://drive.google.com/file/d/1KR5DtekPJin3bmQPlTGP4wbM1zFR80ak/view?usp=sharing). Put and rename it into `StableMotion_SIR/MDM_Flow`.
|
| 22 |
-
1. Run
|
| 23 |
|
| 24 |
## StableMotion for Rolling Shutter Correction (RSC)
|
| 25 |
### Inference
|
| 26 |
-
0. Download the checkpoints of
|
| 27 |
-
1. Run
|
| 28 |
-
2. Run
|
| 29 |
|
| 30 |
### Training
|
| 31 |
-
Run
|
|
|
|
| 13 |
|
| 14 |
## StableMotion for Stitched Image Rectangling (SIR)
|
| 15 |
### Inference
|
| 16 |
+
0. Download the checkpoints of `StableMotion_SIR`
|
| 17 |
+
1. Run `cd StableMotion_SIR && sh sample.sh`. You may want to change this file to modify the inference configurations.
|
| 18 |
+
2. Run `sh metrics.sh` to evaluate the results.
|
| 19 |
|
| 20 |
### Training
|
| 21 |
0. Replicate [RecDiffusion](https://github.com/lhaippp/RecDiffusion) to get pseudo labels, i.e., the flow labels generated by [RecDiffusion](https://github.com/lhaippp/RecDiffusion) on the training set of [DIR-D](https://drive.google.com/file/d/1KR5DtekPJin3bmQPlTGP4wbM1zFR80ak/view?usp=sharing). Put and rename it into `StableMotion_SIR/MDM_Flow`.
|
| 22 |
+
1. Run `cd StableMotion_SIR && sh train.sh`. You may want to change this file to modify the training configurations. The default configuration requires approximately 80 GB of VRAM per card.
|
| 23 |
|
| 24 |
## StableMotion for Rolling Shutter Correction (RSC)
|
| 25 |
### Inference
|
| 26 |
+
0. Download the checkpoints of `StableMotion_RSC`
|
| 27 |
+
1. Run `cd StableMotion_RSC && sh sample.sh`. You may want to change this file to modify the inference configurations.
|
| 28 |
+
2. Run `sh metrics.sh` to evaluate the results.
|
| 29 |
|
| 30 |
### Training
|
| 31 |
+
Run `cd StableMotion_RSC && sh train.sh`. You may want to change this file to modify the training configurations. The default configuration requires approximately 40 GB of VRAM per card.
|