wileewang commited on
Commit
fdcfa96
·
verified ·
1 Parent(s): ef8459f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -22
README.md CHANGED
@@ -14,20 +14,19 @@ tags:
14
  <img src="https://github.com/wileewang/LongLive2.0/blob/release-clean-merge/assets/longlive2/logo.png?raw=true" alt="LongLive2.0 logo" width="100%">
15
  </p>
16
 
17
- # LongLive2.0 5B Checkpoints
18
 
19
- This repository hosts temporary LongLive2.0 5B checkpoints for inference with
20
  the LongLive2.0 release code:
21
 
22
  https://github.com/wileewang/LongLive2.0
23
 
24
- The checkpoint package contains two parts:
 
 
25
 
26
- - **Base generator checkpoint**: the AR-trained Wan2.2-TI2V-5B generator.
27
- - **LoRA checkpoint**: the DMD-distilled few-step LoRA adapter.
28
-
29
- LongLive2.0 inference loads the base generator first, applies the LoRA modules,
30
- and then loads the LoRA weights.
31
 
32
  ## Installation
33
 
@@ -65,15 +64,7 @@ Edit `configs/inference.yaml`:
65
 
66
  ```yaml
67
  checkpoints:
68
- generator_ckpt: checkpoints/longlive2_5b/path/to/base_generator.pt
69
- lora_ckpt: checkpoints/longlive2_5b/path/to/dmd_lora.pt
70
-
71
- adapter:
72
- type: lora
73
- rank: 128
74
- alpha: 128
75
- dropout: 0.0
76
- verbose: true
77
 
78
  data:
79
  data_path: /path/to/inference_prompts
@@ -89,9 +80,10 @@ inference:
89
  multi_shot_rope_offset: 8
90
  ```
91
 
92
- Replace the checkpoint filenames above with the actual files in this repository.
93
- If the LoRA checkpoint is not used, remove the `adapter` section and leave
94
- `lora_ckpt` unset.
 
95
 
96
  ## Prompt Folder
97
 
@@ -159,8 +151,10 @@ Outputs are written to `output_folder`.
159
 
160
  ## Notes
161
 
162
- - The base checkpoint and LoRA checkpoint should be loaded together for the
163
- few-step DMD model.
 
 
164
  - `inference.sampling_steps` controls the number of denoising steps.
165
  - `inference.multi_shot_sink` enables the multi-shot attention sink.
166
  - `inference.multi_shot_rope_offset` controls the multi-shot RoPE offset.
 
14
  <img src="https://github.com/wileewang/LongLive2.0/blob/release-clean-merge/assets/longlive2/logo.png?raw=true" alt="LongLive2.0 logo" width="100%">
15
  </p>
16
 
17
+ # LongLive2.0 5B Checkpoint
18
 
19
+ This repository hosts the LongLive2.0 5B checkpoint for inference with
20
  the LongLive2.0 release code:
21
 
22
  https://github.com/wileewang/LongLive2.0
23
 
24
+ The checkpoint package contains a ready-to-use merged generator checkpoint. The
25
+ AR-trained base generator and DMD-distilled LoRA adapter have already been
26
+ merged, so standard inference only needs to load one `generator_ckpt`.
27
 
28
+ Do not configure a separate `lora_ckpt` or `adapter` section when using the
29
+ merged checkpoint, otherwise the LoRA adapter would be applied a second time.
 
 
 
30
 
31
  ## Installation
32
 
 
64
 
65
  ```yaml
66
  checkpoints:
67
+ generator_ckpt: checkpoints/longlive2_5b/merged_generator.pt
 
 
 
 
 
 
 
 
68
 
69
  data:
70
  data_path: /path/to/inference_prompts
 
80
  multi_shot_rope_offset: 8
81
  ```
82
 
83
+ Replace `merged_generator.pt` with the actual merged checkpoint filename in this
84
+ repository. If your local config was copied from a base+LoRA setup, remove
85
+ `checkpoints.lora_ckpt` and the top-level `adapter` section before running
86
+ inference.
87
 
88
  ## Prompt Folder
89
 
 
151
 
152
  ## Notes
153
 
154
+ - The released BF16 checkpoint is already merged; standard inference only needs
155
+ `checkpoints.generator_ckpt`.
156
+ - Do not set `checkpoints.lora_ckpt` or `adapter` when using the merged
157
+ checkpoint.
158
  - `inference.sampling_steps` controls the number of denoising steps.
159
  - `inference.multi_shot_sink` enables the multi-shot attention sink.
160
  - `inference.multi_shot_rope_offset` controls the multi-shot RoPE offset.