Instructions to use joyfox/Wan2.1-Fight-LoRA with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Diffusers
How to use joyfox/Wan2.1-Fight-LoRA with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image, export_to_video # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("Wan-AI/Wan2.1-I2V-14B-720P,Wan-AI/Wan2.1-I2V-14B-720P-Diffusers", dtype=torch.bfloat16, device_map="cuda") pipe.load_lora_weights("joyfox/Wan2.1-Fight-LoRA") prompt = "dajia,这是一个两个人对打得视频,镜头拉远,保持人物不变,这两个人开始对打,两个人不断旋转,拳打脚踢,姿势像是传统武术, 十分专业,两个人相互比试,打的有来有回,突然左边的人腾空跳起,保持飞在空中用腿不停踢另一个人上半身, 男人被踢得一边用手阻挡女人的飞踢一边后退,镜头跟随,保持背景和人物的服装不改变." input_image = load_image("https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png") image = pipe(image=input_image, prompt=prompt).frames[0] export_to_video(output, "output.mp4") - Notebooks
- Google Colab
- Kaggle
- Local Apps
- Draw Things
Update README.md
Browse files
README.md
CHANGED
|
@@ -54,7 +54,7 @@ widget:
|
|
| 54 |
<h2 style="color: #24292e; margin-top: 0;">Community</h2>
|
| 55 |
<ul style="margin-bottom: 0;">
|
| 56 |
<li>
|
| 57 |
-
<b>
|
| 58 |
<a href="https://www.vvicat.com/" style="color: #0366d6; text-decoration: none;">
|
| 59 |
Join us to generate interesting video models together
|
| 60 |
</a> to generate videos with this LoRA for free
|
|
@@ -140,37 +140,4 @@ export_to_video(output, "output.mp4", fps=16)
|
|
| 140 |
</div>
|
| 141 |
<p>Simply replace <code style="background-color: #f0f0f0; padding: 3px 6px; border-radius: 4px;">[object]</code> with whatever you want to see squished!</p>
|
| 142 |
</div>
|
| 143 |
-
|
| 144 |
-
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
| 145 |
-
<h2 style="color: #24292e; margin-top: 0;">ComfyUI Workflow</h2>
|
| 146 |
-
<p>This LoRA works with a modified version of <a href="https://github.com/kijai/ComfyUI-WanVideoWrapper/blob/main/example_workflows/wanvideo_480p_I2V_example_02.json" style="color: #0366d6; text-decoration: none;">Kijai's Wan Video Wrapper workflow</a>. The main modification is adding a Wan LoRA node connected to the base model.</p>
|
| 147 |
-
<img src="./workflow/workflow_screenshot.png" style="width: 100%; border-radius: 8px; margin: 15px 0; box-shadow: 0 4px 8px rgba(0,0,0,0.1);">
|
| 148 |
-
<p>See the Downloads section above for the modified workflow.</p>
|
| 149 |
-
</div>
|
| 150 |
-
</div>
|
| 151 |
-
|
| 152 |
-
<div style="background-color: #f8f9fa; padding: 20px; border-radius: 10px; margin-bottom: 20px;">
|
| 153 |
-
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
| 154 |
-
<h2 style="color: #24292e; margin-top: 0;">Model Information</h2>
|
| 155 |
-
<p>The model weights are available in Safetensors format. See the Downloads section above.</p>
|
| 156 |
-
</div>
|
| 157 |
-
|
| 158 |
-
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
| 159 |
-
<h2 style="color: #24292e; margin-top: 0;">Training Details</h2>
|
| 160 |
-
<ul style="margin-bottom: 0;">
|
| 161 |
-
<li><b>Base Model:</b> Wan2.1 14B I2V 480p</li>
|
| 162 |
-
<li><b>Training Data:</b> 1.5 minutes of video (20 short clips of things being squished)</li>
|
| 163 |
-
<li><b>Epochs:</b> 18</li>
|
| 164 |
-
</ul>
|
| 165 |
-
</div>
|
| 166 |
-
|
| 167 |
-
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
| 168 |
-
<h2 style="color: #24292e; margin-top: 0;">Additional Information</h2>
|
| 169 |
-
<p>Training was done using <a href="https://github.com/tdrussell/diffusion-pipe" style="color: #0366d6; text-decoration: none;">Diffusion Pipe for Training</a></p>
|
| 170 |
-
</div>
|
| 171 |
-
|
| 172 |
-
<div style="background-color: white; padding: 15px; border-radius: 8px; margin: 15px 0; box-shadow: 0 2px 4px rgba(0,0,0,0.1);">
|
| 173 |
-
<h2 style="color: #24292e; margin-top: 0;">Acknowledgments</h2>
|
| 174 |
-
<p style="margin-bottom: 0;">Special thanks to Kijai for the ComfyUI Wan Video Wrapper and tdrussell for the training scripts!</p>
|
| 175 |
-
</div>
|
| 176 |
-
</div>
|
|
|
|
| 54 |
<h2 style="color: #24292e; margin-top: 0;">Community</h2>
|
| 55 |
<ul style="margin-bottom: 0;">
|
| 56 |
<li>
|
| 57 |
+
<b>Company:</b>
|
| 58 |
<a href="https://www.vvicat.com/" style="color: #0366d6; text-decoration: none;">
|
| 59 |
Join us to generate interesting video models together
|
| 60 |
</a> to generate videos with this LoRA for free
|
|
|
|
| 140 |
</div>
|
| 141 |
<p>Simply replace <code style="background-color: #f0f0f0; padding: 3px 6px; border-radius: 4px;">[object]</code> with whatever you want to see squished!</p>
|
| 142 |
</div>
|
| 143 |
+
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|