RealisDance lora
Am I right to understand that this lora transfer the movements from pose video without forcing the first frame to adapt itself to that of the pose input (like other pose driven implementations often do, to varying degree. At least it seems to less "force" the camera, and stay more true to the input image).
Or is that a happy accident? Works well just transfering pose to an image that is not aligned to the reference pose, and that was quite interesting.
A bit "kling like" motion transfer (in fairness IC-Union-Control also does, but the Realis Dance seemed to look a bit more natural from a few test runs)
Nice lora for sure ;-) Been trying it out a bit today
Honestly at this stage I don't even know, was literally my first attempt at IC-LoRAs, just shared it as some people wanted to try. I do want to achieve what you described, and something closer to what SCAIL is for Wan... currently building new detection method/nodes that use Sam3D-body and then going to try building dataset with that and training further.
Already like the lora, the results are a bit more natural, and not so much a "slave to the video input". Still follows the input, but without forcing the image ref frame to adapt too much.
Sam3D sounds interesting ;-)
Nice, thanks for the upload! Does this work like a regular Control V2V with DWPose?
Nice, thanks for the upload! Does this work like a regular Control V2V with DWPose?
yes, at least thats how i used it, with nice results (can use other pose estimates as well.. SD pose i tried also)
Nice, thanks for the upload! Does this work like a regular Control V2V with DWPose?
Can take a look here https://huggingface.co/Kijai/LTX2.3_comfy/discussions/57