Hello, RUNE - i notice a new WF of CONTROL LORA - can i do a tango dance with this?

#98
by Liquidmind111 - opened

my friends love my LIPSYNCHS, but they want a change, they want me to put a woman we know dancing tango.... can this be done with any of these WF of control DW or SD pose? using a reference video and image?

Yes. If I understood you correctly

It will take an input image. And make it move to the body movements of an input video
So in this case the input image could be the woman, and the input video could be the tango dance.

with one caveat. Its a one character workflow. For multiple characters it becomes more complicated, and will add something for that as soon as some of the new stuff Kijai has made is added into ComfyUI (Sam3 and/or multi character skeleton pose)

Or actually two caveats, LTX is not the best on fast movements (might be better if using DEV mode though). But tango dance might be slow enough ;-)

And it will help a lot if your friends photo is somewhat similar to that of the first frame of the input video (framing, pose).
I am making version of the workflow where Flux Klein will reposition the input image to match the first frame, will add that soon. It should work even better ;-)

Sign up or log in to comment