How to use joyfox/LTX-2.3-Transition-LORA with Diffusers:
pip install -U diffusers transformers accelerate
import torch from diffusers import DiffusionPipeline from diffusers.utils import load_image, export_to_video # switch to "mps" for apple devices pipe = DiffusionPipeline.from_pretrained("Lightricks/LTX-2.3", dtype=torch.bfloat16, device_map="cuda") pipe.load_lora_weights("joyfox/LTX-2.3-Transition-LORA") prompt = "A medium close-up captures a young woman with wavy brown hair and a soft smile in a sun-drenched wooden room, her hands delicately clasped over a white embroidered sweater. As the camera slowly dollies forward, a seamless transformation occurs where her facial features gradually sharpen and her hair shortens into a dark, textured style, morphing her into a young man with a slight, knowing smirk. The delicate floral patterns on her garment shift and merge into a dark leaf motif on a beige knit sweater, maintaining the soft, warm lighting that highlights the grain of the wooden wall and the green leaves of the plant behind them. His hands reposition naturally during the transition, with one hand forming a loose fist near his chest as the movement settles into a calm, steady gaze toward the lens. The ambient sound of a gentle breeze rustling nearby indoor plants and the faint, rhythmic ticking of a wall clock fills the quiet space, emphasizing the fluid and magical nature of the character's evolution, zhuanchang" input_image = load_image("https://huggingface.co/datasets/huggingface/documentation-images/resolve/main/diffusers/guitar-man.png") image = pipe(image=input_image, prompt=prompt).frames[0] export_to_video(output, "output.mp4")
