Are you planning to make gemma-3-27b-it-abliterated compatible with LTX-2 anytime soon?
π
Sure I'll have to try it out first though. My hunch is given that LTX2 was trained on the 12b model, the 27b may have embeddings the DiT doesn't understand and will generate strange results. But hey, one way to find out. Maybe a week or so before I have good internet again to see how it goes.
These models can't be used with image node connected, right?
Seems so, the TextGenerateLTX2Prompt node breaks with the error "mat1 and mat2 shapes cannot be multiplied (4096x1152 and 4304x1152)" when you input an image to it and the node works without the image input. But otherwise it works great! (The original text encoder works with an image input for that node.)
Seems so, the TextGenerateLTX2Prompt node breaks with the error "mat1 and mat2 shapes cannot be multiplied (4096x1152 and 4304x1152)" when you input an image to it and the node works without the image input. But otherwise it works great! (The original text encoder works with an image input for that node.)
I'll have to try again to see if anything recent has changed, if I remember correctly I was able to use img2vid and this text encoder. I had that same error using the original video preview node that was provided. However changing that to the Video Combine node it had worked okay.
Ahh the error I was thinking of was [Errno 22] Invalid argument: 'avcodec_send_frame()'; last error log: [aac] Input contains (near) NaN/+-Inf so it's not related.
I had tried again with image2video, using LTX2.0 ComfyUI template. I swapped out some nodes for multi GPU nodes to avoid OOM errors and it seems it's working okay with both the fp8 and fuller version of this text encoder. I also haven't updated my ComfyUI in a couple of weeks. I was using the non distilled version with the fp8 LTX2 model.
Are you trying with the latest LTX 2.3? Just trying to think of things which would break it. There was also another comment with the same error just today too.
this version include vision capablity?
https://huggingface.co/DreamFast/gemma-3-12b-it-heretic-v2 check out version 2 with vision support and nvfp4. I'll leave this thread open for others to read easier.
Tested okay for me here. Let me know how it goes!