unsloth/LTX-2.3-GGUF · Why it gives me OOM with 21gb gguf model but gens fine with 27gb fp8 safetensor?

Why it gives me OOM with 21gb gguf model but gens fine with 27gb fp8 safetensor?

#12

by Zuzuus - opened 30 days ago

I'm using the same workflow, same parameters, the only change is for the gguf loader and gguf text encoder.
I have 16gb vram and 32gb ram

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment