Q4 or Q6
#9
by shikimahs - opened
Any plan to do a Q4 or Q6? I hard time to run this one in a 12vRAM GPU
FHDR_ComfyUI-Q4_K_M.gguf is now available for you. Enjoy, friend!
How to use FHDR_ComfyUI-Q4_K_M.gguf ?
FluxPipeline diffuser doesn't support it.
Any simple Python example maybe?
Thanks in advance!