lower quants ?

#2
by rththr - opened

can you upload a q3ks and q3km quants also ? and can you share the conversion guide

https://huggingface.co/smthem/TwinFlow-Qwen-Image-v1.0-diffusers-gguf/tree/main - Check this repo for the quants.
I used this https://github.com/phil2sat/convert/tree/main/tools tool to quantize it. Steps are given in the repo.

@Arunk25 im getting mat mul error from those qaunts someone recommended no diffusers gguf that worked that it why

@rththr uploaded both the requested quants

Arunk25 changed discussion status to closed

Sign up or log in to comment