gguf models and quantizations?
#1
by AutomaticHourglass - opened
Is there a possibility to publish quantized models(especially q8) and gguf models?
You don’t need to do hat, I will publish the gguf models later this day, but in you still want to, go ahead.
Please do, I’ll continue following you.
Hey, I'm starting to upload the quants.
Goekdeniz-Guelmez changed discussion status to closed