Any plans to upload F16 or Q8?
#1
by llmtester49 - opened
To enable creating more quants. Thanks for all your work on this!
You can download them from bartowski's repo. I don't want to keep duplicate files here because I am a free user...
https://huggingface.co/bartowski/moonshotai_Kimi-Linear-48B-A3B-Instruct-GGUF
ymcki changed discussion status to closed
Oh Bartowski uploaded them just a few hours after I asked. Thanks!