GGUF model?
#7
by bigfish3 - opened
Getting a quantisized version for this model will be great.@TheBloke
It is possible, at least partially:
Qwen is now officially supported by llama.cpp. You can try creating your own GGUF model~
jklj077 changed discussion status to closed