What tool/framework to test .gguf models?
#4
by bobchenyx - opened
Hi, thanks for all those great quantization versions!
I would like to inquire what kind of tools / frameworks to use, if I'd like to test the performances of certain model? (ex. math. q&a.. etc)
I think llama.cpp only supports ppl?
bobchenyx changed discussion status to closed