New tool to benchmark GGUF files
#9
by Nerdsking - opened
Hi friends,
I created a tool to benchmark gguf files. You may find it at https://github.com/nerdskingcom/gguf-humaneval-benchmark
Feel free to drop a star if you find it usefull.
Or simply use : "pip install gguf-humaneval-benchmark".
Glad to see others are working on rolling up some benchmarking tools. I was working on something similar for internal usage today. Thx for the contrib :)
Thanks for your comments. I am glad it is being of help.