Thank you!
#2
by Puchacz19 - opened
The king has deliver another banger. Thanks! I hope The Bloke will make gguf quants now.
Thank you for the kind words. I included a exl2 measurement file based on the pippa dataset to help accelerate the production of exl2 "rpcal" quants. I am going to try to do that for all my models going forward.
sophosympatheia changed discussion status to closed
@Puchacz19 , you can find a few of my quants here: https://huggingface.co/Artefact2/Midnight-Rose-103B-v1.0-GGUF
Regards