imatrix.dat file
#2
by sokann - opened
Hi, can you share the imatrix.dat file generated from calibration_datav3_gguf.txt? The KLD score for the Q8_0-IQ3_XXS-IQ3_XXS-IQ3_S quant looks amazing, but it is a bit too big to fit into my machine, so I would like to make a smaller one with IQK quants. Thanks 😄
I've uploaded the imatrix.gguf for llama.cpp to https://huggingface.co/AesSedai/GLM-4.5-GGUF/blob/main/imatrix.gguf