Abliterate on models with low KLD
#8
by sebastienbo - opened
Hi
Is it possible to only used models with low KLD ?
See https://www.reddit.com/r/LocalLLaMA/comments/1rfds1h/qwen3535ba3b_q4_quantization_comparison/
Because abliteration makes KLD usually a bit worse.