Abliterate on models with low KLD

#8
by sebastienbo - opened

Hi

Is it possible to only used models with low KLD ?

See https://www.reddit.com/r/LocalLLaMA/comments/1rfds1h/qwen3535ba3b_q4_quantization_comparison/

Because abliteration makes KLD usually a bit worse.

Sign up or log in to comment