Bittery 🤘😎
#1
by McG-221 - opened
Hi, did you hand-select the layers, which should stay higher precision? This quant basically is, what I've been looking for...
Hi. Yes, I use my own conversion script, where I can set the quantization parameters depending on the tensor name or layer number
TheCluster changed discussion status to closed