NeuR0mancR/Pale-Sonneteer-24B-GGUF

"Je meurs aussi de ta mélancolie... Un soir de demi-brume" – Émile Nelligan

Pale Sonneteer - Gothic Poet

The GGUF version of my first model. An experiment with karcher. The Pale Sonneteer is a writing/RP model.

About

These are static and weighted/imatrix quants of https://huggingface.co/NeuR0mancR/Pale-Sonneteer

The IQ-quants and imatrix quants were calibrated with a custom importance matrix to preserve metaphorical depth and dark-academic vocabulary, to stay in line with the model's theme. Feel free to requantize with your own if you desire to preserve a different set of weights. The imatrix.dat used is included in this repo. IQ quants are recommended over similar sized non-IQ quantization.

Feel free to share your feedbacks and let me know if you encounter weird behaviour during inference.

Note: The IQ and K_M quants use the custom Gothic imatrix. Static quants (Q6_K, Q8_0) are provided for purists.