KansenSakura-Symbiosis-12B

File	Notes
KansenSakura-Symbiosis-12B.Q6_K_XL.gguf	Q6_K with select tensors quantized to Q8_0 7.23 bpw ~10% increase in size relative to Q6_K Quantized from BF16 Very close in fidelity to full precision

GGUF

Model size

12B params

Architecture

llama

Hardware compatibility

6-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Valeciela/KansenSakura-Symbiosis-12B-Q6_K_XL-GGUF

Base model

Quantized

(5)

this model