KansenSakura-Symbiosis-12B

Q5 and below are imatrix quants. The imatrix was computed against ubergarm's calibration dataset here.

Quantized from BF16

GGUF

Model size

12B params

Architecture

llama

Hardware compatibility

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Valeciela/KansenSakura-Symbiosis-12B-GGUF

Base model

Quantized

(5)

this model