This repo only contains the Q8, Q6, Q5, & Q4 GGUF files of Clouded Uchtave v0.1

For the details of this model, please refer to the orginal model card here.

Downloads last month
15
GGUF
Model size
8B params
Architecture
llama
Hardware compatibility
Log In to add your hardware

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for kromquant/L3.1-Clouded-Uchtave-v0.1-8B-GGUFs

Quantized
(3)
this model