It's just quantization

My friends really, really love the RouWei model version 0.8, but they have weak laptops. I decided to solve this problem and created a quantized version of this neural network.

Problems!

Yes, this neural network has a small problem. Even though I used the Vpred neural network as a basis, ComfyUI still loads as Epsilon, so before connecting to Ksampler, you'll need ModelSamplingDiscrete. To load, use the ComfyUI-GGUF library.

Thanks!

Downloads last month
228
GGUF
Model size
3B params
Architecture
Hardware compatibility
Log In to add your hardware

2-bit

4-bit

5-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐Ÿ™‹ Ask for provider support

Model tree for YakovSava/RouWei-08-gguf