lilyanatia
/

Bonsai-4B-requantized

Model card Files Files and versions

requantized Bonsai-4B for software that doesn't support Q1_0 quantization.

Downloads last month: 1,860

GGUF

Model size

4B params

Architecture

qwen3

Hardware compatibility

Log In to add your hardware

1-bit

2-bit

View +1 variant

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for lilyanatia/Bonsai-4B-requantized

Base model

prism-ml/Bonsai-4B-unpacked

Quantized

prism-ml/Bonsai-4B-gguf

Quantized

(1)

this model

Space using lilyanatia/Bonsai-4B-requantized 1

Collection including lilyanatia/Bonsai-4B-requantized

Bonsai requantized

requantized Bonsai for software that doesn't support Q1_0 quantization. • 3 items • Updated about 18 hours ago • 2