lilyanatia
/

Bonsai-8B-requantized

Model card Files Files and versions

requantized Bonsai-8B for software that doesn't support Q1_0_g128 quantization.

Downloads last month: 6,875

GGUF

Model size

8B params

Architecture

qwen3

Hardware compatibility

Log In to add your hardware

1-bit

2-bit

View +1 variant

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for lilyanatia/Bonsai-8B-requantized

Base model

prism-ml/Bonsai-8B-gguf

Quantized

(1)

this model

Collection including lilyanatia/Bonsai-8B-requantized

Bonsai requantized

requantized Bonsai for software that doesn't support Q1_0_g128 quantization. • 3 items • Updated 9 days ago • 2