ggml-org
/

Qwen3-8B-GGUF

Model card Files Files and versions

Qwen3-8B

Original model: https://huggingface.co/Qwen/Qwen3-8B

Downloads last month: 2,302

GGUF

Model size

8B params

Architecture

qwen3

Hardware compatibility

Log In to add your hardware

4-bit

8-bit

16-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ggml-org/Qwen3-8B-GGUF

Base model

Qwen/Qwen3-8B-Base

Finetuned

Quantized

(267)

this model

Collection including ggml-org/Qwen3-8B-GGUF

Qwen 3

13 items • Updated Dec 16, 2025 • 9