Qwen3-30B-A3B-Instruct-2507-REAM-GGUF

This model was converted to GGUF format from SamsungSAILMontreal/Qwen3-30B-A3B-Instruct-2507-REAM using GGUF Forge.

Quants

The following quants are available: Q3_K_S, Q2_K, Q3_K_M, Q3_K_L, Q4_K_S, Q4_0, Q5_0, Q4_K_M, Q5_K_S, Q5_K_M, Q8_0, Q6_K

Ollama Support

Full Ollama support is provided by merging any sharded GGUF output into a single file after quantization.

Conversion Stats

Metric Value
Job ID b930f007-50fb-4239-af0c-c828f7b46dc8
GGUF Forge Version v6.2
Total Time 1.4h
Avg Time per Quant 7.9min

Step Breakdown

  • Download: 6.7min
  • FP16 Conversion: 5.0min
  • Quantization: 1.2h

πŸš€ Convert Your Own Models

Want to convert more models to GGUF?

πŸ‘‰ gguforge.com β€” Free hosted GGUF conversion service. Login with HuggingFace and request conversions instantly!

Links

  • 🌐 Free Hosted Service: gguforge.com
  • πŸ› οΈ Self-host GGUF Forge: GitHub
  • πŸ“¦ llama.cpp (quantization engine): GitHub
  • πŸ’¬ Community & Support: Discord

Converted automatically by GGUF Forge v6.2

Downloads last month
123
GGUF
Model size
23B params
Architecture
qwen3moe
Hardware compatibility
Log In to add your hardware

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
This model isn't deployed by any Inference Provider. πŸ™‹ Ask for provider support

Model tree for Akicou/Qwen3-30B-A3B-Instruct-2507-REAM-GGUF