Qwen2.5 0.5B Instruct parity GGUF (Q8_0)
This repo contains a same-origin GGUF parity artifact derived from Qwen/Qwen2.5-0.5B-Instruct for backend parity testing with mesh-llm.
Validated exact pair:
- GGUF:
meshllm/qwen2.5-0.5b-instruct-parity-q8_0-gguf - MLX:
meshllm/qwen2.5-0.5b-instruct-parity-8bit-mlx
Exact validation result:
- GGUF exact: PASS
- MLX exact: PASS
- prompt-by-prompt outputs matched on the checked-in exact suite used by
mesh-llm
Artifact:
qwen2.5-0.5b-instruct-q8_0.gguf
- Downloads last month
- 95
Hardware compatibility
Log In to add your hardware
8-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support