Auto-Quantized GGUF Model
This repository contains automated GGUF quantization files for nbeerbower/Qwen3.5-9B-Writing-DPO.
The calibration data for the imatrix is targeted at Chinese novels and role-playing (RP), while preserving logic and common sense.
imatrix ็ๆ กๅๆฐๆฎไปฅไธญๆ็ๅฐ่ฏดใ่ง่ฒๆฎๆผไธบ็ฎๆ ๏ผๅๆถไฟ็้ป่พๅๅธธ่ฏใ
๐ Perplexity Evaluation
(Tested against the provided calibration dataset)
- Base (F16/BF16): PPL = 15.6960 +/- 0.13226
- Q5_K: PPL = 14.7557 +/- 0.12028
- Downloads last month
- 1,305
Hardware compatibility
Log In to add your hardware
Inference Providers NEW
This model isn't deployed by any Inference Provider. ๐ Ask for provider support
Model tree for nuofang/Qwen3.5-9B-Writing-DPO-GGUF
Base model
Qwen/Qwen3.5-9B-Base Finetuned
Qwen/Qwen3.5-9B Finetuned
nbeerbower/Qwen3.5-9B-Writing-DPO