NVFP4 (SVDQuant) experimental quant for Blackwell — ~13 GB
Hi Phr00t — I quantized v19 to NVFP4 via deepcompressor + nunchaku so it can run natively on RTX 50-series / RTX PRO 6000 (sm_120). Single file, ~13 GB, loads in nunchaku 1.2.1+.
Repo: https://huggingface.co/tacodevs/svdq-fp4_r128-phr00t-qwen-image-edit-v19
Honest caveats are in the model card — it's a touch below your BF16 on prompt adherence for complex scenes (multi-subject edits in particular), but it's clean on simple background/outfit/lighting changes and runs at ~3 s per 4-step 1024² sample on a PRO 6000. I'm calling this v1 / experimental and planning a v2 with rank=32 and a larger calibration set.
The card has a full 4×5 SFW comparison grid (BF16 vs NVFP4, same seed/steps/resolution/prompt) so people can judge for themselves before downloading.
Recipe summary:
- 128 calibration pairs at v19's native 4-step Lightning recipe (
fmeuler4-g1.0, guidance=1.0) - SVDQuant: weight=fp4_e2m1_all, activation=fp4_e2m1_all, scale=fp8_e4m3_nan, group_size=16, low_rank rank=128
- Smoothing per-block, then GPTQ + final fp4 weight pack via lantudou's deepcompressor fork
- Merged to single safetensors with embedded diffusers config + nunchaku quantization metadata
If you have any guidance on your training/distillation recipe that would help me calibrate better, or if you'd rather I not host derivatives, just let me know and I'll act accordingly. Either way, thanks for v19 — it's a great base.
Here's a small sample of the 4×5 grid (full grid + prompts in the model card). Each row is source → BF16 (your v19) → NVFP4 (my quant), same seed (42), 4 steps, 1024², matching prompts.
Cozy interior / warm light
| Source | BF16 v19 | NVFP4 (13 GB) |
|---|---|---|
 |
 |
 |
Now sitting in a cozy old library, reading a leather-bound book at a wooden table. Tall bookshelves around her, warm pendant lighting, soft golden glow, focused expression.
Dramatic neon / wet street
| Source | BF16 v19 | NVFP4 (13 GB) |
|---|---|---|
 |
 |
 |
Now walking through a rainy neon-lit Tokyo street at night. Wearing a stylish dark jacket, holding a transparent umbrella, reflections of pink and blue neon signs on wet pavement, cinematic dramatic lighting.
Atmospheric / preserve a non-trivial feature (pointed ears)
| Source | BF16 v19 | NVFP4 (13 GB) |
|---|---|---|
 |
 |
 |
Same elf woman from image1, keep the exact same face and pointed ears. Now hiking on a rocky mountain trail at sunrise. Wearing practical outdoor gear with a small backpack, golden morning light hitting her face, snow-capped peaks in the distance, determined confident expression.
Outdoor / soft natural light
| Source | BF16 v19 | NVFP4 (13 GB) |
|---|---|---|
 |
 |
 |
Now standing in a sunlit spring garden full of cherry blossoms. Wearing a soft pastel sundress, petals drifting in the breeze, dappled afternoon light, gentle smile, serene mood.
The remaining 16 comparisons (5 situations × 4 subjects) are in the model card if you want to see how it handles other prompts and lighting setups.