Instructions to use mlx-community/HiDream-O1-Image-Dev-mlx-q6 with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- MLX
How to use mlx-community/HiDream-O1-Image-Dev-mlx-q6 with MLX:
# Download the model from the Hub pip install huggingface_hub[hf_xet] huggingface-cli download --local-dir HiDream-O1-Image-Dev-mlx-q6 mlx-community/HiDream-O1-Image-Dev-mlx-q6
- Notebooks
- Google Colab
- Kaggle
- Local Apps
- LM Studio
| license: mit | |
| base_model: HiDream-ai/HiDream-O1-Image-Dev | |
| tags: | |
| - mlx | |
| - mlx-vlm | |
| - hidream | |
| - text-to-image | |
| - apple-silicon | |
| - quantized | |
| - q6 | |
| language: | |
| - en | |
| pipeline_tag: text-to-image | |
| library_name: mlx | |
| inference: false | |
| authors: | |
| - Mrbizarro | |
| # HiDream-O1-Image-Dev β MLX Q6 (Apple Silicon) | |
| > Ported by **[Mrbizarro](https://huggingface.co/Mrbizarro)** Β· MIT licensed Β· published to mlx-community | |
| ## ποΈ Run it one-click in **[Phosphene](https://github.com/mrbizarro/phosphene)** | |
| Phosphene is a free local generative-video panel for Apple Silicon. HiDream is wired into its Image Studio. **[Install Pinokio](https://pinokio.computer)**, then in Pinokio install [Phosphene](https://github.com/mrbizarro/phosphene). Note: Phosphene's HiDream integration uses BF16 by default since **edit requires BF16** β this Q6 repo is for text-to-image-only workflows on RAM-constrained machines. | |
| --- | |
| A 6-bit quantized MLX port of [HiDream-ai/HiDream-O1-Image-Dev](https://huggingface.co/HiDream-ai/HiDream-O1-Image-Dev). | |
| **β Q6 does NOT support edit / multi-ref.** Per-group dequantization noise compounds against reference-image features in attention and produces degenerate output. For edit / multi-reference workflows use the [BF16 sibling repo](https://huggingface.co/mlx-community/HiDream-O1-Image-Dev-mlx-bf16) instead. | |
| ## Sibling repos | |
| - π’ **[BF16 (full precision)](https://huggingface.co/mlx-community/HiDream-O1-Image-Dev-mlx-bf16)** β 17.5 GB, ~16 GB RAM, clean across all dimensions. **Use this when in doubt.** | |
| - π‘ **Q6 (this repo)** β 8 GB, ~8.5 GB RAM, fast. **Best at square 2048Γ2048 or 1024Γ1024.** Visible 32-pixel patch grid in flat regions at non-square dims. | |
| - π‘ [Q8](https://huggingface.co/mlx-community/HiDream-O1-Image-Dev-mlx-q8) β 10 GB, ~11.5 GB RAM, same artifact behaviour as Q6 at non-square dims. | |
| ## When to use Q6 | |
| - β **Square 1024Γ1024 or 2048Γ2048** β clean output, half the time of BF16 | |
| - β **RAM-constrained** β fits 16 GB Macs alongside other apps | |
| - β **Non-square dims (1440Γ2560, 3104Γ1312, etc)** β visible 32-pixel patch grid in skies, walls, water β use BF16 | |
| ## What's in this repo | |
| - `model.safetensors` β Q6 quantized backbone (8 GB) | |
| - `extras/custom_heads.safetensors` β diffusion-side heads (75 MB, BF16) | |
| - `config.json` (with `quantization: {bits: 6, group_size: 64}` so mlx-vlm wraps `Linear β QuantizedLinear` correctly) | |
| - Tokenizer + processor configs | |
| ## Code | |
| The inference scripts are **not** in this repo β they live in the [BF16 sibling repo](https://huggingface.co/mlx-community/HiDream-O1-Image-Dev-mlx-bf16) under `scripts/hidream_o1/`. Clone that for code, this for weights only. | |
| ## Quick start | |
| ```bash | |
| # Get the code | |
| hf download mlx-community/HiDream-O1-Image-Dev-mlx-bf16 --local-dir hidream-o1-mlx \ | |
| --include "scripts/*" --include "*.md" --include "*.txt" --include "*.gitattributes" | |
| cd hidream-o1-mlx | |
| uv venv --python 3.11 && uv pip install -r requirements.txt | |
| # Get the Q6 weights | |
| hf download mlx-community/HiDream-O1-Image-Dev-mlx-q6 --local-dir mlx_models/hidream-o1-dev-q6 | |
| # Run (square dims only for clean output) | |
| .venv/bin/python scripts/hidream_o1/generate_hidream_o1_mlx.py \ | |
| --model-path mlx_models/hidream-o1-dev-q6 \ | |
| --prompt "your prompt here" \ | |
| --width 2048 --height 2048 \ | |
| --output out.png | |
| ``` | |
| ## Performance | |
| | Resolution | Per step | Total (28 steps) | Peak RAM | Quality | | |
| |---|---|---|---|---| | |
| | 1024Γ1024 | 1.30 s | 36 s | 8.5 GB | β clean | | |
| | 2048Γ2048 | 5.51 s | 154 s | 9 GB | β clean | | |
| | 1440Γ2560 (non-square) | 4.50 s | 127 s | 8.5 GB | β patch grid visible | | |
| ## License | |
| MIT β see the [BF16 repo](https://huggingface.co/mlx-community/HiDream-O1-Image-Dev-mlx-bf16) for the full LICENSE file and acknowledgements. | |