Add mirror README with usage instructions
Browse files
README.md
ADDED
|
@@ -0,0 +1,96 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
pipeline_tag: image-to-image
|
| 4 |
+
tags:
|
| 5 |
+
- flux
|
| 6 |
+
- inpainting
|
| 7 |
+
- image-editing
|
| 8 |
+
- diffusion
|
| 9 |
+
- safetensors
|
| 10 |
+
base_model: black-forest-labs/FLUX.2-klein-4B
|
| 11 |
+
---
|
| 12 |
+
|
| 13 |
+
# FLUX Klein 4B — AEmotionStudio Mirror
|
| 14 |
+
|
| 15 |
+
**Mirror of [black-forest-labs/FLUX.2-klein-4B](https://huggingface.co/black-forest-labs/FLUX.2-klein-4B)** for use with [ComfyUI-FFMPEGA](https://github.com/AEmotionStudio/ComfyUI-FFMPEGA).
|
| 16 |
+
|
| 17 |
+
## About
|
| 18 |
+
|
| 19 |
+
FLUX Klein is a 4-billion parameter image editing and generation model from [Black Forest Labs](https://blackforestlabs.ai/). It supports:
|
| 20 |
+
|
| 21 |
+
- **Object removal** — erase unwanted objects from images/video frames
|
| 22 |
+
- **Text-guided editing** — change hair color, swap backgrounds, modify clothing, etc.
|
| 23 |
+
- **Inpainting** — fill masked regions with contextually appropriate content
|
| 24 |
+
|
| 25 |
+
This mirror provides the same bf16 safetensors weights as the upstream repo, hosted on AEmotionStudio infrastructure for supply-chain resilience.
|
| 26 |
+
|
| 27 |
+
## Model Details
|
| 28 |
+
|
| 29 |
+
| Property | Value |
|
| 30 |
+
|----------|-------|
|
| 31 |
+
| **Architecture** | FLUX (Rectified Flow Transformer) |
|
| 32 |
+
| **Parameters** | 4B |
|
| 33 |
+
| **Precision** | bf16 (bfloat16) |
|
| 34 |
+
| **Total Size** | ~15 GB |
|
| 35 |
+
| **License** | [Apache 2.0](https://www.apache.org/licenses/LICENSE-2.0) |
|
| 36 |
+
| **Source** | [black-forest-labs/FLUX.2-klein-4B](https://huggingface.co/black-forest-labs/FLUX.2-klein-4B) |
|
| 37 |
+
|
| 38 |
+
### Files
|
| 39 |
+
|
| 40 |
+
| Component | File | Size |
|
| 41 |
+
|-----------|------|------|
|
| 42 |
+
| Transformer | `transformer/diffusion_pytorch_model.safetensors` | 7.4 GB |
|
| 43 |
+
| Text Encoder (T5-XXL) | `text_encoder/model-00001-of-00002.safetensors` | 4.7 GB |
|
| 44 |
+
| Text Encoder (T5-XXL) | `text_encoder/model-00002-of-00002.safetensors` | 2.9 GB |
|
| 45 |
+
| VAE | `vae/diffusion_pytorch_model.safetensors` | 160 MB |
|
| 46 |
+
| Tokenizer, configs | `tokenizer/`, `scheduler/`, `*.json` | < 15 MB |
|
| 47 |
+
|
| 48 |
+
## Usage with ComfyUI-FFMPEGA
|
| 49 |
+
|
| 50 |
+
This model is **auto-downloaded** when you use the `auto_mask` skill with `effect=remove` or `effect=edit` in [ComfyUI-FFMPEGA](https://github.com/AEmotionStudio/ComfyUI-FFMPEGA).
|
| 51 |
+
|
| 52 |
+
### Object Removal
|
| 53 |
+
|
| 54 |
+
Prompt the FFMPEGA Agent:
|
| 55 |
+
```
|
| 56 |
+
Remove the watermark
|
| 57 |
+
```
|
| 58 |
+
|
| 59 |
+
Or use the Effects Builder with SAM3 target + `remove` effect.
|
| 60 |
+
|
| 61 |
+
### Text-Guided Editing
|
| 62 |
+
|
| 63 |
+
Prompt the FFMPEGA Agent:
|
| 64 |
+
```
|
| 65 |
+
Change the hair to red
|
| 66 |
+
```
|
| 67 |
+
|
| 68 |
+
Or use `auto_mask` with `effect=edit` and `edit_prompt="change the hair to red"`.
|
| 69 |
+
|
| 70 |
+
### Manual Download
|
| 71 |
+
|
| 72 |
+
If auto-download is disabled, download all files and place them in:
|
| 73 |
+
```
|
| 74 |
+
ComfyUI/models/flux_klein/
|
| 75 |
+
```
|
| 76 |
+
|
| 77 |
+
## VRAM Requirements
|
| 78 |
+
|
| 79 |
+
- **Minimum**: ~8 GB (with aggressive CPU offloading)
|
| 80 |
+
- **Recommended**: ~13 GB (bf16/fp16, sequential CPU offload)
|
| 81 |
+
- GPUs without native bf16 support (pre-Ampere) automatically use fp16 at load time
|
| 82 |
+
|
| 83 |
+
## License
|
| 84 |
+
|
| 85 |
+
The model weights are licensed under **Apache 2.0** by Black Forest Labs. See [LICENSE.md](LICENSE.md) for full terms.
|
| 86 |
+
|
| 87 |
+
## Citation
|
| 88 |
+
|
| 89 |
+
```bibtex
|
| 90 |
+
@misc{flux2klein2025,
|
| 91 |
+
title={FLUX.2 Klein},
|
| 92 |
+
author={Black Forest Labs},
|
| 93 |
+
year={2025},
|
| 94 |
+
url={https://huggingface.co/black-forest-labs/FLUX.2-klein-4B}
|
| 95 |
+
}
|
| 96 |
+
```
|