Create README.md
Browse files
README.md
ADDED
|
@@ -0,0 +1,40 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
language:
|
| 3 |
+
- en
|
| 4 |
+
base_model:
|
| 5 |
+
- BAAI/Emu3-Stage1
|
| 6 |
+
---
|
| 7 |
+
|
| 8 |
+
# EARL - SFT (S) (8B)
|
| 9 |
+
|
| 10 |
+
**Model Name:** `mair-lab/sft-simple`
|
| 11 |
+
**Model Size:** 8B parameters
|
| 12 |
+
**Base Model:** [BAAI/Emu3-Stage1](https://huggingface.co/BAAI/Emu3-Stage1)
|
| 13 |
+
**Training Method:** Supervised Fine-Tuning (SFT)
|
| 14 |
+
**Dataset:** Simple Edit (S)
|
| 15 |
+
|
| 16 |
+
This model is part of the EARL benchmark effort introduced in our paper:
|
| 17 |
+
👉 [EARL: The Promise of RL for Autoregressive Image Editing](https://arxiv.org/abs/2508.01119)
|
| 18 |
+
|
| 19 |
+
## Model Summary
|
| 20 |
+
|
| 21 |
+
This SFT model is fine-tuned from Emu3 using direct supervision on the Simple Edit dataset. It is optimized for general-purpose autoregressive image editing without requiring intermediate reasoning steps. This model achieves state-of-the-art performance on several editing benchmarks across modalities.
|
| 22 |
+
|
| 23 |
+
➡️ **Inference script and usage:** [GitHub Repo](https://github.com/saba96/EARL?tab=readme-ov-file)
|
| 24 |
+
|
| 25 |
+
## Benchmark Results (Avg Score Across Benchmarks)
|
| 26 |
+
|
| 27 |
+
| Model | Base Model | OmniEdit | EmuEdit | AURORA | MB | VisMin | I2EBench | **AVG** |
|
| 28 |
+
|----------------|------------|----------|---------|--------|------|--------|----------|---------|
|
| 29 |
+
| Magicbrush | SD v1.5 | 3.43 | 3.28 | 3.01 | 3.64 | 3.48 | 3.06 | 3.32 |
|
| 30 |
+
| InstructPix2Pix| SD v1.5 | 3.97 | 3.24 | 3.05 | 3.12 | 2.94 | 3.23 | 3.26 |
|
| 31 |
+
| Aurora | SD v1.5 | 4.50 | 4.40 | 4.12 | 4.62 | 3.82 | 3.58 | 4.17 |
|
| 32 |
+
| Omnigen* | - | 5.68 | 5.00 | 4.10 | 4.68 | 4.09 | 4.68 | 4.70 |
|
| 33 |
+
| **SFT (S)** | Emu3 | 5.73 | 3.66 | 3.58 | 3.19 | 3.57 | 3.59 | **3.88** |
|
| 34 |
+
|
| 35 |
+
> 📈 **Note:** The Emu3-based SFT (S) model achieves top results among all open-source supervised models on **OmniEdit** and competitive performance across other benchmarks.
|
| 36 |
+
|
| 37 |
+
## Use Cases
|
| 38 |
+
|
| 39 |
+
- Open-ended and instruction-guided image editing
|
| 40 |
+
- Object, attribute, style and environment change
|