Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,13 @@
|
|
| 1 |
-
---
|
| 2 |
-
license: apache-2.0
|
| 3 |
-
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
---
|
| 4 |
+
# Direction-Aware Diagonal Autoregressive Image Generation
|
| 5 |
+
|
| 6 |
+
We propose Direction-Aware Diagonal Autoregressive Image Generation (DAR) method, which generates image tokens following a diagonal scanning order.
|
| 7 |
+
The proposed diagonal scanning order ensures that tokens with adjacent indices remain in close proximity while enabling causal attention to gather information from a broader range of directions.
|
| 8 |
+
Additionally, two direction-aware modules: 4D-RoPE and direction embeddings are introduced, enhancing the model's capability to handle frequent changes in generation direction.
|
| 9 |
+
To leverage the representational capacity of the image tokenizer, we use its codebook as the image token embeddings.
|
| 10 |
+
|
| 11 |
+
This repo is used for hosting DAR's checkpoints.
|
| 12 |
+
|
| 13 |
+
Paper: <https://arxiv.org/abs/2503.11129>
|