Improve model card and add metadata

#1
by nielsr HF Staff - opened
Files changed (1) hide show
  1. README.md +37 -3
README.md CHANGED
@@ -1,3 +1,37 @@
1
- ---
2
- license: mit
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: mit
3
+ pipeline_tag: text-generation
4
+ ---
5
+
6
+ # Solve the Loop: Attractor Models for Language and Reasoning
7
+
8
+ This repository contains the 770M parameter Attractor Model introduced in [Solve the Loop: Attractor Models for Language and Reasoning](https://huggingface.co/papers/2605.12466).
9
+
10
+ Attractor Models offer a promising alternative to purely feed-forward computation by iteratively refining latent representations. In this architecture, a backbone module first proposes output embeddings, then an attractor module refines them by solving for the fixed point using implicit differentiation. This model delivers a Pareto improvement over standard Transformers in language modeling and demonstrates strong performance on reasoning tasks.
11
+
12
+ - **Paper:** [Solve the Loop: Attractor Models for Language and Reasoning](https://huggingface.co/papers/2605.12466)
13
+ - **Project Page:** [attractor-models.github.io](https://attractor-models.github.io/)
14
+ - **Repository:** [jacobfa/Attractor](https://github.com/jacobfa/Attractor)
15
+
16
+ ## Usage
17
+
18
+ To use this model, you need to install the official package from the [GitHub repository](https://github.com/jacobfa/Attractor).
19
+
20
+ ```python
21
+ from attractor.models.attractor import Attractor, AttractorConfig
22
+
23
+ # Construct the configuration for the 770m model
24
+ config = AttractorConfig.from_name("attractor-large-770m")
25
+ model = config.construct_model()
26
+ ```
27
+
28
+ ## Citation
29
+
30
+ ```bibtex
31
+ @article{feinashley2026attractor,
32
+ title={Solve the Loop: Attractor Models for Language and Reasoning},
33
+ author={Fein-Ashley, Jacob and Rashidinejad, Paria},
34
+ year={2026},
35
+ url={https://arxiv.org/abs/2605.12466}
36
+ }
37
+ ```