nielsr HF Staff commited on
Commit
a790759
Β·
verified Β·
1 Parent(s): 8621a55

Add pipeline tag and improve documentation

Browse files

Hi! I'm Niels from the Hugging Face community science team.

This PR improves the model card for Qwen3_1.7B_LoopUS by:
- Adding the `text-generation` pipeline tag to the metadata for better discoverability.
- Summarizing the abstract to provide a more concise overview.
- Adding a "Quick Start" section with usage instructions from the GitHub repository.
- Adding a citation section with the BibTeX provided in the paper.

Files changed (1) hide show
  1. README.md +32 -10
README.md CHANGED
@@ -1,14 +1,16 @@
1
  ---
2
- license: apache-2.0
 
3
  datasets:
4
  - HuggingFaceFW/fineweb-edu
 
5
  model_name: Qwen3_1.7B_LoopUS
6
- base_model:
7
- - Qwen/Qwen3-1.7B-Base
8
  tags:
9
  - LoopUS
10
  - LoopedTransformers
 
11
  ---
 
12
  <div align="center">
13
  <h1>LoopUS: <br> Recasting Pretrained LLMs into Looped Latent Refinement Models</h1>
14
  </div>
@@ -26,26 +28,46 @@ tags:
26
  </p>
27
 
28
  <p align="center">
29
- <a href="https://thrillcrazyer.github.io/LoopUS"><b>🌟 Github</b></a> |
30
- <a href="https://huggingface.co/Thrillcrazyer/Qwen3_1.7B_LoopUS"><b>πŸ“₯ Download</b></a> |
31
  <a href="https://arxiv.org/abs/2605.11011"><b>πŸ“„ Paper</b></a>
32
  </p>
33
 
 
34
 
35
- # Abstract
36
 
37
- Looped computation shows promise in improving the reasoning-oriented performance of LLMs by scaling test-time compute. However, existing approaches typically require either training recurrent models from scratch or applying disruptive retrofits, which involve substantial computational costs and may compromise pretrained capabilities. To address these limitations, we introduce \textbf{Looped Depth Up-Scaling} (LoopUS), a post-training framework that converts a standard pretrained LLM into a looped architecture. As a key technical contribution, LoopUS recasts the pretrained LLM into an encoder, a looped reasoning block, and a decoder. It operationalizes this latent-refinement architecture through four core components: (1) block decomposition, guided by staged representation dynamics; (2) an input-dependent selective gate to mitigate hidden-state drift; (3) random deep supervision for memory-efficient learning over long recursive horizons; and (4) a confidence head for adaptive early exiting. Collectively, these mechanisms transform a standard non-looped model into a looped form while stabilizing it against both computational bottlenecks and representation collapse. Through stable latent looping, LoopUS improves reasoning-oriented performance without extending the generated traces or requiring recurrent training from scratch.
38
 
39
- # QuickStart
40
 
41
  ```bash
42
  git clone https://github.com/Thrillcrazyer/LoopUS.git
43
  cd LoopUS
44
- uv run chat.py
 
 
 
45
  ```
46
 
47
  # Illustration of LoopUS
48
 
49
  <div align="center">
50
  <img src="https://raw.githubusercontent.com/Thrillcrazyer/LoopUS/main/assets/Framework.png" width="800"/>
51
- </div>
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ base_model:
3
+ - Qwen/Qwen3-1.7B-Base
4
  datasets:
5
  - HuggingFaceFW/fineweb-edu
6
+ license: apache-2.0
7
  model_name: Qwen3_1.7B_LoopUS
 
 
8
  tags:
9
  - LoopUS
10
  - LoopedTransformers
11
+ pipeline_tag: text-generation
12
  ---
13
+
14
  <div align="center">
15
  <h1>LoopUS: <br> Recasting Pretrained LLMs into Looped Latent Refinement Models</h1>
16
  </div>
 
28
  </p>
29
 
30
  <p align="center">
31
+ <a href="https://github.com/Thrillcrazyer/LoopUS"><b>🌟 Github</b></a> |
32
+ <a href="https://thrillcrazyer.github.io/LoopUS"><b>🌐 Project Page</b></a> |
33
  <a href="https://arxiv.org/abs/2605.11011"><b>πŸ“„ Paper</b></a>
34
  </p>
35
 
36
+ # Introduction
37
 
38
+ **Looped Depth Up-Scaling** (LoopUS) is a post-training framework that converts a standard pretrained LLM into a looped latent refinement model. Instead of extending output traces, LoopUS restructures the model into an encoder, a looped reasoning block, and a decoder, then performs iterative latent refinement in the hidden space. This approach enables test-time compute scaling and improves reasoning-oriented performance without requiring recurrent training from scratch.
39
 
40
+ # Quick Start
41
 
42
+ To use this model, clone the official repository and run the provided scripts:
43
 
44
  ```bash
45
  git clone https://github.com/Thrillcrazyer/LoopUS.git
46
  cd LoopUS
47
+ # Install dependencies
48
+ uv sync
49
+ # Run the chat interface
50
+ uv run chat.py --model-name Thrillcrazyer/Qwen3_1.7B_LoopUS
51
  ```
52
 
53
  # Illustration of LoopUS
54
 
55
  <div align="center">
56
  <img src="https://raw.githubusercontent.com/Thrillcrazyer/LoopUS/main/assets/Framework.png" width="800"/>
57
+ </div>
58
+
59
+ # Citation
60
+
61
+ If you find LoopUS useful in your research, please cite the following paper:
62
+
63
+ ```bibtex
64
+ @misc{park2026loopus,
65
+ title={LoopUS: Recasting Pretrained LLMs into Looped Latent Refinement Models},
66
+ author={Taekhyun Park and Yongjae Lee and Dohee Kim and Hyerim Bae},
67
+ year={2026},
68
+ eprint={2605.11011},
69
+ archivePrefix={arXiv},
70
+ primaryClass={cs.CL},
71
+ url={https://arxiv.org/abs/2605.11011},
72
+ }
73
+ ```