File size: 1,001 Bytes
95a7e3a
 
 
 
 
 
e2a403c
95a7e3a
 
 
 
 
 
e2a403c
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
---
title: QwenScope
emoji: 🔥
colorFrom: indigo
colorTo: gray
sdk: gradio
sdk_version: 5.49.1
python_version: '3.12'
app_file: app.py
pinned: false
license: apache-2.0
---

# QwenScope Feature Explorer

Interactive Sparse Autoencoder (SAE) feature exploration and steering demo for Qwen3.5-2B, powered by Hugging Face ZeroGPU.

## Features

- **Feature Comparison**: Compare SAE feature activations between two text examples across all transformer layers.
- **Feature Steering**: Inject SAE decoder vectors into the residual stream to steer model generation behavior.

## Model Info

| Property | Value |
|---|---|
| Base model | [Qwen/Qwen3.5-2B](https://huggingface.co/Qwen/Qwen3.5-2B) |
| SAE width | 32,768 |
| Top-K | 100 |
| Layers | 0 – 23 (24 total) |
| Hidden size | 2,048 |

## Citation

```bibtex
@misc{qwenscope,
  title  = {{Qwen-Scope}: Turning Sparse Features into Development Tools for Large Language Models},
  author = {{Qwen Team}},
  month  = {April},
  year   = {2026}
}
```