README.md

metadata

title: QwenScope
emoji: 🔥
colorFrom: indigo
colorTo: gray
sdk: gradio
sdk_version: 5.49.1
python_version: '3.12'
app_file: app.py
pinned: false
license: apache-2.0

QwenScope Feature Explorer

Interactive Sparse Autoencoder (SAE) feature exploration and steering demo for Qwen3.5-2B, powered by Hugging Face ZeroGPU.

Features

• Feature Comparison: Compare SAE feature activations between two text examples across all transformer layers.
• Feature Steering: Inject SAE decoder vectors into the residual stream to steer model generation behavior.

Model Info

Property	Value
Base model	Qwen/Qwen3.5-2B
SAE width	32,768
Top-K	100
Layers	0 – 23 (24 total)
Hidden size	2,048

Citation

@misc{qwenscope,
  title  = {{Qwen-Scope}: Turning Sparse Features into Development Tools for Large Language Models},
  author = {{Qwen Team}},
  month  = {April},
  year   = {2026}
}