jiwonsong
/

SeerAttention-Qwen3-8B-AttnGates

Text Generation

Model card Files Files and versions

SeerAttention-Qwen3-8B-AttnGates

Experimental SeerAttention AttnGates for Qwen3-8B. Trained on RedPajama-1T-Sample Dataset.

Downloads last month: 564

Model tree for jiwonsong/SeerAttention-Qwen3-8B-AttnGates

Base model

Qwen/Qwen3-8B-Base

Finetuned

Adapter

(1071)

this model