Hugging Face's logo
davidquarel 's Collections
shk_FINAL
gpt2 SAEs
residmid-residpost
residpre-residpost
mlpin-mlpout
staircase SAEs
JBlock SAEs
jsae_xavier (mlpin -> mlpout)
jsae shakespeare 64x4 max_steps=20k (mlpin -> mlpout)
jsae shakespeare 64x4 V2
jsae shakespeare_64x4
mlp topk SAEs shakespeare_64x4
topk shakespeare_64x4
Shakespeare 64x4 SAEs
SPAR SAEs
SPAR models

jsae shakespeare 64x4 max_steps=20k (mlpin -> mlpout)

A sweep of JSAE training with jacobian penalty from 1e-3 to 1e-2, trained for 20k steps. (added zero sparsity for baseline)

Upvote
-