Hugging Face's logo

sgovil5
/
wtasae

Model card Files
xet
 Community
sgovil5 commited on
Commit
7879a37
·
verified ·
1 Parent(s): 43bf86a

Update config.json

Browse files
Files changed (1) hide show
  1. config.json +1 -1
config.json CHANGED
@@ -8,7 +8,7 @@
8
  "seed": 42,
9
  "activation_dim": 1024,
10
  "dict_size": 8192,
11
- "sparsity_rate": 0.00001,
12
  "device": "cuda",
13
  "layer": 3,
14
  "lm_name": "EleutherAI/pythia-410m-deduped",
 
8
  "seed": 42,
9
  "activation_dim": 1024,
10
  "dict_size": 8192,
11
+ "sparsity_rate": 5e-06,
12
  "device": "cuda",
13
  "layer": 3,
14
  "lm_name": "EleutherAI/pythia-410m-deduped",