Lakoc
/

gpt2_tiny_decoder

Model card Files Files and versions

Lakoc commited on Oct 28, 2023

Commit

412550f

·

1 Parent(s): d59e0d6

Upload config

Files changed (1) hide show

config.json +1 -1

config.json CHANGED Viewed

@@ -10,7 +10,7 @@
   "n_embd": 256,
   "n_head": 4,
   "n_inner": null,
-  "n_layer": 24,
   "n_positions": 1024,
   "output_hidden_size": 256,
   "reorder_and_upcast_attn": false,

   "n_embd": 256,
   "n_head": 4,
   "n_inner": null,
+  "n_layer": 12,
   "n_positions": 1024,
   "output_hidden_size": 256,
   "reorder_and_upcast_attn": false,