gpt2-decomposed / layer_0 /config.json
Lumi-node's picture
Upload folder using huggingface_hub
a9dc2d3 verified
{
"part_type": "full_layer",
"layer_idx": 0,
"module_path": "transformer.h.0",
"input_dim": 768,
"output_dim": 768,
"num_heads": 12,
"head_dim": null,
"intermediate_dim": 3072,
"extra_info": {}
}