Question about duplicate line in config.json file
#5
by Lobliqua - opened
Thank you for your amazing work, this is truly amazing!
I was studying the configuration file (config.json) and discovered that lines 336 and 426 are the same ("model.language_model.layers.41.linear_attn.in_proj_ba") and perhaps the ".in_proj_ba" is missing in model.language_model.layers.61.linear_attn
Should line 426 be: "model.language_model.layers.61.linear_attn.in_proj_ba", ?
Lobliqua changed discussion title from Question about duplicate line in config.file to Question about duplicate line in config.json file
Yes, you're right. At line 426, it is supposed to be model.language_model.layers.61.linear_attn.in_proj_ba, and thankfully, this mistake does not cause any errors with vllm.
Lobliqua changed discussion status to closed