error config args name?
#1
by CurioY - opened
Maybe the "ignored_layers" should be "ingore"?!
The field is defined as ignored_layers for vLLM deployment and ignore for huggingface transformers offline inference, and it is set by the deploy_backend configuration in the AngelSlim source code.
The field is defined as
ignored_layersfor vLLM deployment andignorefor huggingface transformers offline inference, and it is set by thedeploy_backendconfiguration in the AngelSlim source code.
Got it!Thank you for your reply!
CurioY changed discussion status to closed