error config args name？
#1
by
CurioY
- opened
Maybe the "ignored_layers" should be "ingore"?!
The field is defined as ignored_layers for vLLM deployment and ignore for huggingface transformers offline inference, and it is set by the deploy_backend configuration in the AngelSlim source code.
The field is defined as
ignored_layersfor vLLM deployment andignorefor huggingface transformers offline inference, and it is set by thedeploy_backendconfiguration in the AngelSlim source code.
Got it！Thank you for your reply!
CurioY
changed discussion status to
closed