Model doesn't start in vLLM due to validation errors

by wwydmanski - opened Jan 2

Jan 2

(APIServer pid=232484) pydantic_core._pydantic_core.ValidationError: 2 validation errors for VllmConfig
(APIServer pid=232484) scale_dtype
(APIServer pid=232484)   Extra inputs are not permitted [type=extra_forbidden, input_value=None, input_type=NoneType]
(APIServer pid=232484)     For further information visit https://errors.pydantic.dev/2.12/v/extra_forbidden
(APIServer pid=232484) zp_dtype
(APIServer pid=232484)   Extra inputs are not permitted [type=extra_forbidden, input_value=None, input_type=NoneType]
(APIServer pid=232484)     For further information visit https://errors.pydantic.dev/2.12/v/extra_forbidden

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment