Where are the vllm files?
#1
by iheycc - opened
Copy vllm/zhinao.py into vllm/model_executor/models in your vllm installation directory (in python/conda env).
Copy vllm/serving_chat.py into vllm/entrypoints/openai in your vllm installation directory.
Where are these two files? vllm/zhinao.py and vllm/serving_chat.py
iheycc changed discussion title from Where is the vllm files? to Where are the vllm files?
Copy vllm/zhinao.py into vllm/model_executor/models in your vllm installation directory (in python/conda env). Copy vllm/serving_chat.py into vllm/entrypoints/openai in your vllm installation directory.Where are these two files?
vllm/zhinao.pyandvllm/serving_chat.py
zhaicunqi changed discussion status to closed