Is there a way to run it on vLLM?
#2
by Jongsim - opened
Which version of vLLM can run this BnB model?
I want to run the API server using a command.
Since this model is for fine-tuning, is it not possible to run it with vLLM?
No description provided.
Jongsim changed discussion status to closed