To launch this model, run the following command
pip install "vllm>=0.5.0"
python -m vllm.entrypoints.openai.api_server \
--model Sashank-810/lft-finetuned-llama3-8b-merged \
--dtype float16 \
--trust-remote-code
- Downloads last month
- 5
Model tree for Sashank-810/lft-finetuned-llama3-8b-merged
Base model
meta-llama/Llama-3.1-8B Finetuned
meta-llama/Llama-3.1-8B-Instruct