Llama Q4_K_M GGUF
Quantized from Junn17/llama using Unsloth.
Usage
llama-cli --model llama_model.Q4_K_M.gguf -p "Hello!"
- Downloads last month
- 71
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for Junn17/quantize_llama
Base model
meta-llama/Llama-3.1-8B Finetuned
meta-llama/Llama-3.1-8B-Instruct