---
license: apache-2.0
base_model: Qwen/Qwen2.5-7B-Instruct
tags:
- gguf
- q4_k_m
- quantized
---

# Qwen2.5-7B-Instruct Q4_K_M GGUF

Quantized from [Junn17/qwen](https://huggingface.co/Junn17/qwen) using Unsloth.

## Usage
```bash
llama-cli --model qwen_model.Q4_K_M.gguf -p "Hello!"
```