AdamLucek/Qwen2.5-3B-Instruct-GRPO-2K-GSM8K-GGUF

Conversions of AdamLucek/Qwen2.5-3B-Instruct-GRPO-2K-GSM8K into q8_0, q4_k_m and q5_k_m GGUF formats. See original model card for additional details.

This model is a GRPO fine-tuned version of unsloth/qwen2.5-3b-instruct-unsloth-bnb-4bit on a subset of 2,000 examples from openai/gsm8k using Unsloth.

Usage

For best performance, use the below system prompt:

SYSTEM_PROMPT = """
Respond in the following format:
<reasoning>
...
</reasoning>
<answer>
...
</answer>
"""