E-motionAssistant/llama-3.2-3b-english-therapy-GGUF-v2

LLaMA 3.2-3B English Therapy GGUF v2

This is a corrected GGUF quantized version of a LLaMA 3.2-3B model fine-tuned for empathetic therapy conversations.

Model Details

• Base Model: meta-llama/Llama-3.2-3B-Instruct
• Quantization: Q4_K_M
• Size: ~1.8GB
• Format: GGUF
• Use Case: Mental health support chatbot

Usage

from llama_cpp import Llama

llm = Llama(
    model_path="model.gguf",
    n_ctx=2048,
    n_threads=4
)

response = llm(
    "User: I'm feeling anxious today.\nTherapist:",
    max_tokens=200,
    temperature=0.7
)
print(response["choices"][0]["text"])

Disclaimer

This is an AI assistant, not a replacement for professional mental health care.