Granite Guardian 3.2 5B Multi-Harm F16 GGUF
Merged model of ibm-granite/granite-guardian-3.2-5b + ibm-granite/granite-guardian-3.2-5b-lora-harm-categories LoRA adapter.
Usage
Ollama
ollama run hf.co/nishparadox/granite-guardian-3.2-5b-multi-harm-GGUF:F16
llama.cpp
llama-cli -m granite-guardian-3.2-5b-multi-harm-f16.gguf -p "Your prompt"
Prompt Format for Multi-Risk Detection
See original model card for full prompt template.
- Downloads last month
- 27
Hardware compatibility
Log In to add your hardware
16-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for nishparadox/granite-guardian-3.2-5b-multi-harm-GGUF
Base model
ibm-granite/granite-guardian-3.2-5b