granite-speech-3.2-8b-GGUF
GGUF quantisations of ibm-granite/granite-speech-3.2-8b for CrispASR.
| Quant | Description |
|---|---|
| F16 | Full precision |
| Q8_0 | 8-bit |
| Q5_0 | 5-bit |
| Q4_K | 4-bit K-quant (recommended) |
Usage
crispasr -m granite-speech-3.2-8b-q4_k.gguf -f audio.wav
- Downloads last month
- 106
Hardware compatibility
Log In to add your hardware
5-bit
8-bit
Model tree for cstr/granite-speech-3.2-8b-GGUF
Base model
ibm-granite/granite-3.1-8b-base Finetuned
ibm-granite/granite-3.1-8b-instruct Finetuned
ibm-granite/granite-3.2-8b-instruct Finetuned
ibm-granite/granite-speech-3.2-8b