granite-speech-3.3-2b-GGUF
GGUF quantisations of ibm-granite/granite-speech-3.3-2b for CrispASR.
| Quant | Description |
|---|---|
| F16 | Full precision |
| Q8_0 | 8-bit |
| Q5_0 | 5-bit |
| Q4_K | 4-bit K-quant (recommended) |
Usage
crispasr -m granite-speech-3.3-2b-q4_k.gguf -f audio.wav
- Downloads last month
- 114
Hardware compatibility
Log In to add your hardware
5-bit
8-bit
16-bit
Model tree for cstr/granite-speech-3.3-2b-GGUF
Base model
ibm-granite/granite-3.3-2b-base Finetuned
ibm-granite/granite-3.3-2b-instruct Finetuned
ibm-granite/granite-speech-3.3-2b