GGUF models
Collection
17 items • Updated
The GGUF models in this repo are quantized and converted from ibm-granite/granite-3.1-1b-a400m-base using llama.cpp service and llama.cpp
- Downloads last month
- 6
Hardware compatibility
Log In to add your hardware
3-bit
4-bit
5-bit
6-bit
8-bit
16-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for skymizer/granite-3.1-1b-a400m-GGUF
Base model
ibm-granite/granite-3.1-1b-a400m-base