Sharded GGUF version of second-state/stablelm-2-zephyr-1.6b-GGUF.
- Downloads last month
- 2
Hardware compatibility
Log In to add your hardware
We're not able to determine the quantization variants.
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support
Model tree for Felladrin/gguf-sharded-Q4_K_S-stablelm-2-zephyr-1.6b
Base model
stabilityai/stablelm-2-zephyr-1_6b Quantized
second-state/stablelm-2-zephyr-1.6b-GGUF