'Make knowledge free for everyone'
Quantized version of: neuralmagic/Sparse-Llama-3.1-8B-ultrachat_200k-2of4
- Downloads last month
- 14
Hardware compatibility
Log In to add your hardware
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit
Model tree for DevQuasar-5/neuralmagic.Sparse-Llama-3.1-8B-ultrachat_200k-2of4-GGUF
Base model
meta-llama/Llama-3.1-8B Finetuned
RedHatAI/Sparse-Llama-3.1-8B-2of4