Quants of https://huggingface.co/Luni/StarDust-12b-v1
I don't have the best internet connection (or Quanting experience) so I'll leave the more special ones to the professionals aka bartowski.
- Downloads last month
- 44
Hardware compatibility
Log In to add your hardware
2-bit
3-bit
4-bit
5-bit
6-bit
8-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support