6.0bpw EXL2 quant for https://huggingface.co/ProdeusUnity/Stellar-Odyssey-12b-adventure-v0.0

8bit head weights. Default measurement dataset used.

Downloads last month
1
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support