4, 5, and 6 bit quants of nisten/zelensky-78b
use this as a commander model
no speculative decoding support
- Downloads last month
- 172
Hardware compatibility
Log In to add your hardware
16-bit
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support