EXL3 quantization of QED-Nano, 8 bits per weight, including output layers.

Downloads last month
1
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for isogen/QED-Nano-exl3-8bpw-h8

Quantized
(8)
this model