quant of jondurbin's airoboros-l2-13b-3.1.1

python3 convert.py \
    -i /input/jondurbin_airoboros-l2-13b-3.1.1/ \
    -c /input/wikitext/0000.parquet \
    -o /output/temp/ \
    -cf /output/8.0bpw/ \
    -b 8.0 \
    -hb 8
Downloads last month
2
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Dataset used to train waldie/airoboros-l2-13b-3.1.1-8bpw-h8-exl2