rAIfle
/

llama-3-70B-Instruct-abliterated-exl2

Model card Files Files and versions

YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

EXL2 quants of failspy/llama-3-70B-Instruct-abliterated

Branches:

main -- measurement.json
2.25b6h -- 2.25bpw, 6bit lm_head
3.5b6h -- 3.5bpw, 6bit lm_head
3.75b6h -- 3.75bpw, 6bit lm_head
4b6h -- 4bpw, 6bit lm_head
4.5b6h -- 4.5bpw, 6bit lm_head
4.65b6h -- 4.65bpw, 6bit lm_head
6b6h -- 6bpw, 6bit lm_head
8b8h -- 8bpw, 8bit lm_head

No rpcal for this one, just a normal batch of standard-settings exl2.

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support