kaitchup
/

Mistral-7B-awq-4bit

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

YAML Metadata Warning:empty or missing yaml metadata in repo card

Check out the documentation for more information.

Mistral 7B quantized in 4-bit with AutoAWQ.

Downloads last month: 17

Safetensors

Model size

7B params

Tensor type

I32

·

F16

·