Hugging Face's logo

corneille97
/
llama-2-7b-4bits-turbo

Text Generation
Transformers
Safetensors
llama
text-generation-inference
4-bit precision
bitsandbytes
Model card Files
xet
 Community

Llama2 quantized 4bit model with bitsandbytes.

Downloads last month
6
Safetensors
Model size
7B params
Tensor type
F32
路
F16
路
U8
路
Inference Providers NEW
Text Generation
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support

Model tree for corneille97/llama-2-7b-4bits-turbo

Quantizations
1 model