phatjk
/

vietcuna-7b-v3-AWQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions

"zero_point": True, "q_group_size": 128, "w_bit": 4, "version": "GEMM"

Downloads last month: 5

Safetensors

Model size

8B params

Tensor type

I32

·

F16

·