tevino
/

gemma-4-E4B-it-oQ6

Model card Files Files and versions

gemma-4-E4B-it-oQ6

This model was quantized using oQ (oMLX v0.3.9.dev2) mixed-precision quantization.

Quantization details

Model type: gemma4
Bits: 6
Group size: 64
Format: MLX safetensors

Downloads last month: 169

Safetensors

Model size

2B params

Tensor type

BF16

·

U32

·

MLX

Hardware compatibility

Log In to add your hardware

6-bit

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for tevino/gemma-4-E4B-it-oQ6

Base model

google/gemma-4-E4B

Finetuned

google/gemma-4-E4B-it

Quantized

(194)

this model