MolmoE-1B-0924 NF4 Quant Only the LLM portion was quantized, CLIP encoder remains as is

base model for more information:

https://huggingface.co/allenai/MolmoE-1B-0924

Downloads last month
8
Safetensors
Model size
7B params
Tensor type
F32
F16
U8
Inference Providers NEW
This model isn't deployed by any Inference Provider. 馃檵 Ask for provider support

Model tree for reubk/MolmoE-1B-0924-NF4

Quantized
(1)
this model