ALL BROKEN

will get error : RuntimeError: mat1 and mat2 shapes cannot be multiplied (601x3072 and 1536x9216)

BROKEN for now

ministral-3-3b.safetensors only the text tensors are quanted the vision tesnors are kept at BF16

text_encoder folder only the quanted text layer part of the model

text_encoder_full folder same as ministral-3-3b.safetensors just with configs

Downloads last month: -; Downloads are not tracked for this model. How to track

Inference Providers NEW

This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for ApacheOne/ministral-3-3b-nvfp4_mixed

Base model

Finetuned

(1)

this model