Configuration Parsing Warning:In config.json: "quantization_config.bits" must be an integer

You like Darkhn's Animus models? Good, me too. Unfortunately, he removed the vision encoder from the model. So I gave it back its eyes. And — what can I say — it can see you... 😈

This is only the 4.5bpw version. It fits nicely in 24GB VRAM. See here for model base: https://huggingface.co/Darkhn/Magistral-2509-24B-Animus-V12.1-EXL2

Get in contact if you like, have fun and always remember: With great power comes great responsibility.

Kudos@Darkhn for his great work!

Downloads last month
1
Inference Providers NEW
This model isn't deployed by any Inference Provider. 🙋 Ask for provider support

Model tree for Wolfsvolk/Magistral-2509-24B-TheEyesOfAnimus-V12.1-EXL2