Distilled Models
Collection
6 items • Updated
This model was finetuned and converted to GGUF format using Unsloth.
This model was trained on 250 sample of MiniMax-M2 but excluded the thinking to achieve faster response times. It is not a replacement for the full model but merely aims to capture it style in a smaller model.
After further testing, it is not exactly stable and may be updated soon.
4-bit
5-bit
8-bit