deepsweet/GigaChat3.1-10B-A1.8B-MLX-oQ8

This model was converted to MLX format from ai-sage/GigaChat3.1-10B-A1.8B using oMLX v0.2.24 with oQ Quantization.

Multi-Token Prediction (MTP) had to be disabled ("num_nextn_predict_layers": 0) and related layers had to be removed (model.layers.26.*).

Thanks RockTalk/GigaChat3.1-10B-A1.8B-MLX-4bit for the tip.

Settings:

• Level: oQ8
• Sensitivity model: none
• Text Only: yes