Thanks for this model

#1
by NapYang - opened

This is the best 4bit model. A quick test from your oMLX bench mark, humaneval pass 91%! (91/100).

True!

here's my test

Intelligence Benchmark Comparison

          Mode    Sampled         Qwen3.5-35B-A3B-oQ4e

HUMANEVAL Full 164 90.8%
MBPP Sample 200/500 78.0%

--- Detail ---

Model: Qwen3.5-35B-A3B-oQ4e
Benchmark Accuracy Correct Total Time(s)

HUMANEVAL 90.8% 149 164 295.1
MBPP 78.0% 156 200 361.2

Sign up or log in to comment