Fastest for my 3090x8
#1
by ciprianv - opened
Hello, thank you for this quant, i tested many on both vllm and sglang and this one works best for me as speed and quality on 8x3090 . Could you, please, do a similar one for Minimax M2.5?
thank you!
Hello, thank you for this quant, i tested many on both vllm and sglang and this one works best for me as speed and quality on 8x3090 . Could you, please, do a similar one for Minimax M2.5?
thank you!