Thanks for the great work.
Would it be possible to get the optimized quantization types for Q4 like unsloth Q4_K_XL or HauhauCS Q4_K_P ?
· Sign up or log in to comment