Hope there is a quantum Q4_K_M

by chfm - opened Mar 6

Mar 6

great work, because the computer VRAM is limited, hope for a version of Q4_K_M.

Mar 6

I prefer IQ4 N_L because I have ARM soc.

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment