IQ3_XXS quant request

by OrangeApples - opened Feb 11, 2024

@Artefact2 could I request for you to upload an IQ3_XXS quant? It would fit nicely in 24GB vram and have better performance than Q3_K_M.

Owner Feb 11, 2024

Done!

Artefact2 changed discussion status to closed Feb 11, 2024

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment