GGUF

by amogusgaysex - opened Jan 25, 2025

Please any gguf version ? I tried doing it myself but i keep getting broken replies

amogusgaysex changed discussion status to closed Jan 26, 2025

Try this:- QuantFactory/Meditron3-Gemma2-2B-GGUF

Still very broken for some reason
Tested q8 and q6 in llama.cpp and pocketpal (android), same schizo results every time

amogusgaysex changed discussion status to open Jan 26, 2025

Upload images, audio, and videos by dragging in the text input, pasting, or clicking here.

Tap or paste here to upload images

· Sign up or log in to comment