thank you for making the models available. If possible, add q4_1?
@ct-2 π uploading soon
uploaded https://huggingface.co/Aryanne/Mamba-gpt-3B-v4-ggml-and-gguf/blob/main/q4_1-ggml-mamba-gpt-3B_v4.bin
thanks!, is .gguf available too? Whoops should've been specific
https://huggingface.co/Aryanne/Mamba-gpt-3B-v4-ggml-and-gguf/blob/main/q4_1-gguf-mamba-gpt-3B_v4.gguf
π€π€
Β· Sign up or log in to comment