ThatCultivator

/

sarvam-30b-gguf

like 2

How did you get past the sarvamMoE error while using convert-hf-to-gguf?

Please share. 🙂

Sure, I had to use a custom llama cpp fork by sumitchatterjee13: https://github.com/sumitchatterjee13/llama.cpp/tree/add-sarvam-moe