GGUF versions

#7
by maroo87 - opened

Impressive model, can you please provide some gguf versions that can run on low-vram hardware?

inclusionAI org

Hello, we have provided an FP8 version for use.

Sign up or log in to comment