Need GGUF Quantization
#2
by tradenity - opened
Please provide GGUF quantization like the 7B model in order to be able to use it with ollama
It would be cool if the unsloth team released a GGUF version.
Please provide GGUF quantization like the 7B model in order to be able to use it with ollama
It would be cool if the unsloth team released a GGUF version.