Any possibility to run this model on amd gpu?
#2
by cmy2019 - opened
really love this model
I think there's some work being done here: https://github.com/TheTom/llama-cpp-turboquant/pull/5
thanks, i will try this.
really love this model
I think there's some work being done here: https://github.com/TheTom/llama-cpp-turboquant/pull/5
thanks, i will try this.