Any possibility to run this model on amd gpu?

#2
by cmy2019 - opened

really love this model

I think there's some work being done here: https://github.com/TheTom/llama-cpp-turboquant/pull/5

I think there's some work being done here: https://github.com/TheTom/llama-cpp-turboquant/pull/5

thanks, i will try this.

Sign up or log in to comment