AWQ version
#2
by LoneRanger44 - opened
It would be nice if you could provide an AWQ version of this model since I want to run it with vLLM on my machine :) Thanks in advance.
LoneRanger44 changed discussion status to closed
It would be nice if you could provide an AWQ version of this model since I want to run it with vLLM on my machine :) Thanks in advance.