How do I launch this model in Xinference?

#34
by JJNEW - opened

My Xinference version is V2.3.0. I have downloaded the model named Qwen3.5-9B-Uncensored-HauhauCS-Aggressive-Q8_0.gguf. After registering a custom model via the UI interface, there are no available inference engines in the dropdown menu when I try to launch it. Also, after installing the inference engines, the launch icon is grayed out. Can someone kind help me with this? Thank you.

Sign up or log in to comment