Question About Jackrong/Qwopus3.5-27B-v3-FP8

#18
by Jeanxx - opened

Hello, I noticed that you released Jackrong/Qwopus3.5-27B-V3-FP8 yesterday, and I downloaded it. However, when I tried to run it with vLLM, I encountered some error. I'm wondering if there might be an issue with the FP8 version weight files? I would appreciate your response!

Sign up or log in to comment