BF16 part 2 of 2?

#4
by flipplefozz - opened

Hey, looks like you forgot to upload the second half of the BF16 GGUF.

Thanks for your work by the way!

@Jackrong

Qwen3.5-27B.BF16-00002-of-00002.gguf
Error: not a valid gguf file: not starting with GGUF magic number

Can confirm this is still happening - BF16 doesn't have a functional part 2.

Hi, thanks for the feedback!

It looks like something went wrong during the upload of the BF16 part 2. I'll check and re-upload it as soon as possible.

In the meantime, you can try using the full vLLM model or the Q8 GGUF version instead.

Thanks again for reporting this!

Sign up or log in to comment