BF16 part 2 of 2?
#4
by flipplefozz - opened
Hey, looks like you forgot to upload the second half of the BF16 GGUF.
Thanks for your work by the way!
Hi, thanks for the feedback!
It looks like something went wrong during the upload of the BF16 part 2. I'll check and re-upload it as soon as possible.
In the meantime, you can try using the full vLLM model or the Q8 GGUF version instead.
Thanks again for reporting this!