Please upload BF16 version of this model in GGUF?
#1
by luxiloid - opened
I have hard time converting it to BF16 gguf myself. Hope you could upload it.
There is absolutely no benefit running this model in BF16 over Q8_0. Everything i1-Q5_K_M and larger will not result in any quality difference that can be perceived by humans in a monolithic model based on the measurements I made in Q4 2024. If you absolutely insist on us providing BF16 wuants anyways we could do so.