ValueError
#82
by bijays09 - opened
Blockwise quantization only supports 16/32-bit floats, but got torch.uint8. Anyone know how to solve this?
Blockwise quantization only supports 16/32-bit floats, but got torch.uint8. Anyone know how to solve this?