Hi,
Can you please provide FP4_DYNAMIC quantized edition here?Also, do I have to use mmproj file with the FP4_DYNAMIC / FP8_DYNAMIC quant version?
· Sign up or log in to comment