Need FP4_DYNAMIC

#1
by adnanPBI - opened

Hi,

Can you please provide FP4_DYNAMIC quantized edition here?
Also, do I have to use mmproj file with the FP4_DYNAMIC / FP8_DYNAMIC quant version?

Sign up or log in to comment