FP8 & Quantized version request.
#1
by RedwanRafi - opened
Please Upload the fp8 and quantized model! As most of the user own less then 16gb GPU.
Will See what I can do :-)
fjkane changed discussion status to closed
Please Upload the fp8 and quantized model! As most of the user own less then 16gb GPU.
Will See what I can do :-)