Which framework was used to quantize this model? llm-compressor? or Can you share the quantization Python script?
· Sign up or log in to comment