Hugging Face's logo

edp1096
/
Huihui-Qwen3.5-27B-abliterated-FP8

Image-Text-to-Text
Transformers
Safetensors
qwen3_5
conversational
fp8
Model card Files
xet
 Community
3

Which framework was used to quantize this model? llm-compressor? or Can you share the quantization Python script?

#2
by traphix - opened
Discussion
traphix

Which framework was used to quantize this model? llm-compressor? or Can you share the quantization Python script?
edp1096
 Owner

https://github.com/edp1096/dgx_spark_init/tree/main/compose_yaml/weights_override

Sign up or log in to comment