Thank you for sharing...May you use this (heretic orPRISM) technique?
https://github.com/p-e-w/heretic
Refusal direction projection removal (Arditi et al., 2024) is an outdated technique.)
This is a quantization of Chompa1422/Qwen3.5-122B-A10B-abliterated
i was run well at Qwen/Qwen3.5-122B-A10B-FP8 but run this model i get an error :
[Shifusen/Qwen3.5-122B-A10B-abliterated-FP8](ValueError: Downcasting not allowed: target.dtype=torch.float8_e4m3fn, loaded_weight.dtype=torch.bfloat16)
i was trying --quantization fp8 then i get another error
ValueError: Quantization method specified in the model config (compressed-tensors) does not match the quantization method specified in the quantization argument (fp8).
GPU : 2 * Sparks ( main + 1 worker )
This is a quantization of Chompa1422/Qwen3.5-122B-A10B-abliterated
This seems to be a fake abliterated model. The model still refuse to generate dangerous content