Excessive Emojis
#1
by AlecKloss - opened
After hitting this model with mlx_lm.convert its going off the rails with emojis. Just as a precaution to others. Tried both default and float16 each with similar results. I'm no expert here, just reporting a potential downside to "abliterating" this model.
What was your refusal count and KL divergence on this one?
It was Refusal 12/100 KL .08
Using float16 precision for gemma3 won't work! Using float32. That was the issue.
AlecKloss changed discussion status to closed