How to stop this model from thinking.
#2
by CreeperMZ - opened
When I tried running it with sglang, the model still kept thinking. At first I thought it was a chat_template issue, so I switched to the 235B Instruct version chat template, but that still didn't stop the thinking.
Ohh
CreeperMZ changed discussion status to closed
I should post that to FP8