waiting

#1
by gopi87 - opened

model not there

Unsloth AI org

It's up sorry

got it thanks sir

gopi87 changed discussion status to closed
gopi87 changed discussion status to open

It's up sorry

i tested the bf16 reasonning is not working on 4B can you check it ?

@gopi87 how is it not working, be more specific

@danielhanchen - there is a note on the 9B README "GGUFs will be updated in about 30mins ", will that affect the other sizes as well?

@gopi87 how is it not working, be more specific

@danielhanchen - there is a note on the 9B README "GGUFs will be updated in about 30mins ", will that affect the other sizes as well?

i didn't checked but in twitter i seen people are using the q8 which has reasoning format maybe only the bf16 gets affected i guess any have i am checking the q8 now

Unsloth AI org

Note Qwen Small models have reasoning disabled by default - see https://unsloth.ai/docs/models/qwen3.5#how-to-enable-or-disable-reasoning-and-thinking to enable it

Note Qwen Small models have reasoning disabled by default - see https://unsloth.ai/docs/models/qwen3.5#how-to-enable-or-disable-reasoning-and-thinking to enable it

got it

The 9b seems to reason for me by default though.

Sign up or log in to comment