5.19B params ?
#1
by davidpfarrell - opened
This card is tagged as Model Size: 5.19B params ?
That's because it is AWQ Quants model, and HF calculate params as like that (almost 1/4 of original fp16 model).
Other AWQ models also shows like that. ( for example, https://huggingface.co/Qwen/Qwen3-32B-AWQ )
Thanks for the note, I'll close this out, but wondering if that value is accurate? i.e. does the AWQ quantizing actually reduce the parameter count? Or is just weird maths used by HF on the card pages (i.e a known bug) ?
davidpfarrell changed discussion status to closed