Any way to mtp?

#1
by tasticleeze - opened

Autoround is great for us small fries. Thank you!

Amy way to enable mtp?

I added MTP by following @mconcat ’s git commits and it’s running great!

  • Add MTP layers to quantization_config.ignore list
  • Add sharded index with MTP tensor mappings
  • Add MTP weights sidecar (BF16 from Qwen/Qwen3.5-27B)

Oh awesome do you wanna open a PR

EDIT: sorry I briefly thought this was a comment on my repo 🤣

Sign up or log in to comment