Any way to mtp?
#1
by tasticleeze - opened
Autoround is great for us small fries. Thank you!
Amy way to enable mtp?
I added MTP by following @mconcat ’s git commits and it’s running great!
- Add MTP layers to quantization_config.ignore list
- Add sharded index with MTP tensor mappings
- Add MTP weights sidecar (BF16 from Qwen/Qwen3.5-27B)
Oh awesome do you wanna open a PR
EDIT: sorry I briefly thought this was a comment on my repo 🤣