SlimQwen: Exploring the Pruning and Distillation in Large MoE Model Pre-training
Paper • 2605.08738 • Published • 7
Zongfang Liu
ZongfangLiu
·
AI & ML interests
None yet
Recent Activity
upvoted a paper about 9 hours ago
SlimQwen: Exploring the Pruning and Distillation in Large MoE Model Pre-training updated a model 5 months ago
ZongfangLiu/pruned-reap-freq-0.25 published a model 5 months ago
ZongfangLiu/pruned-reap-freq-0.25Organizations
None yet
upvoted a paper about 9 hours ago