BinghengWu's picture

BinghengWu

wubingheng

·

https://github.com/wubingheng111

AI & ML interests

I like to fine-tune the small models of the Doge series.

Organizations

upvoted an article 9 months ago

Article

Trainable Dynamic Mask Sparse Attention: Bridging Efficiency and Effectiveness in Long-Context Language Models

Aug 5, 2025

•

7

upvoted a collection 9 months ago

🧐Small-Papers

Technical support for the SmallDoges series models. • 2 items • Updated Aug 5, 2025 • 2

upvoted a paper 9 months ago

Trainable Dynamic Mask Sparse Attention

Paper • 2508.02124 • Published Aug 4, 2025 • 19

upvoted a collection 9 months ago

🧠 SmolLM3

Smol, multilingual, long-context reasoner • 14 items • Updated Oct 9, 2025 • 99

upvoted a collection over 1 year ago

Doge

Doge family of small language models. • 12 items • Updated Mar 28, 2025 • 6

upvoted a paper over 1 year ago

Wonderful Matrices: Combining for a More Efficient and Effective Foundation Model Architecture

Paper • 2412.11834 • Published Dec 16, 2024 • 8