Li Shuaiyi's picture

5 1

Li Shuaiyi

Syon-Li

https://github.com/Syon-Li

Syon-Li

AI & ML interests

Model editing, Long context, Compression

Recent Activity

upvoted a paper 26 days ago

MiroThinker-1.7 & H1: Towards Heavy-Duty Research Agents via Verification

upvoted a paper 3 months ago

Improving Multi-step RAG with Hypergraph-based Memory for Long-Context Complex Relational Modeling

upvoted a paper 5 months ago

The End of Manual Decoding: Towards Truly End-to-End Language Models

View all activity

Organizations

None yet

authored 3 papers over 1 year ago

A Silver Bullet or a Compromise for Full Attention? A Comprehensive Study of Gist Token-based Context Compression

Paper • 2412.17483 • Published Dec 23, 2024 • 34

Attention Entropy is a Key Factor: An Analysis of Parallel Context Encoding with Full-attention-based Pre-trained Language Models

Paper • 2412.16545 • Published Dec 21, 2024

Consecutive Batch Model Editing with HooK Layers

Paper • 2403.05330 • Published Mar 8, 2024

authored a paper almost 2 years ago

On the Transformations across Reward Model, Parameter Update, and In-Context Prompt

Paper • 2406.16377 • Published Jun 24, 2024 • 13