Junyuan Shang

sjy1203's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

authored 3 papers 2 months ago

DHA: Learning Decoupled-Head Attention from Transformer Checkpoints via Adaptive Heads Fusion

Paper • 2406.06567 • Published Jun 3, 2024

NACL: A General and Effective KV Cache Eviction Framework for LLMs at Inference Time

Paper • 2408.03675 • Published Aug 7, 2024

ERNIE 5.0 Technical Report

Paper • 2602.04705 • Published Feb 4 • 267

authored 6 papers 3 months ago

ERNIE-Doc: A Retrospective Long-Document Modeling Transformer

Paper • 2012.15688 • Published Dec 31, 2020 • 1

ERNIE 3.0: Large-scale Knowledge Enhanced Pre-training for Language Understanding and Generation

Paper • 2107.02137 • Published Jul 5, 2021

ERNIE 3.0 Titan: Exploring Larger-scale Knowledge Enhanced Pre-training for Language Understanding and Generation

Paper • 2112.12731 • Published Dec 23, 2021 • 1

Inner Thinking Transformer: Leveraging Dynamic Depth Scaling to Foster Adaptive Internal Thinking

Paper • 2502.13842 • Published Feb 19, 2025

Mixture of Hidden-Dimensions Transformer

Paper • 2412.05644 • Published Dec 7, 2024 • 1

VideoAR: Autoregressive Video Generation via Next-Frame & Scale Prediction

Paper • 2601.05966 • Published Jan 9 • 23