Attention Sink in Transformers: A Survey on Utilization, Interpretation, and Mitigation
Paper • 2604.10098 • Published • 74
Prince Canuma PRO
prince-canuma
AI & ML interests
None yet
Recent Activity
updated a model about 22 hours ago
mlx-community/Qwen3.6-35B-A3B-mxfp8 updated a model about 22 hours ago
mlx-community/Qwen3.6-35B-A3B-mxfp4 updated a model about 23 hours ago
mlx-community/Qwen3.6-35B-A3B-nvfp4Organizations
![Unofficial Mistral Community [deprecated]'s profile picture](https://cdn-avatars.huggingface.co/v1/production/uploads/6141a88b3a0ec78603c9e784/HAdAzcs1CDB9OxgxT2W9K.png)
upvoted 2
papers 3 days ago
upvoted 5
papers 11 days ago
Plug-and-Play 1.x-Bit KV Cache Quantization for Video Large Language Models
Paper • 2503.16257 • Published • 28
KIVI: A Tuning-Free Asymmetric 2bit Quantization for KV Cache
Paper • 2402.02750 • Published • 5
Token Warping Helps MLLMs Look from Nearby Viewpoints
Paper • 2604.02870 • Published • 33
Self-Distilled RLVR
Paper • 2604.03128 • Published • 160
Turbo Sparse: Achieving LLM SOTA Performance with Minimal Activated Parameters
Paper • 2406.05955 • Published • 28
upvoted a paper about 2 months ago
upvoted an article 3 months ago
Article
Scaling Real-Time Voice Agents with Cache-Aware Streaming ASR
•
85
upvoted a collection 3 months ago
upvoted 2
articles 3 months ago
Article
Tokenization in Transformers v5: Simpler, Clearer, and More Modular
- +4
•
124
Article
NVIDIA brings agents to life with DGX Spark and Reachy Mini
- +1
•
66
upvoted a collection 5 months ago
upvoted a collection 7 months ago
upvoted 2
collections 8 months ago
upvoted a collection 11 months ago
upvoted 3
collections 12 months ago