Interleaved Head Attention
Paper • 2602.21371 • Published • 1
Luc Robert--Villanueva
lucrbrtv
AI & ML interests
None yet
Recent Activity
liked a model about 20 hours ago
VatsaDev/1b_research upvoted a paper 4 days ago
Interleaved Head Attention upvoted a changelog 8 days ago
Agent Traces on the HubOrganizations
None yet
upvoted a paper 4 days ago
upvoted a changelog 8 days ago
Hugging Face Changelog
Agent Traces on the Hub
• 100
upvoted an article 15 days ago
Article
Welcome Gemma 4: Frontier multimodal intelligence on device
- +5
•
854
upvoted a paper 17 days ago
upvoted a collection 17 days ago
upvoted a changelog 30 days ago
Hugging Face Changelog
Hugging Face Papers for AI Agents
• 137
upvoted an article about 1 month ago
Article
PRX Part 3 — Training a Text-to-Image Model in 24h!
•
61
upvoted 2
papers about 1 month ago
upvoted an article about 2 months ago
Article
Mixture of Experts (MoEs) in Transformers
- +5
•
154
upvoted an article 4 months ago
Article
We Got Claude to Fine-Tune an Open Source LLM
•
618
upvoted an article 5 months ago
Article
Transformers v5: Simple model definitions powering the AI ecosystem
- +2
•
309
upvoted a paper 5 months ago
upvoted 7
articles 5 months ago
Article
~Don't~ Repeat Yourself
•
55
Article
nanoVLM: The simplest repository to train your VLM in pure PyTorch
- +5
•
255
Article
The 1 Billion Token Challenge: Finding the Perfect Pre-training Mix
•
65
Article
Text-to-image Architectural Experiments
•
56
Article
Why Did MiniMax M2 End Up as a Full Attention Model?
•
80
Article
We’re open-sourcing our text-to-image model and the process behind it
•
97
Article
Streaming datasets: 100x More Efficient
- +3
•
86