XQuant: Breaking the Memory Wall for LLM Inference with KV Cache Rematerialization
Paper • 2508.10395 • Published • 42
Sehoon Kim
kssteven
AI & ML interests
Efficient AI, AI Systems, Model Compression
Organizations
None yet
upvoted a paper 8 months ago
upvoted an article about 1 year ago
Article
Hugging Face and FriendliAI partner to supercharge model deployment on the Hub
- +2
•
36
upvoted a paper about 2 years ago