DualSpec: Accelerating Deep Research Agents via Dual-Process Action Speculation Paper • 2603.07416 • Published Mar 8 • 1
HybriMoE: Hybrid CPU-GPU Scheduling and Cache Management for Efficient MoE Inference Paper • 2504.05897 • Published Apr 8, 2025 • 21
HybriMoE: Hybrid CPU-GPU Scheduling and Cache Management for Efficient MoE Inference Paper • 2504.05897 • Published Apr 8, 2025 • 21 • 2
AdapMoE: Adaptive Sensitivity-based Expert Gating and Management for Efficient MoE Inference Paper • 2408.10284 • Published Aug 19, 2024 • 1
HybriMoE: Hybrid CPU-GPU Scheduling and Cache Management for Efficient MoE Inference Paper • 2504.05897 • Published Apr 8, 2025 • 21
ProPD: Dynamic Token Tree Pruning and Generation for LLM Parallel Decoding Paper • 2402.13485 • Published Feb 21, 2024
AdapMoE: Adaptive Sensitivity-based Expert Gating and Management for Efficient MoE Inference Paper • 2408.10284 • Published Aug 19, 2024 • 1