Efficient Backpropagation with Variance-Controlled Adaptive Sampling Paper • 2402.17227 • Published Feb 27, 2024
ReMoE: Fully Differentiable Mixture-of-Experts with ReLU Routing Paper • 2412.14711 • Published Dec 19, 2024 • 16
