Overview

Expert routing studies how models assign tokens, examples, or tasks to a small subset of experts, enabling conditional computation while storing many specialized networks. Common approaches include top-k token-choice and expert-choice gates, hierarchical and threshold-based routing, and adaptive policies driven by uncertainty, task information, or learned structure. Researchers test these methods in autoregressive language models, vision and multimodal systems, and diffusion models, measuring quality on benchmarks such as WikiText, MMLU, GSM8K, and ImageNet alongside load balance, latency, and memory use. A central tension is that balancing expert workloads can conflict with specialization and efficient execution, while analyses increasingly question whether routing patterns alone demonstrate genuine domain expertise or useful downstream effects.

Latest papers

CardsList

127 papers16 papers in the last four weeks, down 30% on the four weeks before. 0.1% of all new papers.

  1. CECAR: Cache & Expert Co-Aware Routing Accelerates On-Device Inference of MoE LLMs

    Nov 15, 2026Byeongju Kim, Hoonki Lee, Byungjun Kim +4On-Device Language Model InferenceMixture-of-Experts Inference

  2. GLCR: Global-Local Collaborative Routing for Multi-Task Electromagnetic Signal Processing

    Nov 11, 2026Fang Lu, Yao Lu, Zhuangzhi Chen +5Adaptive Model RoutingExpert Routing

  3. Matching the Training-Time Weight Rule in Inference-Time Expert Deactivation

    Nov 4, 2026Hao Cheng, Zhiyu Yang, Bo Ma +1Mixture-of-Experts InferenceExpert Routing

  4. What We Keep of What We Forget: Replacement Operators and Routing Semantics in Training-Free MoE Expert Pruning

    Oct 30, 2026Ezza Ali, Sehrish Bibi, Momina Moetesum +1Mixture-of-Experts PruningExpert Routing

  5. Modular Bayesian Foundation Models: Bayesian time series encoders for OOD detection, routing and forecasting

    Oct 28, 2026Mame Diarra Toure, Quang Hung Pham, Mohamed Ryad Zemouri +3Time-Series Foundation ModelsModular Neural Networks

  6. Learning What to Share: Expert Specialization for Time-Series Forecasting

    Oct 24, 2026Bashar Khoury, Shadi Omari, Assaf SchusterMultivariate Time Series ForecastingMixture-of-Experts Expert Specialization

  7. A Strong MoE Is All You Need for Process Supervision

    Oct 21, 2026Guanzhi Deng, Zengyan Liu, Haibo Wang +5Process SupervisionProcess Reward Models

  8. APRIL: Ambiguity-Aware Expert Routing for Respiratory Sound Domain-Incremental Learning

    Oct 20, 2026Xinhong Li, Weiping TuRespiratory Sound ClassificationDomain-Incremental Learning

  9. Learning to Refer: Inference-Time Collaboration in Decentralized Federated Learning

    Oct 19, 2026Yuheng Ma, Chendi Wang, Qiong ZhangFederated LearningDecentralized Learning

  10. Map-Distribution Mixture-of-Experts for Multi-Agent Pathfinding

    Oct 19, 2026Fumimaro Suzuki, Keisuke OkumuraMulti-Agent Path FindingMixture-of-Experts Models

  11. Rethinking Routing Exploration in Modern Mixture-of-Experts

    Oct 15, 2026Bingcong Li, Hao Ma, Michael Muehlebach +2Mixture-of-Experts ModelsExpert Routing

  12. Regime-Aware Router Learning for Multi-Domain Medical Image Generation with Diffusion Experts

    Oct 12, 2026Yaoshuai Ma, Wei Yao, Yongxiang Liu +5Expert RoutingDiffusion-Based Image Generation

  13. Cost-Aware Mixture-of-Experts Coordination for Model Markets

    Oct 8, 2026Yizhou Ma, Wenbo Wu, Xikun Jiang +2Mixture-of-Experts ModelsExpert Routing

  14. RouterInterp: Understanding Superposed Specialisation in Mixture of Experts Routing

    Oct 8, 2026Ilya Lasy, Nora Yinuo Cai, Kola AyonrindeMixture-of-Experts InterpretabilityMixture of Experts

  15. DivMoE: Fine-Grained MoE Upcycling via Cross-Domain Expert Composition

    Oct 8, 2026Yuxuan Lou, Kai Yang, Geng Zhang +2Mixture-of-Experts ModelsSparse Mixture-of-Experts

  16. MASKerade: Token-Routed Mask Experts for Dense-to-MoE Upcycling

    Oct 6, 2026Mingyuan Zhang, Yue Bai, Zhongruo Wang +5Expert RoutingSparse Neural Networks

  17. Memory-Efficient Expert Routing for Distributed MoE Training

    Oct 5, 2026Arnab Kanti Tarafder, Jaume Guasch-Martí, Gokcen Kestor +1Expert RoutingMixture-of-Experts Models

  18. Structuring MoE Expert Selection for Agentic Reinforcement Learning

    Oct 5, 2026Bolian Li, Ting-Yao Hu, Cheng-Yu Hsieh +3Agentic RLExpert Routing

  19. How Sparse Probability Maps Shape Mixture-of-Experts Routing

    Oct 5, 2026Tomás Brogueira, Marcos Treviso, Miguel CouceiroMixture-of-Experts Language ModelsMixture-of-Experts Inference

  20. CIPHER-MoE: Balancing Efficiency and Routing Fidelity in Trillion-Scale MoE Training

    Oct 5, 2026Jing Li, Jian Meng, Yingmeng Gao +8Expert Load BalancingExpert Routing

  21. Conditional Capacity and Routing in Mixture-of-Experts Particle Transformers

    Oct 2, 2026Kaushik Pendiyala, Haris Zia, Trevin Lee +8Mixture-of-Experts ModelsSparse Mixture-of-Experts

  22. Auditing Routing Entropy as an Uncertainty Signal in Attention-Residual Transformers

    Oct 1, 2026Wenhao Liang, Lin Yue, Wei Emma Zhang +3Uncertainty QuantificationModel Calibration