Expert Routing

Latest papers 79

All topics
CardsList
  1. Relax Within, Balance Across: Geometry-Guided Load Balancing for Vision-Language Mixture-of-Experts

    Aug 1, 2026Ziang Wu, Peng Jin, Qishen Yin +4Expert Load BalancingVision-Language Models

  2. EntropyMoE: Entropy-Aware Sparse Expert Routing for Tokenizer-Free LLMs

    Jul 31, 2026Bo Liu, Muxuab Yu, Yu Zhang +2Sparse Mixture-of-ExpertsByte-Level Language Model

  3. Beyond Geometric Complementarity: Coherent Overlap in Sparse Mixture-of-Experts Routing

    Jul 30, 2026Huiyuan Tian, Bonan Xu, Shijian LiSparse Mixture-of-ExpertsExpert Routing

  4. Route by Kinematics, Act by Observation: Kinematics-Supervised Expert Routing in MoE-Augmented VLA

    Jul 29, 2026Tianhang Yang, Yanze Zheng, Junjie Wang +3Robot Policy LearningExpert Routing

  5. Spend Experts Where You Are Unsure: Confidence-Adaptive Routing for Mixture-of-Experts LoRA

    Jul 28, 2026Tom Saliencro, Rohan Desai, Priya Nair +2Parameter-Free Mixture-of-Experts RoutingLLM Inference Acceleration

  6. OPERA: Offline Policy-guided Expert Routing and Adaptation for Universal Biomedical Image Analysis

    Jul 27, 2026Zihan Li, Feiyang Liu, Dandan Shan +2Test-Time AdaptationMedical Image Analysis

  7. Beyond Independent Optimization: Compression, MoE Routing, and Quantization Interactions in Multimodal Edge Intelligence

    Jul 23, 2026Jay Gor, Karm Dave, Akshita Abrol +3Efficient Multimodal InferenceVLM Quantization

  8. Multi-level context Modeling for consistent expert selection in Mixture-of-Experts

    Jul 17, 2026Shuhan Huang, Naifan Zhang, Yuanbo Tang +2Mixture-of-Experts Language ModelsExpert Routing

  9. From Global to Factor-Wise Expert Composition in Discrete Diffusion Models

    Jul 13, 2026Haozhe Huang, Yudong Xu, Abhijoy Mandal +1Expert RoutingMixture-of-Experts Models

  10. H-SAGE: Holistic Speaker-Aware Guided Experts for MoE-based Multi-Talker ASR

    Jul 2, 2026Yujie Guo, Jiaming Zhou, Yuhang Jia +2Automatic Speech RecognitionExpert Routing

  11. Focusing on What Matters: Saliency-Harnessing Accurate Routing for Diffusion MoE

    Jun 25, 2026Haoyou Deng, Keyu Yan, Chaojie Mao +4Expert RoutingDiffusion-Based Image Generation

  12. GeMoE: Gating Entropy is All You Need for Uncertainty-aware Adaptive Routing in MoE-based Large Vision-Language Models

    Jun 24, 2026Chaoxiang Cai, Minghe Weng, Jie Li +4Efficient VLM InferenceLarge Vision-Language Models

  13. SARA: Unlocking Multilingual Knowledge in Mixture-of-Experts via Semantically Anchored Routing Alignment

    Jun 24, 2026Tianyu Dong, Yangyang Liu, Jiang Zhou +9Multilingual Language ModelsSparse Mixture-of-Experts

  14. Task-Instructed Causal Routing of Vision Foundation Models for Multi-Task Learning

    Jun 14, 2026Donghyun Han, Yuseok Bae, Jung Uk Kim +1Vision Foundation Model AdaptationMulti-Task Learning

  15. Redesign Mixture-of-Experts Routers with Manifold Power Iteration

    Jun 10, 2026Songhao Wu, Ang Lv, Ruobing Xie +1Mixture-of-Experts Language ModelsExpert Routing

  16. PADD: Path-Aligned Decompression Distillation for Non-Router Teacher to Guide MoE Student Learning

    Jun 9, 2026Xinyue Peng, Yi Qian, Jiaojiao Lin +2Mixture-of-Experts Language ModelsExpert Routing

  17. STAR: Rethinking MoE Routing as Structure-Aware Subspace Learning

    Jun 7, 2026Sumin Park, Noseong ParkSparse Mixture-of-ExpertsExpert Routing

  18. Expert-Aware Refusal Steering

    Jun 2, 2026Anna C. Marbut, Daniel R. Olson, Travis J. WheelerMixture-of-Experts Language ModelsLanguage Model Steering

  19. ProbMoE: Differentiable Probabilistic Routing for Mixture-of-Experts

    Jun 1, 2026Heng Zhao, Zilei Shao, Guy Van den Broeck +1Sparse Mixture-of-ExpertsExpert Routing

  20. PR2: Predictive Routing Replay for MoE-Based LLM Reinforcement Learning

    May 29, 2026Daize Dong, Junlin Chen, Haolong Jia +9RL for Language Model ReasoningExpert Routing

  21. Safety-Oriented Routing Analysis of Mixtral MoE Under Benign and Harmful Prompts

    May 22, 2026Md Nurul Absar SiddikyMixture-of-Experts Language ModelsExpert Routing

  22. Can AI Guess What You Know? Performance Comparison of Large Language Models for Human Domain Knowledge Estimation From Communication Logs

    May 21, 2026Ko Watanabe, Shoya IshimaruLLM EvaluationExpert Routing

  23. Mixture of Experts for Low-Resource LLMs

    May 17, 2026Ori Bar Joseph, Smadar Arvatz, Noam Kayzer +2Mixture-of-Experts Language ModelsExpert Routing

  24. Stable Routing for Mixture-of-Experts in Class-Incremental Learning

    May 17, 2026Zirui Guo, Quan Cheng, Da-Wei Zhou +1Class-Incremental LearningExpert Routing