Mixture-of-Experts Models

Ask about this topic

Momentum

41 papers in the last four weeks, up 116% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 297

All topics
CardsList

  1. Exact Quantile Balancing and Load-Error Injection for Mixture-of-Experts

    Sep 23, 2026Pit Neitemeier, Jiaze Li, Alessio Serra +2Expert Load BalancingExpert Routing

    Aleph Alpha

  2. Unlocking Cross-Scenario Physical Layer Security: A Mixture-of-Experts Framework with Generative Diffusion Models

    Sep 22, 2026Xiao Tang, Tong Hui, Chao Shen +46G NetworksWireless Communications

    School of Information and Communication Engineering, Xi’an Jiaotong University, Xi’an 710049, China · Shenzhen Research Institute of Northwestern Polytechnical University, Shenzhen 518057, China · School of Electronics and Information, Northwestern Polytechnical University, Xi’an 710072, China +3

  3. PreGS: A Parameter-Transfer-Based Multi-Expert Graph Neural Network for Node Classification

    Sep 22, 2026Zhicong Cai, Yinglong Zhang, Xiaoying Hong +2Graph Neural NetworksMixture-of-Experts Models

    College of Physics and Information Engineering, Minnan Normal University, Zhangzhou 363000, China

  4. MECT: Mixture of Experts with CNN-Transformer Network for Speaker verification

    Sep 21, 2026Yu Zheng, Jinghan Peng, ChangHao Zhang +2Speaker VerificationHybrid CNN-Transformer Architectures

    Machine Intelligence, Ant Group, Shanghai, China

  5. All-in-One Multilingual Scene Text Recognition with Script-aware Mixture-of-Experts

    Sep 21, 2026Xingsong Ye, Yongkun Du, Jiaxin Zhang +6Scene Text RecognitionMixture-of-Experts Models

    Institute of Trustworthy Embodied AI, Fudan University · Shanghai Key Laboratory of Multimodal Embodied AI · WeChat Vision, Tencent Inc. +1

  6. Generalist-Specialist Mixture-of-Experts for Rare Pathology Detection in Multimodal Imaging

    Sep 16, 2026Johannes Kaiser, Florian Braunmiller, Daniel Rückert +1Multimodal ClassificationMixture-of-Experts Models

    Chair for AI in Healthcare and Medicine, Technical University of Munich (TUM) and TUM University Hospital, Munich, Germany · Hasso Plattner Institute for Digital Engineering, University of Potsdam, Potsdam, Germany · Department of Computing, Imperial College London, UK

  7. Colla-Q: Toward Collaborative Experts in MoE Quantization via Minimax Precision Balancing

    Sep 16, 2026Eunju Shin, Jongbin RyuMixed-Precision QuantizationMixture-of-Experts Quantization

    Ajou University, South Korea

  8. Dataset-Dependent Effects of Cross-Depth Aggregation and Soft-Routed Experts in EEG Foundation Model Fine-Tuning

    Sep 15, 2026Mingyang Jiang, Yamin Li, Daniel Moyer +3Attention Residual ConnectionsEEG Decoding

    Department of Computer Science, Vanderbilt University · Department of Biomedical Informatics and Data Science, Yale University

  9. What Breaks Under Pruning in Smart Homes, and When? Evaluating LLM Degradation Across Architectures and Task Complexity

    Sep 15, 2026Congjing Zhang, Vashishtha Patil, Henning Lange +1LLM GroundingLLM Pruning

    Alexa Home AI, Amazon.com · University of Washington

  10. Dense to MoE Adaptation for Compact Vision Language Action Policies

    Sep 15, 2026Muchun Niu, Shuang Chen, Yuzhou Wu +1Robot Policy AdaptationEfficient VLA Models

    Shanghai Jiao Tong University, Shanghai, China · Tianji KernalMind Co., Ltd.

  11. STHMoE: Hypergraph-Enhanced Heterogeneous Dependency Coordination for LLM-Based Urban Traffic Data Forecasting

    Sep 14, 2026Jiawen Chen, Qi Shao, Yongjian Chang +3Traffic Flow EstimationLLM-Based Time Series Forecasting

    School of Mathematics, Southeast University, Nanjing 210096, China · School of Cyber Science and Engineering, Southeast University, Nanjing 210096, China · Jiangsu Province Center for Applied Mathematical Sciences, Nanjing 210096, China

  12. Horizon-specific Expert Fusion for Photovoltaic Power Forecasting

    Sep 14, 2026Xu Yuqing, Zhou Liguo, Sun Ze +2Ensemble LearningSolar Power Forecasting

    School of Computer Science and Technology, Huaibei Normal University, China

  13. Evidence-Aligned Local Composition of Discrete Experts for Sequence Restoration

    Sep 14, 2026Mohammad Panahazari, Usman A. Khan, Shuchin AeronMixture-of-Experts InferenceMixture-of-Experts Models

    Department of Electrical and Computer Engineering, Tufts University, Medford, Massachusetts · Boston College, Chestnut Hill, Massachusetts

  14. Expert-Space Exploration in MoE Reinforcement Learning

    Sep 14, 2026Hongyi He, Zhenghao Lin, Xiao Liu +3Reinforcement LearningExpert Routing

    Tsinghua University · Microsoft Research

  15. Distribution-Consistent Inference for Dynamic Sparse Mixture-of-Experts

    Sep 10, 2026Dohyeon Kim, Bedionita Soro, Sung Ju HwangParameter-Free Mixture-of-Experts RoutingSparse Mixture-of-Experts

    KAIST

  16. Chimaera: A Mixture-of-Graph-Experts Architecture for Cross-Task and Cross-Dataset Graph Learning

    Sep 8, 2026Jonathan Frank, David Richerby, Ansgar ScherpGraph Neural NetworksText-Attributed Graph Learning

    University of Ulm · University of Essex

  17. Hyperparameter Scaling Laws Across MoE Sparsity

    Sep 8, 2026Changxin Tian, Kunlong Chen, Jia Liu +3Language Model Scaling LawsSparse Mixture-of-Experts

    Ling Team, Ant Group

  18. MoEMB: Scaling Universal Multimodal Embeddings with Efficient Mixture-of-Experts Models

    Sep 8, 2026Xuanming Cui, Shlok Kumar Mishra, Wentao Bao +6Efficient Multimodal InferenceMultimodal Embedding

    University of Central Florida · Work done at Meta · AI at Meta

  19. Router Prior Bias: Preserving Base Routing Structure in MoE Post-Training

    Sep 8, 2026Jaedeok Lee, Keonwoo Kim, Dongyoon Han +3LLM RoutingMixture-of-Experts Models

    1NAVER Applied AI Group · 2Healthcare AI Research Institute (HARI), Seoul National University Hospital · 3NAVER AI Lab

  20. Latent-MoE: Domain-Aware Mixture-of-Experts for PDEs with Multi-Regime Physics

    Sep 7, 2026Hanwen Wang, Paris PerdikarisNeural PDE SolversPhysics-Informed ML

    Graduate Group of Applied Mathematics and Computational Science University of Pennsylvania Philadelphia, PA 19104 · Department of Mechanical Engineering and Applied Mechanics University of Pennsylvania Philadelphia, PA 19104

  21. MEOX: Compact Multimodal Mixture-of-Experts for Earth Observation

    Sep 4, 2026Mohanad AlbughdadiMasked AutoencodersGeospatial Representation Learning

    European Centre for Medium-Range Weather Forecasts Bonn, Germany

  22. Towards a Statistical Understanding of Mixture-of-Experts

    Sep 3, 2026Siyuan He, Bokai Yang, Jie Hu +2Mixture of ExpertsSparse Mixture-of-Experts

    Qiuzhen College, Tsinghua University, Beijing, China. · KLATASDS-MOE, School of Statistics, East China Normal University, Shanghai, China. · Yau Mathematical Sciences Center, Tsinghua University, Beijing, China. +1

  23. Routing Is Not Enough: Diagnosing Intra-Adapter Subspace Contention in MoE+LoRA Fine-Tuning

    Sep 2, 2026Mehreen Hossain Chowdhury, Nowshin Mahjabin, Ahmed Shafin Ruhan +3Fine-TuningLow-Rank Adaptation

    1Islamic University of Technology · 2York University · 3Dialpad Inc.

  24. SEAL: Reinforcing Global Safety in Mixture-of-Experts through Shared Expert ALignment

    Sep 2, 2026Qingyu Meng, Yiwei Zha, Jiahuan Pei +3LLM Safety AlignmentJailbreak Defense

    Vrije Universiteit Amsterdam Amsterdam, Netherlands

  25. PCoMoE: Shifting MoE Inference from Monolithic Expert Selection to Fine-Grained Path Composition

    Sep 1, 2026Ziyan Gan, Fangxin Liu, Chenyang Guan +10Mixture-of-Experts PruningMixture-of-Experts Inference

    1Shanghai Jiao Tong University, China · 2Alibaba Group, China

  26. PRIME: Mitigating Subgroup Optimization Competition in Shared CTR Top Networks with Plug-in Residual Input-Conditioned Mixture of Expert

    Aug 31, 2026Heng Yao, Siyun Hou, Tianying Liu +8Residual LearningGradient Interference

    Ant Group · Henan Polytechnic University · Independent Researcher +1

  27. On the Design of Qwen3.8-Next Architecture: Evaluation, Efficiency, and Training Stability

    Aug 31, 2026Zihan Qiu, Zekun Wang, Xiao Li +33Efficient Language Model TrainingSparse Attention

    Qwen Team

  28. Structure Aware Neural Architecture Search for Mixture of Experts

    Aug 30, 2026Petr Babkin, Oleg BakhteevExpectation-MaximizationNeural Architecture Search

  29. DCA-MoE: Spatially Adaptive Cross-Layer Fusion and Density-Routed Experts for Crowd Counting

    Aug 15, 2026Hao WangCrowd CountingMulti-Scale Feature Fusion

    BDNRC

  30. Regime-Gated Residual Mixture-of-Experts for Cross-Sectional Volatility Forecasting

    Aug 12, 2026Junyi Ye, Gargi Vijay BordeQuantitative FinanceNon-Stationary Time Series Forecasting

    School of Computing, Montclair State University · Montclair, New Jersey, USA