Sparse Mixture-of-Experts

Latest papers 80

All topics
CardsList
  1. Routers Learn the Geometry of Their Experts: Geometric Coupling in Sparse Mixture-of-Experts

    May 12, 2026Sagi Ahrac, Noya Hochwald, Mor GevaExpert Load BalancingParameter-Free Mixture-of-Experts Routing

  2. Slicing and Dicing: Configuring Optimal Mixtures of Experts

    May 12, 2026Margaret Li, Sneha Kudugunta, Danielle Rothermel +1Mixture-of-Experts Language ModelsMixture of Experts

  3. DECO: Sparse Mixture-of-Experts with Dense-Comparable Performance on End-Side Devices

    May 11, 2026Chenyang Song, Weilin Zhao, Xu Han +3Sparse Mixture-of-ExpertsMixture-of-Experts Inference

  4. FLAME: Adaptive Mixture-of-Experts for Continual Multimodal Multi-Task Learning

    May 10, 2026Xing Han, Shravan Chaudhari, Tanvi Ranade +2Cross-Modal LearningHealthcare

  5. SDG-MoE: Signed Debate Graph Mixture-of-Experts

    May 8, 2026Stepan Kulibaba, Kirill Labzin, Artem Dzhalilov +4Mixture-of-Experts Language ModelsMixture of Experts

  6. Hierarchical Mixture-of-Experts with Two-Stage Optimization

    May 8, 2026Gleb Molodtsov, Alexander Miasnikov, Aleksandr BeznosikovExpert Load BalancingMixture of Experts

  7. UniPool: Learning Expert-to-Layer Ownership from Brief Global Access

    May 7, 2026Minbin Huang, Han Shi, Chuanyang Zheng +5Mixture-of-Experts Language ModelsMixture of Experts

  8. E = T*H/(O+B): A Dimensionless Control Parameter for Mixture-of-Experts Ecology

    May 7, 2026Qingjun ZhangExpert Load BalancingMixture of Experts

  9. The Thinking Pixel: Recursive Sparse Reasoning in Multimodal Diffusion Latents

    Apr 28, 2026Yuwei Sun, Yuxuan Yao, Hui Li +1Diffusion TransformerConditional Image Generation

  10. Preserving Long-Tailed Expert Information in Mixture-of-Experts Tuning

    Apr 24, 2026Haoze He, Xingyuan Ding, Xuan Jiang +5Supervised Fine-TuningFine-Tuning

  11. Teacher-Guided Routing for Sparse Vision Mixture-of-Experts

    Apr 23, 2026Masahiro Kada, Ryota Yoshihashi, Satoshi Ikehata +2Adaptive Model RoutingSparse Mixture-of-Experts

  12. Quadruped Parkour Learning: Sparsely Gated Mixture of Experts with Visual Input

    Apr 21, 2026Michael Ziegltrum, Jianhao Jiao, Tianhu Peng +2Robot Policy LearningSparse Mixture-of-Experts

  13. Adaptive Semantic Communication for Wireless Image Transmission Leveraging Mixture-of-Experts Mechanism

    Apr 3, 2026Haowen Wan, Qianqian YangAdaptive Model RoutingSparse Mixture-of-Experts

  14. Modality-Guided Mixture of Structured Experts with Entropy-Triggered Routing for Multimodal Recommendation

    Feb 24, 2026Ji Dai, Quan Fang, DeSheng CaiSparse Mixture-of-ExpertsRecommender Systems

  15. A Replicate-and-Quantize Strategy for Plug-and-Play Load Balancing of Sparse Mixture-of-Experts LLMs

    Feb 23, 2026Zijie Liu, Jie Peng, Jinhao Duan +7Expert Load BalancingMixture of Experts

  16. Regularized Estimation and Feature Selection in Mixtures of Generalized Linear Experts

    Jul 14, 2019Thin Nguyen-Van, Faicel Chamroukhi, Ha Hoang Van +1Mixture of ExpertsSparse Mixture-of-Experts