Mixture-Of-Experts

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

21 new papers

A weekly snapshot of new work published in Mixture-Of-Experts.

Period ending 2026-09-14

8 new papers

A weekly snapshot of new work published in Mixture-Of-Experts.

Period ending 2026-09-07

23 new papers

A weekly snapshot of new work published in Mixture-Of-Experts.

Inside this field

Focused directions

584 papers

Latest in Mixture-Of-Experts

Browse all topics →
CardsList

  1. GeMoE: Gating Entropy is All You Need for Uncertainty-aware Adaptive Routing in MoE-based Large Vision-Language Models

    Jun 24, 2026Chaoxiang Cai, Minghe Weng, Jie Li +4Mixture-Of-Expert Language ModelsAdaptive Routing

  2. SARA: Unlocking Multilingual Knowledge in Mixture-of-Experts via Semantically Anchored Routing Alignment

    Jun 24, 2026Tianyu Dong, Yangyang Liu, Jiang Zhou +9Multilingual Language ModelsMixture-of-Experts Models

  3. LiMoDE: Rethinking Lifelong Robot Manipulation from a Mixture-of-Dynamic-Experts Perspective

    Jun 24, 2026Zhihao Gu, Lin WangUnseen-Task AdaptationGeneralizable Robotic Manipulations

  4. Learning Subset-Shared Invariances for Domain Generalization with Mixture-of-Experts

    Jun 24, 2026Tien-Hung Nguyen, Tien-Dat Tran, M. -Duong Nguyen +1Multimodal Domain GeneralizationDomain Generalization

  5. Heterogeneous and Adept Snapshot Distillation for 3D Semantic Segmentation

    Jun 24, 2026Xiaopei Wu, Yuenan Hou, Junkai Xu +73D Semantic SegmentationCross-Modal Distillation

  6. How Modular Is a Frontier Mixture-of-Experts? A Pre-registered Causal Test in Which Apparent Expert Modularity Mostly Dissolves

    Jun 23, 2026Tony Salomone, Deep Gandhi, Ali AsariaMixture-of-Experts ModelsModular Framework

  7. BioMedVR: Confusion-Aware Mixture-of-Prompt Experts for Biomedical Visual Reprogramming

    Jun 23, 2026Jiaxiang Liu, Tianxiang Hu, Juwei Guan +5Medical Vision-Language ModelsFew-Shot Learning

  8. CrossPool: Efficient Multi-LLM Serving for Cold MoE Models through KV-Cache and Weight Disaggregation

    Jun 23, 2026Zhuoren Ye, Tianyu Wo, Dinghao Xue +4Kv-Cache BlocksLarge Language Model Serving

  9. Transformer-Based Language Models Across Domain Verticals: Architectures, Applications and Critical Assessment

    Jun 23, 2026Guruprakash J, Krithika L. BEncoder-Decoder ArchitecturesDeepseek

  10. RAVEN: A Regime-Aware Variable-context Expert Network for Financial Time Series Forecasting

    Jun 23, 2026Cheng He, Zhenyu Guan, Xijie Liang +6Multivariate ForecastingStochastic Volatility

  11. Cross-Architectural Mixture-of-Experts with Adaptive Soft Routing for Plant Leaf Disease Classification

    Jun 22, 2026Phi-Hung Hoang, Thi-Thu-Hong PhanTomato DiseasesApple Tree Leaf Disease Segmentation Dataset

  12. Do LLM Embedding Spaces Recover Expert Structure?

    Jun 22, 2026Yixuan Zhu, Zhenke Duan, Fanghen LiMental HealthExpert Demonstrations

  13. Expert Consensus on Criteria for the Automated Assessment of Laparoscopic Camera Navigation

    Jun 22, 2026Amir Ebrahimzadeh, Nazila Esmaeili, Michael Ghadimi +1Robot-Assisted Minimally Invasive SurgeryComputer Vision

  14. AudioCALM: Continuous Autoregressive Language Modeling for Universal Audio Generation

    Jun 22, 2026Huadai Liu, Kaicheng Luo, Wen Wang +4Audio LatentAudio

  15. Training-free Task Classification for Multi-Task Model Merging

    Jun 21, 2026Jungyong Son, Jinwook Jung, Sungyong BaikContinual Model MergingMulti--Task Learning

  16. Systematic Exploration of 4-Expert Heterogeneous Mixture-of-Experts via Automated Pipeline Search

    Jun 21, 2026Yashkumar R Lukhi, Harsh Rameshbhai Moradiya, Radu Timofte +1Mixture-of-Experts ModelsNeural Architecture Search

  17. CoRDE: Concept-Prior Routed Diffusion Experts for Structural Generalization in Robot Manipulation

    Jun 20, 2026Haidong Huang, Xixin Zhao, Yaohua Zhou +5Diffusion PoliciesIterative Co-Training

  18. WiSP: A Working-Set View of Mixture-of-Experts Serving on Extremely Low-Resource Hardware

    Jun 20, 2026Jiamu Zhang, Liang Wu, Mayank Darbari +1Mixture-Of-Expert InferenceMixture-of-Experts Models

  19. Does Mixture-of-Experts Actually Help Inference on Consumer and Edge Hardware? An Empirical Study

    Jun 19, 2026Alfarizy Alfarizy, Hung Truong Thanh Nguyen, René Richard +2Mixture-Of-Expert InferenceMixture-of-Experts Models

  20. Speaker Identity in Non-Verbal Vocalizations: Conditional Distillation and Mixture of Experts Approach

    Jun 19, 2026Tzu-Chieh Wei, Yi-Cheng Lin, Huang-Cheng Chou +4Speaker Verification PerformanceSpeaker Identity

  21. Factor-Aware Mixture-of-Experts with Pretrained Encoder for Combinatorial Generalization

    Jun 19, 2026Feihong Zhang, Guojian Zhan, Zeyu He +8Diffusion PoliciesGeneralizable Robotic Manipulations

  22. MoECodec: Image Compression for joint human and machine perception via Mixture-of-Experts

    Jun 19, 2026Jiancheng Zhao, Xiang Ji, Yifan Zhan +2Learned Image CompressionMixture-of-Experts Models

  23. Grouped Query Experts: Mixture-of-Experts on GQA Self-Attention

    Jun 18, 2026Vishesh Tripathi, Abhay KumarTransformer ArchitecturesMixture-of-Experts Models

  24. Toward Calibrated Mixture-of-Experts Under Distribution Shift

    Jun 18, 2026Gina Wong, Drew Prinster, Suchi Saria +2Mixture-of-Experts ModelsDistribution Shifts

  25. CTS-MoE: Implicit Terrain Adaptation via Mixture-of-Experts for Perceptive Locomotion

    Jun 17, 2026Francisco Affonso, Matheus P. Angarola, Ana Luiza Mineiro +3Perceptive Locomotion PoliciesTerrain

  26. Geometric and Stochastic Analysis of Discontinuities in Sparse Mixture-of-Experts

    Jun 17, 2026Tho Tran Huu, Huu-Tuan Nguyen, Thien-Hai Nguyen +4Mixture-of-Experts ModelsSmoothing

  27. FoMoE: Breaking the Full-Replica Barrier with a Federation of MoEs

    Jun 17, 2026Lorenzo Sani, Zeyu Cao, Meghdad Kurmanji +5Mixture-of-Experts ModelsLarge Models

  28. Model Merging to Evolution: Parameter Space Exploration for Expert Models

    Jun 17, 2026Chao Wang, Yuchen Guo, Zheng Tan +4Continual Model MergingModel Merging

  29. MawForge: Memory-Bounded Expert Materialization for Local Mixture-of-Experts Inference

    Jun 17, 2026Craig OpieMixture-Of-Expert InferenceExpert Demonstrations

  30. Visual Verification Enables Inference-time Steering and Autonomous Policy Improvement

    Jun 16, 2026Mingtong Zhang, Dhruv ShahRobot PoliciesInference-Time Control

  31. SoftMoE: Soft Differentiable Routing for Mixture-of-Experts in LLMs

    Jun 16, 2026Mikołaj Zasada, Łukasz Struski, Jacek Tabor +1Mixture-Of-Expert Language ModelsMixture-of-Experts Models

  32. Attribution-Guided and Coverage-Maximized Pruning for Structural MoE Compression

    Jun 16, 2026Yifu Ding, Jiacheng Wang, Ge Yang +4Mixture-Of-Expert InferenceMixture-of-Experts Models

  33. TerraTransfer: Learning End-to-End Driving Policies Without Expert Demonstrations

    Jun 16, 2026Zikang Xiong, Weixin Li, Zhouchonghao Wu +6Autonomous DrivingImitation Learning

  34. Tying the Loop -- Tied Expert Layers in Mixture-of-Experts Language Models

    Jun 15, 2026Martin JaggiMixture-Of-Expert Language ModelsExperts

  35. Multi-Modal Spatio-Temporal Graph Neural Network with Mixture of Experts for Soil Organic Carbon Prediction

    Jun 15, 2026Daniele Mos, Felipe Drummond, Anton Bossenbroek +1Soil Moisture EstimationSoil

  36. MODE: Modality-Decomposed Expert-Level Mixed-Precision Quantization for MoE Multimodal LLMs

    Jun 15, 2026Yuanteng Chen, Peisong Wang, Zhilei Liu +9Mixture-Of-Expert Language ModelsMixed-Precision Quantization

  37. AI systems out-persuade expert humans

    Jun 15, 2026Kobi Hackenburg, Caroline Wagner, Luke Hewitt +5PersuasionArtificial Intelligence Systems

  38. SPRI: SVD-Partitioned Residual Initialization for Data-Constrained MoE Upcycling

    Jun 15, 2026Weiqiao Shan, Ruixiang Mao, Yuang Li +10Mixture-of-Experts ModelsModel Pretraining

  39. DynFS-MoE: Dynamic Functional-Structural Mixture-of-Experts for Post-Traumatic Epilepsy Diagnosis

    Jun 15, 2026Jun-En Ding, Spencer Chen, Henry Noren +6Interictal Epileptiform DischargesHuman Brain Networks

  40. How to Score Experts for One-Shot MoE Expert Pruning: A Unified Formulation and Selection Principle

    Jun 14, 2026Zongfang Liu, Jinghui Zhang, Zijian Ma +2ExpertsSparse Expert Activation

  41. Conflict-Aware Federated Fine-Tuning of Large Language Models with Mixture-of-Experts

    Jun 14, 2026Yijun Lu, Zihan Fang, Pengpeng Qiao +6Federated LearningMixture-of-Experts Models

  42. MoECa: Aligning Feature Reuse with Expert Decomposition in Diffusion Transformers

    Jun 14, 2026Maoliang Li, Haojing Chen, Jiayu Chen +4Mixture-Of-Expert InferenceMultimodal Diffusion Transformers

  43. A Spatio-Temporal Expert Prefetching Framework for Efficient MoE-based LLM Inference

    Jun 13, 2026Yingnan Zhao, Razvan Bunescu, Ahmed Louri +2Mixture-Of-Expert InferenceLLM Inference Efficiency

  44. Towards a Unified Generative Model for Scarce Time Series with Domain Experts

    Jun 13, 2026Zihao Yao, Qi Zheng, Jiankai Zuo +1Synthetic Time SeriesGenerative Models

  45. Director: Accelerating Distributed MoE Serving via Online Proactive Expert Placement

    Jun 13, 2026Qianli Liu, Kaibin Guo, Zicong Hong +5Mixture-Of-Expert InferenceMixture-of-Experts Models

  46. Sticky Routing: Training MoE Models for Memory-Efficient Inference

    Jun 12, 2026Ali KayyamMixture-Of-Expert Language ModelsMixture-of-Experts Models

  47. Nemotron 3 Ultra: Open, Efficient Mixture-of-Experts Hybrid Mamba-Transformer Model for Agentic Reasoning

    Jun 12, 2026NVIDIA, :, Aaron Blakeman +571Agentic ReasoningMixture-of-Experts Models

  48. iLENS: Interpretable LLM-Guided Mixture-of-Experts for Neuroimaging Survival Analysis

    Jun 12, 2026Farica Zhuang, Seong Woo Han, Zixuan Wen +3Survival PredictionsAlzheimer

  49. From Self-Supervised Speech Models to Mixture-of-Experts for Robust Anti-Spoofing

    Jun 12, 2026Hugo Daumain, Driss Matrouf, Khaled Khelif +1Spoofed SpeechSelf-Supervised Speech Models

  50. Expert-Driven Survival Machines: Improving Stratification and Interpretability in Multiple Clinical Cohorts

    Jun 12, 2026Farica Zhuang, Zixuan Wen, Christos Davatzikos +1Survival PredictionsSurvival Analysis

  51. A theoretical model for task routing in mixture-of-expert transformers

    Jun 12, 2026Vinoth Nandakumar, Yongli Xiang, Yunzhi Yao +2Mixture-of-Experts ModelsTransformer Layers

  52. Decoupled Mixture-of-Experts for Parametric Knowledge Injection

    Jun 12, 2026Baoqing Yue, Weihang Su, Qingyao Ai +5Mixture-Of-Expert Language ModelsMixture-of-Experts Models

  53. AIR-VLA+: Decoupling Movement and Manipulation via Cascaded Dual-Action Decoders with Asymmetric MoE for Aerial Robots

    Jun 11, 2026Jianli Sun, Bin Tian, Qiyao Zhang +6Aerial ManipulationAerial Robots

  54. Redesign Mixture-of-Experts Routers with Manifold Power Iteration

    Jun 10, 2026Songhao Wu, Ang Lv, Ruobing Xie +1Mixture-of-Experts ModelsExpert Demonstrations

  55. Multi-Rate Mixture of Experts for Accelerating Liquid Neural Network Training

    Jun 10, 2026Shilong Zong, Almuatazbellah Boker, Hoda EldardiryMultivariate Time Series ForecastingSpatial Attention

  56. MFEN:Multi-Frequency Expert Network for Visible-Infrared Person Re-ID

    Jun 10, 2026Xulin Li, Yan Lu, Bin Liu +4Re-IdentificationFrequency-Aware Structural Aggregation

  57. From Observation to Intervention: A Causal Audit of Expert Importance in Mixture-of-Experts Models

    Jun 9, 2026Leonard Engmann, Christian Medeiros Adriano, Holger GieseMixture-of-Experts ModelsCausal Intervention

  58. Profy: Interpretable Visualization of Expertise-Dependent Motor Skills Toward Supporting Piano Practice

    Jun 9, 2026Kazuki Kawamura, Fujiki Nakamura, Hayato Nishioka +3PianoExpert Demonstrations

  59. MoE Enhanced Federated Learning for Spatiotemporal Prediction

    Jun 9, 2026Zhehao Dai, Xiao Han, Zhaolin Deng +4Spatiotemporal PredictionTraffic

  60. Achieving Cloud-Grade SLOs for Local Mixture-of-Experts Inference through CPU-GPU Hybrid Design

    Jun 9, 2026Wenxin Wang, Yule Hou, Yu Ji +2Mixture-Of-Expert InferenceMixture-of-Experts Models