Mixture-Of-Experts

Follow this field Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

21 new papers

A weekly snapshot of new work published in Mixture-Of-Experts.

Period ending 2026-09-14

8 new papers

A weekly snapshot of new work published in Mixture-Of-Experts.

Period ending 2026-09-07

23 new papers

A weekly snapshot of new work published in Mixture-Of-Experts.

Inside this field

Focused directions

Focused topic

Mixture-of-Experts Models

Within Mixture-Of-Experts

419 papersExplore

Focused topic

Experts

Within Mixture-Of-Experts

167 papersExplore

Focused topic

Mixture-Of-Expert Language Models

Within Mixture-Of-Experts

72 papersExplore

Focused topic

Mixture-Of-Expert Inference

Within Mixture-Of-Experts

66 papersExplore

Focused topic

Expert Demonstrations

Within Mixture-Of-Experts

55 papersExplore

Focused topic

Load Balancing

Within Mixture-Of-Experts

18 papersExplore

584 papers

Latest in Mixture-Of-Experts

Browse all topics →

E = T*H/(O+B): A Dimensionless Control Parameter for Mixture-of-Experts Ecology
May 7, 2026Qingjun ZhangMixture-of-Experts Models Exponents
Federation of Experts: Communication Efficient Distributed Inference for Large Language Models
May 7, 2026Muhammad Shahir Abdurrahman, Chun Deng, Azalia Mirhoseini +1Mixture-Of-Expert Inference LLM Inference Efficiency
VLA-GSE: Boosting Parameter-Efficient Fine-Tuning in VLA with Generalized and Specialized Experts
May 7, 2026Yuhua Jiang, Junjie Lu, Xinyao Qin +4Large Vision Language Models Parameter-Efficient Fine-Tuning
Continuous Expert Assembly: Instance-Conditioned Low-Rank Residuals for All-in-One Image Restoration
May 7, 2026Haisen He, Xiangyu Zou, SongLin Dong +3Image Restoration Restoration
Relay Buffer Independent Communication over Pooled HBM for Efficient MoE Inference on Ascend
May 7, 2026Tianlun Hu, Tiancheng Hu, Shengsheng Litang +8Mixture-Of-Expert Inference Workload
VisMMOE: Exploiting Visual-Expert Affinity for Efficient Visual-Language MoE Offloading
May 7, 2026Cheng Xu, Xiaofeng Hou, Jiacheng Liu +1Large Vision Language Models Mixture-of-Experts Models
MTL-MAD: Multi-Task Learners are Effective Medical Anomaly Detectors
May 7, 2026Bogdan Alexandru Bercean, Florinel Alin Croitoru, Vlad Hondru +3Medical Imaging Anomaly
Detecting Time Series Anomalies Like an Expert: A Multi-Agent LLM Framework with Specialized Analyzers
May 7, 2026Hyeongwon Kang, Jeongseob Kim, Jinwoo Park +1Time-Series Anomaly Detection Anomaly Detection
ZAYA1-8B Technical Report
May 6, 2026Robert Washbourne, Rishi Iyer, Tomas Figliolia +15Deepseek Mixture-of-Experts Models
Expert Routing for Communication-Efficient MoE via Finite Expert Banks
May 6, 2026Mohammad Reza Deylam Salehi, Ali KhalesiMixture-Of-Expert Inference Mixture-of-Experts Models
Piper: Efficient Large-Scale MoE Training via Resource Modeling and Pipelined Hybrid Parallelism
May 6, 2026Sajal Dash, Feiyi WangMixture-Of-Expert Inference High-Performance Computing
Adaptive Inverted-Index Routing for Granular Mixtures-of-Experts
May 6, 2026Klaus-Rudolf Kladny, Maximilian Mordig, Bernhard Schölkopf +1Mixture-of-Experts Models
AxMoE: Characterizing the Impact of Approximate Multipliers on Mixture-of-Experts DNN Architectures
May 6, 2026Omkar B Shende, Marcello Traiola, Gayathri AnanthanarayananMixture-Of-Expert Inference Graph Neural Network Inference
SPHERE: Mitigating the Loss of Spectral Plasticity in Mixture-of-Experts for Deep Reinforcement Learning
May 6, 2026Lirui Luo, Guoxi Zhang, Hongming Xu +2Deep Reinforcement Learning Mixture-of-Experts Models
YOTOnet: Zero-Shot Cross-Domain Fault Diagnosis via Domain-Conditioned Mixture of Experts
May 6, 2026Zesen Wang, Zihao Wu, Yue Hu +2Fault Diagnosis Multimodal Domain Generalization
GEM: Graph-Enhanced Mixture-of-Experts with ReAct Agents for Dialogue State Tracking
May 6, 2026Ziqi Zhu, Adithya Suresh, Tomal Deb +1Multi-Turn Conversations Agent Framework
Unified Multimodal Visual Tracking with Dual Mixture-of-Experts
May 5, 2026Lingyi Hong, Jinglun Li, Xinyu Zhou +6Multi-Object Tracking Multimodal Fusion
Toward Structural Multimodal Representations: Specialization, Selection, and Sparsification via Mixture-of-Experts
May 5, 2026Hahyeon Choi, Nojun KwakMulti-Modal Representation Learning Mixture-of-Experts Models
Ortho-Hydra: Orthogonalized Experts for DiT LoRA
May 5, 2026Seunghyun JiMultimodal Diffusion Transformers Low-Rank Adaptation
M\textsuperscript{4}Fuse: Lightweight State-Space MoE with a Cross-Scale Gating Bridge for Brain Tumor Segmentation
May 4, 2026Meihua Zhou, Xinyu Tong, Li YangBrain Tumor Segmentation Mixture-of-Experts Models
MoE-Prefill: Zero Redundancy Overheads in MoE Prefill Serving
May 3, 2026Zhaoyuan Su, Olatunji Ruwase, Karthik Ganesan +5Mixture-Of-Expert Inference Prefill
Affinity Is Not Enough: Recovering the Free Energy Principle in Mixture-of-Experts
May 1, 2026Man Yung WongMixture-of-Experts Models Free Energy Principle
RouteHijack: Routing-Aware Attack on Mixture-of-Experts LLMs
May 1, 2026Zhiyuan Xu, Joseph Gardiner, Sana Belguith +1Hijacking Mixture-of-Experts Models
SpaceMoE: Realizing Distributed Mixture-of-Experts Inference over Space Networks
May 1, 2026Zhanwei Wang, Huiling Yang, Min Sheng +2Mixture-Of-Expert Inference Mixture-of-Experts Models
Making Every Verified Token Count: Adaptive Verification for MoE Speculative Decoding
May 1, 2026Lehan Pan, Ziyang Tao, Ruoyu Pang +3Speculative Decoding Autoregressive Decoding
Rethinking Network Topologies for Cost-Effective Mixture-of-Experts LLM Serving
Apr 30, 2026Junsun Choi, Sam Son, Sunjin Choi +5Mixture-Of-Expert Language Models Mixture-of-Experts Models
Prediction-powered Inference by Mixture of Experts
Apr 30, 2026Yanwu Gu, Linglong Kong, Dong XiaMixture-Of-Expert Inference Probabilistic Inference
Path-Lock Expert: Separating Reasoning Mode in Hybrid Thinking via Architecture-Level Separation
Apr 29, 2026Shouren Wang, Wang Yang, Chuang Ma +7Mixture-Of-Expert Language Models Hybrid
FaaSMoE: A Serverless Framework for Multi-Tenant Mixture-of-Experts Serving
Apr 29, 2026Minghe Wang, Trever Schirmer, Mohammadreza Malekabbasi +1Mixture-of-Experts Models Kubernetes
Advancing multi-site emission control: A physics-informed transfer learning framework with mixture of experts for carbon-pollutant synergy
Apr 29, 2026Yuxuan Ying, Hanqing Yang, Kaige Wang +6Carbon Emissions Waste
Adaptive and Fine-grained Module-wise Expert Pruning for Efficient LoRA-MoE Fine-Tuning
Apr 29, 2026Weihang Li, Jianchun Liu, Hongli XuMixture-of-Experts Models Parameter-Efficient Fine-Tuning
Mixture of Experts Framework in Machine Learning Interatomic Potentials for Atomistic Simulations
Apr 28, 2026Gabriel de Miranda Nascimento, Marc L. Descoteaux, Laura Zichi +9Interatomic Potentials Molecular Dynamics
RaMP: Runtime-Aware Megakernel Polymorphism for Mixture-of-Experts
Apr 28, 2026Vyom Sharma, Debajyoti DattaMixture-Of-Expert Inference Mixture-of-Experts Models
Marco-MoE: Open Multilingual Mixture-of-Expert Language Models with Efficient Upcycling
Apr 28, 2026Fan Jiang, Yu Zhao, Chenyang Lyu +5Mixture-Of-Expert Language Models Mixture-of-Experts Models
The Thinking Pixel: Recursive Sparse Reasoning in Multimodal Diffusion Latents
Apr 28, 2026Yuwei Sun, Yuxuan Yao, Hui Li +1Text-To-Image Diffusion Models Discrete Diffusion Model
Agentic clinical reasoning over longitudinal myeloma records: a retrospective evaluation against expert consensus
Apr 27, 2026Johannes Moll, Jannik Lübberstedt, Christoph Nuernbergk +21Clinical Reasoning Longitudinal Patient Records
Move-Then-Operate: Behavioral Phasing for Human-Like Robotic Manipulation
Apr 26, 2026Haoming Xu, Lei Lei, Jie Gu +3Generalizable Robotic Manipulations Manipulation
Scaling Multi-Node Mixture-of-Experts Inference Using Expert Activation Patterns
Apr 25, 2026Abhimanyu Bambhaniya, Geonhwa Jeong, Jason Park +6Mixture-Of-Expert Inference Mixture-of-Experts Models
Mixture of Heterogeneous Grouped Experts for Language Modeling
Apr 25, 2026Zhicheng Ma, Xiang Liu, Zhaoxiang Liu +5Mixture-of-Experts Models Inference Cost
Preserving Long-Tailed Expert Information in Mixture-of-Experts Tuning
Apr 24, 2026Haoze He, Xingyuan Ding, Xuan Jiang +5Mixture-of-Experts Models Experts
Towards Adaptive Continual Model Merging via Manifold-Aware Expert Evolution
Apr 24, 2026Haiyun Qiu, Xingyu Wu, Kay Chen TanMixture-of-Experts Models Continual Model Merging
Separable Expert Architecture: Toward Privacy-Preserving LLM Personalization via Composable Adapters and Deletable User Proxies
Apr 23, 2026Chris Schneider, Philipp Schoenegger, Ben BariachPersonalization Low-Rank Adaptation Adapters
MISTY: High-Throughput Motion Planning via Mixer-based Single-step Drifting
Apr 23, 2026Yining Xing, Zehong Ke, Yiqian Tu +3Diffusion Planning Motion Planners
Rethinking Cross-Domain Evaluation for Face Forgery Detection with Semantic Fine-grained Alignment and Mixture-of-Experts
Apr 23, 2026Yuhan Luo, Tao Chen, Decheng LiuFace Forgery Detection Cross-Dataset Benchmark
Teacher-Guided Routing for Sparse Vision Mixture-of-Experts
Apr 23, 2026Masahiro Kada, Ryota Yoshihashi, Satoshi Ikehata +2Mixture-of-Experts Models Training-Free Inference Framework
Enhancing Online Recruitment with Category-Aware MoE and LLM-based Data Augmentation
Apr 23, 2026Minping Chen, Bing Xu, Zulong Chen +4Reranking Low-Quality Data
On Bayesian Softmax-Gated Mixture-of-Experts Models
Apr 22, 2026Nicola Bariletto, Huy Nguyen, Nhat Ho +1Mixture Models Bayesian
Temporally Extended Mixture-of-Experts Models
Apr 22, 2026Zeyu Shen, Peter HendersonMixture-of-Experts Models Training-Free Inference Framework
Quadruped Parkour Learning: Sparsely Gated Mixture of Experts with Visual Input
Apr 21, 2026Michael Ziegltrum, Jianhao Jiao, Tianhu Peng +2Parkour Locomotion Mixture-of-Experts Models
Expert Upcycling: Shifting the Compute-Efficient Frontier of Mixture-of-Experts
Apr 21, 2026Chaitanya Dwivedi, Binxuan Huang, Himanshu Gupta +3Mixture-of-Experts Models Experts
Product-of-Experts Training Reduces Dataset Artifacts in Natural Language Inference
Apr 21, 2026Aby Mammen MathewNatural Language Inference Experts
Multi-Domain Learning with Global Expert Mapping
Apr 20, 2026Pourya Shamsolmoali, Masoumeh Zareapoor, Huiyu Zhou +3Mixture-of-Experts Models Multi-Domain
Efficient Mixture-of-Experts LLM Inference with Apple Silicon NPUs
Apr 20, 2026Afsara Benazir, Felix Xiaozhu LinNeural Processing Units Mixture-Of-Expert Inference
Train Separately, Merge Together: Modular Post-Training with Mixture-of-Experts
Apr 20, 2026Jacob Morrison, Sanjay Adhikesaven, Akshita Bhagia +3Mixture-Of-Expert Language Models Mixture-of-Experts Models
Polysemantic Experts, Monosemantic Paths: Routing as Control in MoEs
Apr 20, 2026Charles Ye, Bo Yuan, Lee SharkeyMixture-Of-Expert Language Models Mixture-of-Experts Models
MACS: Modality-Aware Capacity Scaling for Efficient Multimodal MoE Inference
Apr 19, 2026Bo Li, Chuan Wu, Shaolin ZhuMixture-Of-Expert Inference Multimodal Benchmarks
DREAM: Dynamic Retinal Enhancement with Adaptive Multi-modal Fusion for Expert Precision Medical Report Generation
Apr 19, 2026Nagur Shareef Shaik, Teja Krishna Cherukuri, Dong Hye YeRetinal Imaging Medical Report Generation
Layer-wise MoE Routing Locality under Shared-Prefix Code Generation: Token-Identity Decomposition and Compile-Equivalent Fork Redundancy
Apr 19, 2026Shun-ichiro Hayashi, Daichi Mukunoki, Tetsuya Hoshino +1Mixture-Of-Expert Language Models Code Generation
IMA-MoE: An Interpretable Modality-Aware Mixture-of-Experts Framework for Characterizing the Neurobiological Signatures of Binge Eating Disorder
Apr 18, 2026Lin Zhao, Qiaohui Gao, Elizabeth Martin +5Neurophysiological Correlates Mixture-of-Experts Models
CoGR-MoE: Concept-Guided Expert Routing with Consistent Selection and Flexible Reasoning for Visual Question Answering
Apr 18, 2026Xiyin Zeng, Yi Lu, Hao WangKnowledge-Based Visual Question Answering Experts

May 7, 2026 · cs.LGJ/K move · Enter open · S save

E = T*H/(O+B): A Dimensionless Control Parameter for Mixture-of-Experts Ecology

Qingjun Zhang

School of Integrated Circuits, Wuxi Taihu University Department of Communication Engineering · Department of Communication Engineering

We introduce E = T*H/(O+B), a dimensionless control parameter that predicts whether Mixture-of-Experts (MoE) models will develop a healthy expert ecology or collapse into dead experts. E combines four hyperparameters -- routing temperature T, routing entropy weight H, oracle weight O, and balance weight B -- into a single quantity. Through 12 controlled experiments (8 vision, 4 language) totaling over 11,000 training epochs, we establish that E >= 0.5 alone is sufficient to guarantee zero dead experts, removing the necessity for handcrafted load-balancing auxiliary losses. We validate this cross-modally on CIFAR-10, CIFAR-100, TinyImageNet-200, WikiText-2, and WikiText-103. Six additional findings emerge: (1) dead experts can resuscitate -- triggered by balance loss driving router re-exploration; (2) ortho toxicity is dataset-dependent, not universal; (3) task complexity shifts the critical E threshold; (4) model overfitting is decoupled from expert ecological health; (5) three-tier MoE spontaneously collapses into a two-tier functional structure; (6) ecological structure is temperature-invariant across a 50x range. We propose that E serves as a unified diagnostic for MoE training, analogous to the Reynolds number in fluid dynamics.

Mixture-of-Experts Models Exponents Ecosystems Weighted

Open paper Ask about it PDF