Mixture-of-Experts Models

Ask about this topic

Recent momentum

-61%

29 papers in the last 28 days · 0.7% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Also in Mixture-Of-Experts

Neighbouring directions

ExpertsMixture-Of-Expert Language ModelsMixture-Of-Expert InferenceExpert DemonstrationsLoad Balancing

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

14 new papers

A weekly snapshot of new work published in Mixture-of-Experts Models.

Period ending 2026-09-14

2 new papers

A weekly snapshot of new work published in Mixture-of-Experts Models.

Period ending 2026-09-07

12 new papers

A weekly snapshot of new work published in Mixture-of-Experts Models.

419 papers

Latest in Mixture-of-Experts Models

Open your feed →
CardsList

  1. OceanMoE: Structured Conditional Sparse Computation for Long-Horizon Multivariate Ocean Forecasting

    Sep 17, 2026Yishun Zhu, Jian WangSpatio-Temporal ForecastingOcean

  2. Higher-order pruning of experts in mixture-of-experts language models

    Sep 16, 2026Alex M. Tseng, Prannay Kaul, Luca Zancato +2Mixture-Of-Expert Language ModelsMixture-of-Experts Models

  3. Infinite-Parameter LLMs: Generating and Adapting Weights from Live Data

    Sep 16, 2026Jinli Hu, Ross M. Clarke, Yichuan Zhang +1Model WeightsIn-Context Learning

  4. Generalist-Specialist Mixture-of-Experts for Rare Pathology Detection in Multimodal Imaging

    Sep 16, 2026Johannes Kaiser, Florian Braunmiller, Daniel Rückert +1Medical ImagingMultimodal Clinical Data

  5. Divide and Conquer: Mixture-of-Bottleneck Experts in Informative Ordinal Space for Video-based Multimodal Sentiment Analysis

    Sep 16, 2026Ronghao Lin, Qiaolin He, Zefeng Lu +5Multimodal Deep LearningSentiment Analysis

  6. MoRE: Mixture of Reused Experts

    Sep 16, 2026Eric S. Qiu, Utku Umur Acikalin, Justin Lovelace +4Mixture-of-Experts ModelsExperts

  7. Colla-Q: Toward Collaborative Experts in MoE Quantization via Minimax Precision Balancing

    Sep 16, 2026Eunju Shin, Jongbin RyuMixed-Precision QuantizationQuantization

  8. The Other Half of the Memory Wall: Serving 35B MoEs from SSD with Trained Routing Prediction

    Sep 16, 2026Yu Lin, Yiming Wang, Runyuan Cai +2Mixture-Of-Expert InferenceMixture-of-Experts Models

  9. Beyond the Previous Layer: Residual Predictive Structure in Sparse MoE Routing

    Sep 15, 2026Hao Li, Yasuyuki Tahara, Yuichi SeiMixture-of-Experts Models

  10. Unifying Semantic Priors and High-Frequency Traces: Enhancing V-JEPA with Mixture-of-Experts for Robust Synthetic Image Forensics

    Sep 15, 2026Simone Teglia, Irene AmeriniExplainable Deepfake DetectionDeepfake Detection

  11. Horizon-specific Expert Fusion for Photovoltaic Power Forecasting

    Sep 14, 2026Xu Yuqing, Zhou Liguo, Sun Ze +2Energy ForecastingSolar

  12. Expert-Space Exploration in MoE Reinforcement Learning

    Sep 14, 2026Hongyi He, Zhenghao Lin, Xiao Liu +3Mixture-of-Experts ModelsRollout

  13. ExpertHTR: Unified Handwritten Text Recognition with Multi-Task Learning and Sparse Mixture-of-Experts

    Sep 14, 2026Dang Hoai Nam, Nguyen Duy Hieu, Quang Huu Hieu +1Handwritten Text RecognitionMixture-of-Experts Models

  14. SeqMoE: Toward Full-Load Performance via Predictive and Graph-Compatible MoE Offloading

    Sep 14, 2026Zihan Wang, Yuqi Wang, Lei Gong +5Mixture-Of-Expert InferenceOffloading

  15. M3-Former: Multimodal Transformer with Mixture-of-Experts for Long-Term Vessel Trajectory Prediction

    Sep 11, 2026Wenzhe Jin, Haina TangTrajectory PredictionMultimodal Transformers

  16. Data Scarcity and Model Sparsity: Mixtures-of-Experts Overfit More to Repeated Data

    Sep 10, 2026Atindra Jha, Margaret Li, Jure Leskovec +2Mixture-of-Experts ModelsOverfitting

  17. Distribution-Consistent Inference for Dynamic Sparse Mixture-of-Experts

    Sep 10, 2026Dohyeon Kim, Bedionita Soro, Sung Ju HwangMixture-Of-Expert InferenceMixture-of-Experts Models

  18. How Fragile Is Safety Alignment at Frontier Scale? A Single-Direction Attack on a 320B MoE

    Sep 9, 2026Yi Shi, Tanyu Chen, Kai ShenLarge Language Model AlignmentSafety Alignment

  19. Good Pretraining, Bad SFT: Checkpoint Quality Across the Training Stack

    Sep 8, 2026Sohir Maskey, Philipp Scholl, Jonas Knupp +2Model PretrainingDownstream Fine-Tuning

  20. Chimaera: A Mixture-of-Graph-Experts Architecture for Cross-Task and Cross-Dataset Graph Learning

    Sep 8, 2026Jonathan Frank, David Richerby, Ansgar ScherpGraph Foundation ModelText-Attributed Graph

  21. Hyperparameter Scaling Laws Across MoE Sparsity

    Sep 8, 2026Changxin Tian, Kunlong Chen, Jia Liu +3Hyperparameter OptimizationMixture-of-Experts Models

  22. MoEMB: Scaling Universal Multimodal Embeddings with Efficient Mixture-of-Experts Models

    Sep 8, 2026Xuanming Cui, Shlok Kumar Mishra, Wentao Bao +6Multimodal EmbeddingsMixture-of-Experts Models

  23. Router Prior Bias: Preserving Base Routing Structure in MoE Post-Training

    Sep 8, 2026Jaedeok Lee, Keonwoo Kim, Dongyoon Han +3Mixture-of-Experts ModelsLLM Post-Training Methods

  24. MI-PEFT: Mixture-of-Experts Integrated Parameter-Efficient Fine-Tuning Protein Language Models Improves Acidophilic Proteins Classification

    Sep 7, 2026Honghan ShenMixture-of-Experts Models

  25. Latent-MoE: Domain-Aware Mixture-of-Experts for PDEs with Multi-Regime Physics

    Sep 7, 2026Hanwen Wang, Paris PerdikarisConventional Physics-Informed Neural NetworksPartial Differential Equations

  26. Distance-Aware Attention and Wall-Distance Expert Routing for Transformer-Based 3D Flow Prediction

    Sep 7, 2026Sanghyeon Kim, Sunwoong Yang, Namwoo KangOptical FlowMixture-of-Experts Models

  27. MEOX: Compact Multimodal Mixture-of-Experts for Earth Observation

    Sep 4, 2026Mohanad AlbughdadiCloud-Aware Earth Observation SequencesEarth Observation

  28. Towards a Statistical Understanding of Mixture-of-Experts

    Sep 3, 2026Siyuan He, Bokai Yang, Jie Hu +2Mixture-of-Experts ModelsAdaptive Routing

  29. PersuaRL: Reinforcement Learning-Driven Multi-Expert Selection for Persuasive Dialogue Generation in Insurance

    Sep 1, 2026Rohan Kirti, Akash Ghosh, Aryan Vats +5PersuasionInsurance

  30. Beyond Magnitude: Contrastive Routing for Modular Mixture-of-Experts

    Sep 1, 2026Nikolaos Xiros, Dimitrios Damianos, Maria-Eleni Zoumpoulidi +3Mixture-of-Experts ModelsAdaptive Routing

  31. PCoMoE: Shifting MoE Inference from Monolithic Expert Selection to Fine-Grained Path Composition

    Sep 1, 2026Ziyan Gan, Fangxin Liu, Chenyang Guan +10Mixture-Of-Expert InferenceMixture-of-Experts Models

  32. Candidate-Expanding Routing with Permutation-Stabilized Experts for Mixed-Format Medical VQA

    Sep 1, 2026Hai-Dang Nguyen, Huy-Hieu PhamMedical Visual Question AnsweringMixture-of-Experts Models

  33. Instella-MoE Technical Report

    Sep 1, 2026Jiang Liu, Sudhanshu Ranjan, Prakamya Mishra +10Mixture-Of-Expert Language ModelsLarge Models

  34. DynaNDE: Dynamic Near-Data Expert Scheduling for Batched MoE Inference

    Aug 31, 2026Xiaoyang Lu, Belthangady Akash Vi Narayana Pai, Xian-He SunMixture-Of-Expert InferenceNeural Processing Units

  35. WiSDoM: Wireless Sparse Decision Transformer with Mixture-of-Experts for Multi-Task Mobile Network Optimization

    Aug 31, 2026Fatih Temiz, Shavbo Salehi, Melike Erol-KantarciOpen Radio Access NetworksMulti-Task Reinforcement Learning

  36. Multimodal Adaptive Expert Selection with Text Routing and Ordinal Prototype Optimization for Sentiment Analysis

    Aug 31, 2026Xiaode Chen, Jiakang Yu, Hongtao Deng +3Sentiment AnalysisMultimodal Learning

  37. TuringLLM: Efficiently Scaling Foundation Models Toward Physical AI

    Aug 31, 2026Yuheng Zhang, Yizhao Wang, Da Zhu +19Mixture-of-Experts ModelsCounter Turing Test

  38. Q-Strata: Hierarchical Bit Allocation for Mixed-Precision Quantization of Mixture-of-Experts LLMs

    Aug 31, 2026Deokjae Lee, Sihun Chu, Hyun Oh SongMixed-Precision QuantizationMixture-Of-Expert Language Models

  39. PRIME: Mitigating Subgroup Optimization Competition in Shared CTR Top Networks with Plug-in Residual Input-Conditioned Mixture of Expert

    Aug 31, 2026Heng Yao, Siyun Hou, Tianying Liu +8Mixture-of-Experts ModelsClick-Through Rate Prediction

  40. A.X K2 Technical Report

    Aug 31, 2026Cheolseung Baek, Dhammiko Arya, Eunki Kim +40Mixture-Of-Expert Language ModelsMixture-of-Experts Models

  41. Evolutionary Soups: Evolving Mixture-of-Experts for Multi-Objective LLM Alignment

    Aug 30, 2026Lingxiao Kong, Steffen Staab, Cong Yang +2Evolutionary SearchLarge Language Model Alignment

  42. Structure Aware Neural Architecture Search for Mixture of Experts

    Aug 30, 2026Petr Babkin, Oleg BakhteevNeural Architecture SearchMixture-of-Experts Models

  43. HiVe: Beyond Static Prompts for Multitask Learning via Hierarchy-based Vertical Mixture-of-Experts

    Aug 30, 2026Hyeonjik Bae, Minyeol Kim, Susik YoonPrompt TuningParameter-Efficient Fine-Tuning

  44. DCA-MoE: Spatially Adaptive Cross-Layer Fusion and Density-Routed Experts for Crowd Counting

    Aug 15, 2026Hao WangMixture-of-Experts ModelsFusion

  45. Fine-Grained Action Recognition with Cross-Attentive Latent Sparse Experts

    Aug 13, 2026Imtiaz Ul Hassan, Tasweer Ahmad, Nik Bessis +1Open-Vocabulary Action RecognitionFine-Grained Perception

  46. Regime-Gated Residual Mixture-of-Experts for Cross-Sectional Volatility Forecasting

    Aug 12, 2026Junyi Ye, Gargi Vijay BordeStochastic VolatilityHeteroskedasticity

  47. RoutePack: Expert Placement and Attention-Aware Data Packing for MoE Reinforcement Learning

    Aug 12, 2026Yibo Shen, Xudong Han, Xiaowei Zhu +2Mixture-of-Experts ModelsExpert Demonstrations

  48. APEX: Adaptive Expert Prefetching for Memory-Efficient Edge MoE Inference

    Aug 12, 2026Alish Kanani, Layan Badawi, Umit Y. OgrasMixture-Of-Expert InferenceMixture-of-Experts Models

  49. FM-LLM: A frequency-enhanced mixture-of-experts framework for adapting LLMs to time series forecasting

    Aug 12, 2026Rentao Gu, Yihang Ding, Junjie Li +5Frequency-Aware Structural AggregationLarge Language Models(Llms

  50. CLEAR: Class-wise Expert Aggregation with Structured Sampling for Long-Tailed Classification

    Aug 11, 2026Gawon LimExtreme Class ImbalanceEnsemble

  51. Can Bayesian Optimization Efficiently Find a Strong Single Expert in Neural Thickets?

    Aug 11, 2026Nigel Bastian Cendra, Abdelhamid Ezzerg, Fernando Julio Cendra +2Gradient-Based OptimizationBayesian Optimization

  52. MoE Proxy Models for Low-Cost Failure Reproduction and Diagnosis in LLM RL Post-Training

    Aug 11, 2026Yikai Wang, Chuansai Zhou, Yuhang Zhou +10Reinforcement Learning Post-TrainingRobot Failures

  53. Compute-Optimal Is Not Cluster-Optimal: Systems-Aware Scaling for Sparse Mixture-of-Experts

    Aug 11, 2026Soumajyoti Sarkar, Yuxin Tang, Sheng ZhaMixture-of-Experts ModelsLarge Models

  54. MammoMix: Leveraging Mixture of Experts for Robust Mammogram Breast Detection

    Aug 11, 2026Dinh Tan Nguyen, Hoang Quan Dang, Chen Zhang +1MammographyMixture-of-Experts Models

  55. Share First, Route What Remains: A Unified Framework for Token-Adaptive MoE Computation

    Aug 11, 2026Gongli Zhang, Zhulin Liu, C. L. Philip ChenMixture-of-Experts ModelsUnified Framework

  56. DistMoE: Private-data Rehearsal-free Routing in Mixture-of-Experts for Distributed Instruction Tuning

    Aug 10, 2026Mainak Singha, Niccolò Biondi, Elisa Ricci +1Multimodal Instruction TuningMixture-of-Experts Models

  57. Disentangling Co-Occurring Retinal Pathologies with Saliency-Guided Sparse Expert Routing

    Aug 10, 2026Nagur Shareef Shaik, Jeongwoo Park, Yeong-Jin Kim +3Interpretable Diabetic Retinopathy GradingFundus Images

  58. SonicWeave: Chunk-Routed Mixture-of-Experts for Unified Audio Scene Generation

    Aug 10, 2026Yunrui Cai, Xu Li, Yucheng Zhou +8Music EditingAudio

  59. MixFormer: Linear Transformer with Mixture of Memory Experts

    Aug 10, 2026Yu Guo, Lei DuanEfficient Long-Context InferenceSequence Modeling

  60. Signature-Guided Capacity Occupancy for Dense Expert Merging

    Aug 10, 2026Lingching Tung, Chi-Jui Kim, Beicheng Xu +2Model MergingMixture-of-Experts Models