Mixture-of-Experts Models

Ask about this topic

Recent momentum

-34%

43 papers in the last 28 days · 0.7% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Also in Mixture-Of-Experts

Neighbouring directions

ExpertsMixture-Of-Expert Language ModelsMixture-Of-Expert InferenceExpert DemonstrationsLoad Balancing

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

14 new papers

A weekly snapshot of new work published in Mixture-of-Experts Models.

Period ending 2026-09-14

2 new papers

A weekly snapshot of new work published in Mixture-of-Experts Models.

Period ending 2026-09-07

12 new papers

A weekly snapshot of new work published in Mixture-of-Experts Models.

419 papers

Latest in Mixture-of-Experts Models

Browse all topics →
CardsList

  1. Toward Structural Multimodal Representations: Specialization, Selection, and Sparsification via Mixture-of-Experts

    May 5, 2026Hahyeon Choi, Nojun KwakMulti-Modal Representation LearningMixture-of-Experts Models

  2. M\textsuperscript{4}Fuse: Lightweight State-Space MoE with a Cross-Scale Gating Bridge for Brain Tumor Segmentation

    May 4, 2026Meihua Zhou, Xinyu Tong, Li YangBrain Tumor SegmentationMixture-of-Experts Models

  3. MoE-Prefill: Zero Redundancy Overheads in MoE Prefill Serving

    May 3, 2026Zhaoyuan Su, Olatunji Ruwase, Karthik Ganesan +5Mixture-Of-Expert InferencePrefill

  4. Affinity Is Not Enough: Recovering the Free Energy Principle in Mixture-of-Experts

    May 1, 2026Man Yung WongMixture-of-Experts ModelsFree Energy Principle

  5. RouteHijack: Routing-Aware Attack on Mixture-of-Experts LLMs

    May 1, 2026Zhiyuan Xu, Joseph Gardiner, Sana Belguith +1HijackingMixture-of-Experts Models

  6. SpaceMoE: Realizing Distributed Mixture-of-Experts Inference over Space Networks

    May 1, 2026Zhanwei Wang, Huiling Yang, Min Sheng +2Mixture-Of-Expert InferenceMixture-of-Experts Models

  7. Making Every Verified Token Count: Adaptive Verification for MoE Speculative Decoding

    May 1, 2026Lehan Pan, Ziyang Tao, Ruoyu Pang +3Speculative DecodingAutoregressive Decoding

  8. Rethinking Network Topologies for Cost-Effective Mixture-of-Experts LLM Serving

    Apr 30, 2026Junsun Choi, Sam Son, Sunjin Choi +5Mixture-Of-Expert Language ModelsMixture-of-Experts Models

  9. FaaSMoE: A Serverless Framework for Multi-Tenant Mixture-of-Experts Serving

    Apr 29, 2026Minghe Wang, Trever Schirmer, Mohammadreza Malekabbasi +1Mixture-of-Experts ModelsKubernetes

  10. Adaptive and Fine-grained Module-wise Expert Pruning for Efficient LoRA-MoE Fine-Tuning

    Apr 29, 2026Weihang Li, Jianchun Liu, Hongli XuMixture-of-Experts ModelsParameter-Efficient Fine-Tuning

  11. RaMP: Runtime-Aware Megakernel Polymorphism for Mixture-of-Experts

    Apr 28, 2026Vyom Sharma, Debajyoti DattaMixture-Of-Expert InferenceMixture-of-Experts Models

  12. Marco-MoE: Open Multilingual Mixture-of-Expert Language Models with Efficient Upcycling

    Apr 28, 2026Fan Jiang, Yu Zhao, Chenyang Lyu +5Mixture-Of-Expert Language ModelsMixture-of-Experts Models

  13. The Thinking Pixel: Recursive Sparse Reasoning in Multimodal Diffusion Latents

    Apr 28, 2026Yuwei Sun, Yuxuan Yao, Hui Li +1Text-To-Image Diffusion ModelsDiscrete Diffusion Model

  14. Move-Then-Operate: Behavioral Phasing for Human-Like Robotic Manipulation

    Apr 26, 2026Haoming Xu, Lei Lei, Jie Gu +3Generalizable Robotic ManipulationsManipulation

  15. Scaling Multi-Node Mixture-of-Experts Inference Using Expert Activation Patterns

    Apr 25, 2026Abhimanyu Bambhaniya, Geonhwa Jeong, Jason Park +6Mixture-Of-Expert InferenceMixture-of-Experts Models

  16. Mixture of Heterogeneous Grouped Experts for Language Modeling

    Apr 25, 2026Zhicheng Ma, Xiang Liu, Zhaoxiang Liu +5Mixture-of-Experts ModelsInference Cost

  17. Preserving Long-Tailed Expert Information in Mixture-of-Experts Tuning

    Apr 24, 2026Haoze He, Xingyuan Ding, Xuan Jiang +5Mixture-of-Experts ModelsExperts

  18. Towards Adaptive Continual Model Merging via Manifold-Aware Expert Evolution

    Apr 24, 2026Haiyun Qiu, Xingyu Wu, Kay Chen TanMixture-of-Experts ModelsContinual Model Merging

  19. Separable Expert Architecture: Toward Privacy-Preserving LLM Personalization via Composable Adapters and Deletable User Proxies

    Apr 23, 2026Chris Schneider, Philipp Schoenegger, Ben BariachPersonalizationLow-Rank Adaptation Adapters

  20. Rethinking Cross-Domain Evaluation for Face Forgery Detection with Semantic Fine-grained Alignment and Mixture-of-Experts

    Apr 23, 2026Yuhan Luo, Tao Chen, Decheng LiuFace Forgery DetectionCross-Dataset Benchmark

  21. Teacher-Guided Routing for Sparse Vision Mixture-of-Experts

    Apr 23, 2026Masahiro Kada, Ryota Yoshihashi, Satoshi Ikehata +2Mixture-of-Experts ModelsTraining-Free Inference Framework

  22. Enhancing Online Recruitment with Category-Aware MoE and LLM-based Data Augmentation

    Apr 23, 2026Minping Chen, Bing Xu, Zulong Chen +4RerankingLow-Quality Data

  23. On Bayesian Softmax-Gated Mixture-of-Experts Models

    Apr 22, 2026Nicola Bariletto, Huy Nguyen, Nhat Ho +1Mixture ModelsBayesian

  24. Temporally Extended Mixture-of-Experts Models

    Apr 22, 2026Zeyu Shen, Peter HendersonMixture-of-Experts ModelsTraining-Free Inference Framework

  25. Quadruped Parkour Learning: Sparsely Gated Mixture of Experts with Visual Input

    Apr 21, 2026Michael Ziegltrum, Jianhao Jiao, Tianhu Peng +2Parkour LocomotionMixture-of-Experts Models

  26. Expert Upcycling: Shifting the Compute-Efficient Frontier of Mixture-of-Experts

    Apr 21, 2026Chaitanya Dwivedi, Binxuan Huang, Himanshu Gupta +3Mixture-of-Experts ModelsExperts

  27. Multi-Domain Learning with Global Expert Mapping

    Apr 20, 2026Pourya Shamsolmoali, Masoumeh Zareapoor, Huiyu Zhou +3Mixture-of-Experts ModelsMulti-Domain

  28. Efficient Mixture-of-Experts LLM Inference with Apple Silicon NPUs

    Apr 20, 2026Afsara Benazir, Felix Xiaozhu LinNeural Processing UnitsMixture-Of-Expert Inference

  29. Train Separately, Merge Together: Modular Post-Training with Mixture-of-Experts

    Apr 20, 2026Jacob Morrison, Sanjay Adhikesaven, Akshita Bhagia +3Mixture-Of-Expert Language ModelsMixture-of-Experts Models

  30. Polysemantic Experts, Monosemantic Paths: Routing as Control in MoEs

    Apr 20, 2026Charles Ye, Bo Yuan, Lee SharkeyMixture-Of-Expert Language ModelsMixture-of-Experts Models

  31. IMA-MoE: An Interpretable Modality-Aware Mixture-of-Experts Framework for Characterizing the Neurobiological Signatures of Binge Eating Disorder

    Apr 18, 2026Lin Zhao, Qiaohui Gao, Elizabeth Martin +5Neurophysiological CorrelatesMixture-of-Experts Models

  32. Application of a Mixture of Experts-based Foundation Model to the GlueX DIRC Detector

    Apr 17, 2026Cristiano Fanelli, James Giroux, Cole Granger +1Wireless Foundation ModelsMixture-of-Experts Models

  33. FineSteer: A Unified Framework for Fine-Grained Inference-Time Steering in Large Language Models

    Apr 16, 2026Zixuan Weng, Jinghuai Zhang, Kunlin Cai +3Inference-Time ControlMixture-of-Experts Models

  34. Pangu-ACE: Adaptive Cascaded Experts for Educational Response Generation on EduBench

    Apr 16, 2026Dinghao Li, Wenlong Zhou, Zhimin Chen +5TutorsMulti-Hop Question Answering Benchmarks

  35. ELMoE-3D: Leveraging Intrinsic Elasticity of MoE for Hybrid-Bonding-Enabled Self-Speculative Decoding in On-Premises Serving

    Apr 16, 2026Yuseon Choi, Jingu Lee, Jungjun Oh +5Mixture-of-Experts ModelsSpeculative Decoding

  36. Geometric Metrics for MoE Specialization: From Fisher Information to Early Failure Detection

    Apr 16, 2026Dongxin Guo, Jikun Wu, Siu Ming YiuMixture-of-Experts ModelsFisher Information

  37. Symbiotic-MoE: Unlocking the Synergy between Generation and Understanding

    Apr 9, 2026Xiangyue Liu, Zijian Zhang, Miles Yang +3Cross-Modal LearningMixture-of-Experts Models

  38. Unveiling Language Routing Isolation in Multilingual MoE Models for Interpretable Subnetwork Adaptation

    Apr 4, 2026Kening Zheng, Wei-Chieh Huang, Jiahao Huo +9Mixture-of-Experts ModelsMultilingual Language Models

  39. Council Mode: A Heterogeneous Multi-Agent Consensus Framework for Reducing LLM Hallucination and Bias

    Apr 3, 2026Shuai Wu, Xue Li, Yanna Feng +3Large Language Model HallucinationMixture-of-Experts Models

  40. StanceMoE: Mixture-of-Experts Architecture for Stance Detection

    Apr 1, 2026Abdullah Al Shafi, Md. Milon Islam, Sk. Imran Hossain +1Tweet-Level Stance DetectionSentence-Level Classification

  41. Self-Routing: Parameter-Free Expert Routing from Hidden States

    Apr 1, 2026Jama Hussein Mohamud, Drew Wagner, Mirco RavanelliMixture-of-Experts ModelsExpert Routing

  42. ExFusion: Efficient Transformer Training via Multi-Experts Fusion

    Mar 30, 2026Jiacheng Ruan, Daize Dong, Xiaoye Qu +5Mixture-of-Experts ModelsTransformer Architectures

  43. A Replicate-and-Quantize Strategy for Plug-and-Play Load Balancing of Sparse Mixture-of-Experts LLMs

    Feb 23, 2026Zijie Liu, Jie Peng, Jinhao Duan +7Load BalancingMixture-Of-Expert Inference

  44. OmniMoE: An Efficient MoE by Orchestrating Atomic Experts at Scale

    Feb 5, 2026Jingze Shi, Zhangyang Peng, Yizhang Zhu +3Mixture-Of-Expert InferenceMixture-of-Experts Models

  45. TRACE: Trajectory Recovery for Continuous Mechanism Evolution in Causal Representation Learning

    Jan 29, 2026Shicheng Fan, Kun Zhang, Lu ChengCausal Representation LearningInteraction Trajectories

  46. Conditional Memory via Scalable Lookup: A New Axis of Sparsity for Large Language Models

    Jan 12, 2026Xin Cheng, Rui Tian, Wangding Zeng +18Sparse Expert ActivationMixture-of-Experts Models

  47. DR-LoRA: Dynamic Rank LoRA for Fine-Tuning Mixture-of-Experts Models

    Jan 8, 2026Guanzhi Deng, Bo Li, Ronghao Chen +5Gradient-Free Rank AllocatorMixture-of-Experts Models

  48. HiMoE-VLA: Hierarchical Mixture-of-Experts for Generalist Vision-Language-Action Policies

    Dec 5, 2025Zhiying Du, Bei Liu, Yaobo Liang +7Mixture-of-Experts ModelsIterative Co-Training

  49. Mixtures of SubExperts for Large Language Continual Learning

    Nov 9, 2025Haeyong Kang, Hee Suk Yoon, Dahua Feng +1Mixture-Of-Expert Language ModelsEfficient Continual Learning

  50. PuzzleMoE: Efficient Compression of Large Mixture-of-Experts Models via Sparse Expert Merging and Bit-packed inference

    Nov 6, 2025Yushu Zhao, Zheng Wang, Minjia ZhangMixture-Of-Expert InferenceMixture-of-Experts Models

  51. Variational Mixture of Graph Neural Experts for Alzheimer's Disease Recognition across Frequency Bands in EEG Brain Networks

    Oct 13, 2025Jun-En Ding, Anna Zilverstand, Shihao Yang +2AlzheimerHuman Brain Networks

  52. MM-Nav: Multi-View VLA Model for Robust Visual Navigation via Multi-Expert Learning

    Oct 3, 2025Tianyu Xu, Jiawei Chen, Jiazhao Zhang +5Vision-Language NavigationObject Goal Navigation

  53. SHMoAReg: Spark Deformable Image Registration via Spatial Heterogeneous Mixture of Experts and Attention Heads

    Sep 24, 2025Yuxi Zheng, Jianhui Feng, Tianran Li +2Image RegistrationPopular Deformable Convolutions

  54. MEGO: Learning Mixture-of-Experts for General-Purpose Binary Optimization

    May 29, 2024Shengcai Liu, Zhiyuan Wang, Yew-Soon Ong +2Black-Box OptimizationCombinatorial Optimization

  55. Regularized Estimation and Feature Selection in Mixtures of Generalized Linear Experts

    Jul 14, 2019Thin Nguyen-Van, Faicel Chamroukhi, Ha Hoang Van +1Mixture-of-Experts ModelsLasso

  56. FluxMoE: Decoupling Expert Residency for High-Performance MoE Serving

    Date pendingQingxiu Liu, Yongchao He, Runhan Jiang +4Mixture-Of-Expert InferenceMixture-of-Experts Models

  57. Multi-Modal Time Series Prediction via Mixture of Modulated Experts

    Date pendingLige Zhang, Ali Maatouk, Jialin Chen +3Time SeriesMixture-of-Experts Models

  58. SMELT: Scaling Laws for Compute-Matched MoE Looped Transformers

    Date pendingShaowen Wang, Ge Zhang, Kairong Luo +6Transformer LayersTransformer Architectures

  59. Cache-Aware Joint Router Adaptation for Memory-Efficient MoE Inference

    Date pendingZhenhe Wu, Yaping Jin, Qinghua Xing +6Mixture-Of-Expert InferenceMixture-of-Experts Models