Mixture-Of-Experts

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

21 new papers

A weekly snapshot of new work published in Mixture-Of-Experts.

Period ending 2026-09-14

8 new papers

A weekly snapshot of new work published in Mixture-Of-Experts.

Period ending 2026-09-07

23 new papers

A weekly snapshot of new work published in Mixture-Of-Experts.

Inside this field

Focused directions

584 papers

Latest in Mixture-Of-Experts

Browse all topics →
CardsList

  1. Exact Quantile Balancing and Load-Error Injection for Mixture-of-Experts

    Sep 23, 2026Pit Neitemeier, Jiaze Li, Alessio Serra +2Load BalancingBalanced Learning

  2. Edustories: A Collection of Real-world Case Studies from Classroom Practices

    Sep 17, 2026Michal Štefánik, Jan Nehyba, Jirina Karasova +4ClassroomsCase Study

  3. OceanMoE: Structured Conditional Sparse Computation for Long-Horizon Multivariate Ocean Forecasting

    Sep 17, 2026Yishun Zhu, Jian WangSpatio-Temporal ForecastingOcean

  4. Higher-order pruning of experts in mixture-of-experts language models

    Sep 16, 2026Alex M. Tseng, Prannay Kaul, Luca Zancato +2Mixture-Of-Expert Language ModelsMixture-of-Experts Models

  5. Infinite-Parameter LLMs: Generating and Adapting Weights from Live Data

    Sep 16, 2026Jinli Hu, Ross M. Clarke, Yichuan Zhang +1Model WeightsIn-Context Learning

  6. Generalist-Specialist Mixture-of-Experts for Rare Pathology Detection in Multimodal Imaging

    Sep 16, 2026Johannes Kaiser, Florian Braunmiller, Daniel Rückert +1Medical ImagingMultimodal Clinical Data

  7. Divide and Conquer: Mixture-of-Bottleneck Experts in Informative Ordinal Space for Video-based Multimodal Sentiment Analysis

    Sep 16, 2026Ronghao Lin, Qiaolin He, Zefeng Lu +5Multimodal Deep LearningSentiment Analysis

  8. MoRE: Mixture of Reused Experts

    Sep 16, 2026Eric S. Qiu, Utku Umur Acikalin, Justin Lovelace +4Mixture-of-Experts ModelsExperts

  9. Colla-Q: Toward Collaborative Experts in MoE Quantization via Minimax Precision Balancing

    Sep 16, 2026Eunju Shin, Jongbin RyuMixed-Precision QuantizationQuantization

  10. The Other Half of the Memory Wall: Serving 35B MoEs from SSD with Trained Routing Prediction

    Sep 16, 2026Yu Lin, Yiming Wang, Runyuan Cai +2Mixture-Of-Expert InferenceMixture-of-Experts Models

  11. Beyond the Previous Layer: Residual Predictive Structure in Sparse MoE Routing

    Sep 15, 2026Hao Li, Yasuyuki Tahara, Yuichi SeiMixture-of-Experts Models

  12. Dataset-Dependent Effects of Cross-Depth Aggregation and Soft-Routed Experts in EEG Foundation Model Fine-Tuning

    Sep 15, 2026Mingyang Jiang, Yamin Li, Daniel Moyer +3Electroencephalography Foundation ModelsWireless Foundation Models

  13. Unifying Semantic Priors and High-Frequency Traces: Enhancing V-JEPA with Mixture-of-Experts for Robust Synthetic Image Forensics

    Sep 15, 2026Simone Teglia, Irene AmeriniExplainable Deepfake DetectionDeepfake Detection

  14. Data storytelling meets interpretable machine learning: Decoding AI decisions for non-experts without revealing sensitive data and model details

    Sep 14, 2026Lemen Chao, Zixuan Yang, Anran Fang +2Model InterpretabilityExperts

  15. MoME: Mixture-of-Memory Embeddings for Context-Aware Sparse Lookup

    Sep 14, 2026Muchen Li, Leonid Sigal, Renjie LiaoMixture-Of-Expert Language ModelsLarge Language Model Memory

  16. Horizon-specific Expert Fusion for Photovoltaic Power Forecasting

    Sep 14, 2026Xu Yuqing, Zhou Liguo, Sun Ze +2Energy ForecastingSolar

  17. Evidence-Aligned Local Composition of Discrete Experts for Sequence Restoration

    Sep 14, 2026Mohammad Panahazari, Usman A. Khan, Shuchin AeronRestorationExperts

  18. SeqMoE: Toward Full-Load Performance via Predictive and Graph-Compatible MoE Offloading

    Sep 14, 2026Zihan Wang, Yuqi Wang, Lei Gong +5Mixture-Of-Expert InferenceOffloading

  19. Expert-Space Exploration in MoE Reinforcement Learning

    Sep 14, 2026Hongyi He, Zhenghao Lin, Xiao Liu +3Mixture-of-Experts ModelsRollout

  20. ExpertHTR: Unified Handwritten Text Recognition with Multi-Task Learning and Sparse Mixture-of-Experts

    Sep 14, 2026Dang Hoai Nam, Nguyen Duy Hieu, Quang Huu Hieu +1Handwritten Text RecognitionMixture-of-Experts Models

  21. From Collaboration to Capability: Internalizing Routed LLM Experts into Compact Reasoners

    Sep 14, 2026Frank Nie, Shuyao Wang, Ethan B. LiuRecursive ReasonerExperts

  22. Can We Triage LLM Translation Errors in Classical Texts Without Human References? Source Novelty, GEMBA Scoring, and Budgeted Review through Pali-to-English Translation

    Sep 14, 2026Máté MetzgerTranslation QualityTriage

  23. M3-Former: Multimodal Transformer with Mixture-of-Experts for Long-Term Vessel Trajectory Prediction

    Sep 11, 2026Wenzhe Jin, Haina TangTrajectory PredictionMultimodal Transformers

  24. Data Scarcity and Model Sparsity: Mixtures-of-Experts Overfit More to Repeated Data

    Sep 10, 2026Atindra Jha, Margaret Li, Jure Leskovec +2Mixture-of-Experts ModelsOverfitting

  25. Breaking the Central Bias: Spatially Partitioned Experts for Coordinate-Based Neuroevolution

    Sep 10, 2026Romain Claret, Arthur Gygax, Michael O'Neill +3MnistReceptive Fields

  26. Distribution-Consistent Inference for Dynamic Sparse Mixture-of-Experts

    Sep 10, 2026Dohyeon Kim, Bedionita Soro, Sung Ju HwangMixture-Of-Expert InferenceMixture-of-Experts Models

  27. How Fragile Is Safety Alignment at Frontier Scale? A Single-Direction Attack on a 320B MoE

    Sep 9, 2026Yi Shi, Tanyu Chen, Kai ShenLarge Language Model AlignmentSafety Alignment

  28. Good Pretraining, Bad SFT: Checkpoint Quality Across the Training Stack

    Sep 8, 2026Sohir Maskey, Philipp Scholl, Jonas Knupp +2Model PretrainingDownstream Fine-Tuning

  29. Chimaera: A Mixture-of-Graph-Experts Architecture for Cross-Task and Cross-Dataset Graph Learning

    Sep 8, 2026Jonathan Frank, David Richerby, Ansgar ScherpGraph Foundation ModelText-Attributed Graph

  30. Hyperparameter Scaling Laws Across MoE Sparsity

    Sep 8, 2026Changxin Tian, Kunlong Chen, Jia Liu +3Hyperparameter OptimizationMixture-of-Experts Models

  31. MoEMB: Scaling Universal Multimodal Embeddings with Efficient Mixture-of-Experts Models

    Sep 8, 2026Xuanming Cui, Shlok Kumar Mishra, Wentao Bao +6Multimodal EmbeddingsMixture-of-Experts Models

  32. DISEIL: Demonstration Distillation for Sample-Efficient Imitation Learning

    Sep 8, 2026Suyog Khanal, Arun Kumar A, Santu RanaImitation LearningRobot Systems

  33. Router Prior Bias: Preserving Base Routing Structure in MoE Post-Training

    Sep 8, 2026Jaedeok Lee, Keonwoo Kim, Dongyoon Han +3Mixture-of-Experts ModelsLLM Post-Training Methods

  34. MI-PEFT: Mixture-of-Experts Integrated Parameter-Efficient Fine-Tuning Protein Language Models Improves Acidophilic Proteins Classification

    Sep 7, 2026Honghan ShenMixture-of-Experts Models

  35. Latent-MoE: Domain-Aware Mixture-of-Experts for PDEs with Multi-Regime Physics

    Sep 7, 2026Hanwen Wang, Paris PerdikarisConventional Physics-Informed Neural NetworksPartial Differential Equations

  36. Distance-Aware Attention and Wall-Distance Expert Routing for Transformer-Based 3D Flow Prediction

    Sep 7, 2026Sanghyeon Kim, Sunwoong Yang, Namwoo KangOptical FlowMixture-of-Experts Models

  37. Encoded Early, Used Late: Where Transformers Begin to Act on an Inferred Partner's Expertise

    Sep 7, 2026Mika Okamoto, Gabriele SartiTransformer EncoderExpert Demonstrations

  38. MEOX: Compact Multimodal Mixture-of-Experts for Earth Observation

    Sep 4, 2026Mohanad AlbughdadiCloud-Aware Earth Observation SequencesEarth Observation

  39. Towards a Statistical Understanding of Mixture-of-Experts

    Sep 3, 2026Siyuan He, Bokai Yang, Jie Hu +2Mixture-of-Experts ModelsAdaptive Routing

  40. Does Imitation Learning Preserve Temporal Robustness in Dexterous Manipulation? An Expert-Learner Comparison Across Task Execution Speeds

    Sep 1, 2026Clinton Enwerem, John S. Baras, Calin BeltaImitation LearningRobotic Manipulation Policies

  41. GazeRefine: Expert Gaze as a Test-Time Prompt for Training-Free Medical Image Segmentation

    Sep 1, 2026Mohammed Oussama Benyahia, Marouane Tliba, Mohamed Amine Kerkouri +10Few-Shot Medical Image SegmentationMedical Image Segmentation

  42. PersuaRL: Reinforcement Learning-Driven Multi-Expert Selection for Persuasive Dialogue Generation in Insurance

    Sep 1, 2026Rohan Kirti, Akash Ghosh, Aryan Vats +5PersuasionInsurance

  43. Different Changes Require Different Reasoning: Change-Type-Specialized Experts for Robust Change Captioning

    Sep 1, 2026Jiyoung Park, InJae Oh, Jung Uk KimRemote Sensing Image Change CaptioningImage Classification

  44. Beyond Magnitude: Contrastive Routing for Modular Mixture-of-Experts

    Sep 1, 2026Nikolaos Xiros, Dimitrios Damianos, Maria-Eleni Zoumpoulidi +3Mixture-of-Experts ModelsAdaptive Routing

  45. PCoMoE: Shifting MoE Inference from Monolithic Expert Selection to Fine-Grained Path Composition

    Sep 1, 2026Ziyan Gan, Fangxin Liu, Chenyang Guan +10Mixture-Of-Expert InferenceMixture-of-Experts Models

  46. Candidate-Expanding Routing with Permutation-Stabilized Experts for Mixed-Format Medical VQA

    Sep 1, 2026Hai-Dang Nguyen, Huy-Hieu PhamMedical Visual Question AnsweringMixture-of-Experts Models

  47. AnalysisBank: An Expert Analysis Pattern Library for Financial Report Generation

    Sep 1, 2026Yajing Yang, Yunshan Ma, Kelvin J. L. Koa +1ReportFinance Domain

  48. Instella-MoE Technical Report

    Sep 1, 2026Jiang Liu, Sudhanshu Ranjan, Prakamya Mishra +10Mixture-Of-Expert Language ModelsLarge Models

  49. Residual Sparsification via Output Importance for Compressing Mixture-of-Experts LLMs

    Sep 1, 2026Seungwoo Jung, Dohyeok Kwon, Seungmin Cha +4Mixture-Of-Expert Language ModelsLarge Language Model Compression

  50. mimeo: Compiling Public Expert Corpora into Agent Skills and Testing What Transfers

    Aug 31, 2026Timothy KassisExpert DemonstrationsCoding Agents

  51. DynaNDE: Dynamic Near-Data Expert Scheduling for Batched MoE Inference

    Aug 31, 2026Xiaoyang Lu, Belthangady Akash Vi Narayana Pai, Xian-He SunMixture-Of-Expert InferenceNeural Processing Units

  52. WiSDoM: Wireless Sparse Decision Transformer with Mixture-of-Experts for Multi-Task Mobile Network Optimization

    Aug 31, 2026Fatih Temiz, Shavbo Salehi, Melike Erol-KantarciOpen Radio Access NetworksMulti-Task Reinforcement Learning

  53. Multimodal Adaptive Expert Selection with Text Routing and Ordinal Prototype Optimization for Sentiment Analysis

    Aug 31, 2026Xiaode Chen, Jiakang Yu, Hongtao Deng +3Sentiment AnalysisMultimodal Learning

  54. TuringLLM: Efficiently Scaling Foundation Models Toward Physical AI

    Aug 31, 2026Yuheng Zhang, Yizhao Wang, Da Zhu +19Mixture-of-Experts ModelsCounter Turing Test

  55. Q-Strata: Hierarchical Bit Allocation for Mixed-Precision Quantization of Mixture-of-Experts LLMs

    Aug 31, 2026Deokjae Lee, Sihun Chu, Hyun Oh SongMixed-Precision QuantizationMixture-Of-Expert Language Models

  56. PRIME: Mitigating Subgroup Optimization Competition in Shared CTR Top Networks with Plug-in Residual Input-Conditioned Mixture of Expert

    Aug 31, 2026Heng Yao, Siyun Hou, Tianying Liu +8Mixture-of-Experts ModelsClick-Through Rate Prediction

  57. A.X K2 Technical Report

    Aug 31, 2026Cheolseung Baek, Dhammiko Arya, Eunki Kim +40Mixture-Of-Expert Language ModelsMixture-of-Experts Models

  58. Evolutionary Soups: Evolving Mixture-of-Experts for Multi-Objective LLM Alignment

    Aug 30, 2026Lingxiao Kong, Steffen Staab, Cong Yang +2Evolutionary SearchLarge Language Model Alignment

  59. Structure Aware Neural Architecture Search for Mixture of Experts

    Aug 30, 2026Petr Babkin, Oleg BakhteevNeural Architecture SearchMixture-of-Experts Models

  60. HiVe: Beyond Static Prompts for Multitask Learning via Hierarchy-based Vertical Mixture-of-Experts

    Aug 30, 2026Hyeonjik Bae, Minyeol Kim, Susik YoonPrompt TuningParameter-Efficient Fine-Tuning