Mixture-of-Experts Models

Ask about this topic

Recent momentum

-34%

43 papers in the last 28 days · 0.7% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Also in Mixture-Of-Experts

Neighbouring directions

ExpertsMixture-Of-Expert Language ModelsMixture-Of-Expert InferenceExpert DemonstrationsLoad Balancing

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

14 new papers

A weekly snapshot of new work published in Mixture-of-Experts Models.

Period ending 2026-09-14

2 new papers

A weekly snapshot of new work published in Mixture-of-Experts Models.

Period ending 2026-09-07

12 new papers

A weekly snapshot of new work published in Mixture-of-Experts Models.

419 papers

Latest in Mixture-of-Experts Models

Browse all topics →
CardsList

  1. PagedWeight: Efficient MoE LLM Serving with Dynamic Quality-Aware Weight Quantization

    Jul 17, 2026Yuchen Yang, Yifan Zhao, Anisha Dasgupta +1Mixture-Of-Expert Language ModelsGraphics Processing Unit Memory

  2. Loop the Loopies!

    Jul 17, 2026Zitian Gao, Yilong Chen, Yihao Xiao +4Billion-Parameter ModelsLoop

  3. QUADS: Stabilizing NVFP4 Reinforcement Learning for MoE via QUantization-error Alignment across Dual Sides

    Jul 17, 2026Zhengyang Zhuge, Hao Yu, Xin Wang +4RolloutTraining-Inference Mismatch

  4. MGDT: MLLM-Guided Diffusion Transformer with Relation-Adaptive Mixture-of-Experts for Multimodal Knowledge Graph Completion

    Jul 17, 2026Xu Hou, Meiyu Liang, Wei Huang +6Knowledge Graph CompletionCross-Modal Learning

  5. Multi-Expert Routing for Multi-Domain Low-Resource OCR: A Manchu Case Study

    Jul 15, 2026Zhan Chen, Jiqiao Ma, Chih-wen KuoOptical Character RecognitionHandwriting

  6. Less Experts, Faster Decoding: Cost-Aware Speculative Decoding for Mixture-of-Experts

    Jul 14, 2026Jincheng Xie, Runheng Liu, Heyan Huang +4Speculative DecodingMixture-of-Experts Models

  7. Understanding Structured Health Data through Interaction-Aware Mixture-of-Experts

    Jul 14, 2026Ji Hwan Park, Ying Ding, Tianjin GuoMixture-of-Experts ModelsMultimodal Clinical Data

  8. HCRMap: Pressure-Aware Hot-Expert Residency Mapping for 3.5D MoE Chiplet Inference

    Jul 13, 2026Yongqin ZhangMixture-Of-Expert InferenceMixture-of-Experts Models

  9. A Sovereign, Open-Source Foundation Model for German and English

    Jul 10, 2026The Soofi-Team, :, Benedikt Droste +29Mixture-Of-Expert Language ModelsWireless Foundation Models

  10. Mach-Mind-4-Flash Technical Report

    Jul 10, 2026Foundation Model TeamAgentic Reinforcement-Learning FrameworkMixture-of-Experts Models

  11. It Takes a MAESTRO To Prune Bad Experts

    Jul 9, 2026Palaash Goel, Ayush Maheshwari, Tanmoy ChakrabortyMixture-of-Experts ModelsExperts

  12. On the Design of Mixture-of-Experts for Dynamic Gaussian Splatting

    Jul 9, 2026In-Hwan Jin, Hyeongju Mun, Joonsoo Kim +23D Gaussian SplatsGaussian Splatting

  13. Scaling Mixture-of-Experts Video Pretraining for Embodied Intelligence

    Jul 8, 2026Shuailei Ma, Jiaqi Liao, Xinyang Wang +24Video PretrainingIntelligence

  14. ProMoE-FL: Prototype-conditioned Mixture of Experts for Multimodal Federated Learning with Missing Modalities

    Jul 7, 2026Aavash Chhetri, Bibek Niroula, Eduard Vazquez +4Missing ModalitiesRobust Multimodal Learning

  15. UBEP: Re-architecting Expert Parallelism Communication Library for Production Superpods

    Jul 7, 2026Yipeng Liu, Chang Liu, Si Shen +16Mixture-Of-Expert InferenceMixture-of-Experts Models

  16. RoME: Robust Mixture of Low-Rank Experts against Multiple Adversarial Perturbations

    Jul 7, 2026Woo Jae Kim, Kyle Min, Suhyeon Ha +2Adversarial TransferabilityMixture-of-Experts Models

  17. SpaR3D-MoE: Adaptive 3D Spatial Reasoning from Sparse Views Meets Geometry-Inductive Mixture-of-Experts

    Jul 7, 2026Haida Feng, Hao Wei, Haolin Wang +33D Spatial ReasoningMixture-of-Experts Models

  18. NEST: Tackling Dataset-Level Distribution Shifts via Regime-Oriented Mixture-of-Experts

    Jul 7, 2026Lanhao Li, Bingshu Xie, Lijun Sun +3Distribution ShiftsMixture-of-Experts Models

  19. TriRoute: Unified Learned Routing for Joint Adaptive Attention, Experts, and KV-Cache Allocation

    Jul 7, 2026Andrii Balashov, Olena PonomarovaAdaptive RoutingQuadratic Attention

  20. Optimal Mixture-of-Experts Model Averaging for Conditional Generative Models

    Jul 5, 2026Shijin Gong, Baihua He, Xinyu ZhangGenerative ModelsMixture-of-Experts Models

  21. WPG-MoE: Weak-Prior-Guided Dense Mixture-of-Experts for User-Level Social Media Depression Detection

    Jul 5, 2026Xian Li, Yuanhe Tian, Yang Yang +2Depression DetectionScreening

  22. Worldscape-MoE: A Unified Mixture-of-Experts World Model for Scalable Heterogeneous Action Control

    Jul 4, 2026Jianjie Fang, Yongyan Xu, Ziyou Wang +13Efficient World-Action ModelLong-Tail Humanoid Whole-Body Control

  23. CL-Anomaly: Layer-Adaptive Mixture-of-Experts with Multimodal Large Language Model for Continual Learning in Anomaly Detection

    Jul 3, 2026Wen Dong, Zhao Wang, Shuangqing Zhang +5Efficient Continual LearningAnomaly Detection

  24. Gemma 4 Technical Report

    Jul 2, 2026Gemma Team, Sherif El Abd, Vaibhav Aggarwal +298Technical ReportEncoder-Decoder Architectures

  25. RES-DARE: Failure-Aware Expert Adaptation and Rollback-Safe Self-Repair for Intrusion Detection

    Jul 2, 2026Rahil Aftab, Anyash Prasad, Soumya Mazumdar +2Intrusion DetectionFault Injection Experiments

  26. MARVEL: Margin-Aware Robust von Mises-Fischer Expert Learning for Long-Tailed Out-of-Distribution Detection

    Jul 2, 2026A. S. Anudeep, Vaanathi SundaresanOut-Of-Distribution DetectionOut-Of-Distribution

  27. Mixture-of-Parallelisms: Towards Memory-Efficient Training Stack for Mixture-of-Experts Models

    Jul 2, 2026Xuan-Phi Nguyen, Shrey Pandit, Yiran Zhao +3Mixture-of-Experts ModelsBillion-Parameter Models

  28. EPnG: Adaptive Expert Prune-and-Grow for Parameter-Efficient MoE Fine-tuning

    Jul 2, 2026Ahin Lee, Sehyun Yun, Taesik GongParameter-Efficient Fine-TuningMixture-of-Experts Models

  29. Generic Expert Coverage for Pruning SparseMixture-of-Experts Language Models

    Jul 2, 2026Yongqin Zeng, Sicheng Pan, Jiale Wang +4Mixture-of-Experts ModelsPruning

  30. On the Utility and Factual Reliability of Pruned Mixture-of-Experts Models in the Biomedical Domain

    Jul 1, 2026Atsuki Yamaguchi, Szymon Palucha, Léo Bijar +2Mixture-of-Experts ModelsSelective

  31. Spatial-Temporal Expert Learning for Video-based Person Re-identification

    Jul 1, 2026Xiaofei Hui, Pengfei Wang, Evan Ling +4Re-IdentificationSpatiotemporal Representations

  32. FRAME: Learning the Adaptation Domain with a Mixture of Fractional-Fourier Experts

    Jun 30, 2026Tom Saliencro, Maya Lindqvist, Rohan Desai +2Parameter-Efficient Fine-TuningMixture-of-Experts Models

  33. FaceMoE: Mixture of Experts for Low-Resolution Face Recognition

    Jun 30, 2026Kartik Narayan, Vishal M. PatelFacial RecognitionLow-Resolution

  34. CHERRY: Compressed Hierarchical Experts with Recurrent Representational Yield

    Jun 30, 2026Dohyeon Kwon, Youngjin ParkLarge Language Model CompressionToken-Level Supervision

  35. Dual-Adaptive SAM3: Hierarchical Routing over Low-Rank Expert Layers for Parameter-Efficient Medical Image Segmentation

    Jun 30, 2026Ying Chen, Jinyue Li, Kun Wang +2Few-Shot Medical Image SegmentationMedical Image Segmentation

  36. ExPLoRe: Expert Patch-Level Loss Routing for Multi-Objective Masked Image Modeling

    Jun 30, 2026Konstantinos Georgiou, Maofeng Tang, Hairong QiMixture-of-Experts ModelsMulti-Objective Optimization

  37. A Multi-task Mixture of Experts Framework for Malware Classification, Packing Detection, and Family Attribution

    Jun 29, 2026Jithin S., Roshin Sleeba C., Anvin Mariya P. B. +4Malware DetectionMixture-of-Experts Models

  38. Residual-Guided Expert Specialization for Incomplete Multimodal Learning

    Jun 29, 2026Seunghun Baek, Jihwan Park, Jaeyoon Sim +3Robust Multimodal LearningMixture-of-Experts Models

  39. DAIN: Dynamic Agent-Based Interaction Network for Efficient and Collaborative Multimodal Reasoning

    Jun 29, 2026Xinxin Chen, Yuchen Li, Zihan Wang +3Multimodal FusionMultimodal Agents

  40. Does Role Specialization Matter for Explanation Faithfulness in Mixture-of-Experts?

    Jun 28, 2026Yeji Kim, Housam Babiker, Mi-Young Kim +1Mixture-of-Experts ModelsExplanation Faithfulness

  41. TF-MoE: Time-Frequency Mixture-of-Experts for Efficient Speech Separation

    Jun 28, 2026Qinzhe Hu, Chenda Li, Wangyou Zhang +3Speech SeparationTime-Frequency

  42. Mixture of Debaters: Learn to Debate at Architectural Level in Multi-Agent Reasoning

    Jun 28, 2026Dayong Liang, Kaisong Gong, Yi Cai +2Multi-Agent DebateDebate

  43. FreqOrtho-SR: Frequency-Guided Orthogonal Expert Learning for Real-World Image Super-Resolution

    Jun 27, 2026Minh Son Hoang, Dinh Phu Tran, Quyen Nguyen Duc +2Generative Super-ResolutionImage Restoration

  44. CLEAR-MoE: Shared-Basis Expert Extraction from Frozen Vision Transformers via Calibration-Driven Layer Selection

    Jun 26, 2026Md Irtiza Hossain, Humaira Ayesha, Junaid Ahmed SifatVision TransformerMixture-of-Experts Models

  45. FlexMoE: One-for-All Nested Intra-Expert Pruning for MoE Language Models

    Jun 26, 2026Fan Mo, Yuxuan Han, Geng Zhang +2Mixture-Of-Expert Language ModelsMixture-of-Experts Models

  46. PAMAE: Phase-Aware-MoE Action Experts Towards Reliable Flow-Matching Vision-Language-Action Policies

    Jun 25, 2026Jiayu Yang, Tao Yang, Xiang Chang +3Flow-Matching Vision-Language-ActionVision-Language-Action Models

  47. Focusing on What Matters: Saliency-Harnessing Accurate Routing for Diffusion MoE

    Jun 25, 2026Haoyou Deng, Keyu Yan, Chaojie Mao +4Mixture-of-Experts ModelsSaliency

  48. Learning to Recover Task Experts from a Multi-Task Merged Model

    Jun 25, 2026Jinwook Jung, Taegyu Kim, Kumju Jo +1Multi--Task LearningMixture-of-Experts Models

  49. Optimizing CUDA like a Human: Micro-Profiling Tools as Expert Surrogates for LLM-Based GPU Kernel Optimization

    Jun 24, 2026Jiading Gai, Shuai Zhang, Kaj Bostrom +6Graphics Processing Unit KernelsCuda

  50. SARA: Unlocking Multilingual Knowledge in Mixture-of-Experts via Semantically Anchored Routing Alignment

    Jun 24, 2026Tianyu Dong, Yangyang Liu, Jiang Zhou +9Multilingual Language ModelsMixture-of-Experts Models

  51. LiMoDE: Rethinking Lifelong Robot Manipulation from a Mixture-of-Dynamic-Experts Perspective

    Jun 24, 2026Zhihao Gu, Lin WangUnseen-Task AdaptationGeneralizable Robotic Manipulations

  52. Learning Subset-Shared Invariances for Domain Generalization with Mixture-of-Experts

    Jun 24, 2026Tien-Hung Nguyen, Tien-Dat Tran, M. -Duong Nguyen +1Multimodal Domain GeneralizationDomain Generalization

  53. Heterogeneous and Adept Snapshot Distillation for 3D Semantic Segmentation

    Jun 24, 2026Xiaopei Wu, Yuenan Hou, Junkai Xu +73D Semantic SegmentationCross-Modal Distillation

  54. How Modular Is a Frontier Mixture-of-Experts? A Pre-registered Causal Test in Which Apparent Expert Modularity Mostly Dissolves

    Jun 23, 2026Tony Salomone, Deep Gandhi, Ali AsariaMixture-of-Experts ModelsModular Framework

  55. BioMedVR: Confusion-Aware Mixture-of-Prompt Experts for Biomedical Visual Reprogramming

    Jun 23, 2026Jiaxiang Liu, Tianxiang Hu, Juwei Guan +5Medical Vision-Language ModelsFew-Shot Learning

  56. CrossPool: Efficient Multi-LLM Serving for Cold MoE Models through KV-Cache and Weight Disaggregation

    Jun 23, 2026Zhuoren Ye, Tianyu Wo, Dinghao Xue +4Kv-Cache BlocksLarge Language Model Serving

  57. Transformer-Based Language Models Across Domain Verticals: Architectures, Applications and Critical Assessment

    Jun 23, 2026Guruprakash J, Krithika L. BEncoder-Decoder ArchitecturesDeepseek

  58. RAVEN: A Regime-Aware Variable-context Expert Network for Financial Time Series Forecasting

    Jun 23, 2026Cheng He, Zhenyu Guan, Xijie Liang +6Multivariate ForecastingStochastic Volatility

  59. Cross-Architectural Mixture-of-Experts with Adaptive Soft Routing for Plant Leaf Disease Classification

    Jun 22, 2026Phi-Hung Hoang, Thi-Thu-Hong PhanTomato DiseasesApple Tree Leaf Disease Segmentation Dataset

  60. AudioCALM: Continuous Autoregressive Language Modeling for Universal Audio Generation

    Jun 22, 2026Huadai Liu, Kaicheng Luo, Wen Wang +4Audio LatentAudio