Mixture-of-Experts Inference

Ask about this topic

Momentum

16 papers in the last four weeks, up 167% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 109

All topics
CardsList

  1. SpaceMoE: Realizing Distributed Mixture-of-Experts Inference over Space Networks

    May 1, 2026Zhanwei Wang, Huiling Yang, Min Sheng +2Mixture-of-Experts Language ModelsMixture-of-Experts Inference

    Department of Electrical and Computer Engineering, The University of Hong Kong (HKU), Hong Kong SAR, China · State Key Laboratory of Integrated Service Networks, Institute of Information Science, Xidian University (XDU), Xi’an, Shaanxi, China · Department of Electronic and Computer Engineering, The Hong Kong University of Science and Technology (HKUST), Hong Kong SAR, China

  2. Making Every Verified Token Count: Adaptive Verification for MoE Speculative Decoding

    May 1, 2026Lehan Pan, Ziyang Tao, Ruoyu Pang +3Mixture-of-Experts InferenceSpeculative Decoding

    University of Science and Technology of China · Tianyijiaotong Technology Ltd., Suzhou, China

  3. Rethinking Network Topologies for Cost-Effective Mixture-of-Experts LLM Serving

    Apr 30, 2026Junsun Choi, Sam Son, Sunjin Choi +5LLM ServingCost-Aware Inference

    UC Berkeley · UC Berkeley & ICSI

  4. FaaSMoE: A Serverless Framework for Multi-Tenant Mixture-of-Experts Serving

    Apr 29, 2026Minghe Wang, Trever Schirmer, Mohammadreza Malekabbasi +1Mixture-of-Experts Language ModelsLLM Serving

    TU Berlin · Berlin, Germany

  5. RaMP: Runtime-Aware Megakernel Polymorphism for Mixture-of-Experts

    Apr 28, 2026Vyom Sharma, Debajyoti DattaGPU Kernel OptimizationGPU Acceleration

    Hippocratic AI

  6. Scaling Multi-Node Mixture-of-Experts Inference Using Expert Activation Patterns

    Apr 25, 2026Abhimanyu Bambhaniya, Geonhwa Jeong, Jason Park +6Expert Load BalancingMixture-of-Experts Inference

    1Georgia Institute of Technology, USA · 2Meta Platforms, Inc.

  7. Mixture of Heterogeneous Grouped Experts for Language Modeling

    Apr 25, 2026Zhicheng Ma, Xiang Liu, Zhaoxiang Liu +5Expert Load BalancingMixture-of-Experts Language Models

    1Data Science & Artificial Intelligence Research Institute, China Unicom · 2Unicom Data Intelligence, China Unicom

  8. Temporally Extended Mixture-of-Experts Models

    Apr 22, 2026Zeyu Shen, Peter HendersonMixture-of-Experts InferenceMemory-Efficient Inference

    1Princeton University

  9. Efficient Mixture-of-Experts LLM Inference with Apple Silicon NPUs

    Apr 20, 2026Afsara Benazir, Felix Xiaozhu LinAI Accelerator InferenceEnergy-Efficient ML

    University of Virginia Charlottesville, Virginia, USA

  10. MACS: Modality-Aware Capacity Scaling for Efficient Multimodal MoE Inference

    Apr 19, 2026Bo Li, Chuan Wu, Shaolin ZhuEfficient Multimodal InferenceExpert Load Balancing

    School of Software, Tsinghua University, Beijing, China · TJUNLP Lab, School of Computer Science and Technology, Tianjin University, China · School of New Media and Communication, Tianjin University, China

  11. ELMoE-3D: Leveraging Intrinsic Elasticity of MoE for Hybrid-Bonding-Enabled Self-Speculative Decoding in On-Premises Serving

    Apr 16, 2026Yuseon Choi, Jingu Lee, Jungjun Oh +5LLM ServingMixture-of-Experts Inference

    KAIST · Samsung Electronics · GIST

  12. MoEless: Efficient MoE LLM Serving with Serverless Experts

    Mar 6, 2026Hanfei Yu, Bei Ouyang, Shwai He +2LLM Inference EfficiencyExpert Load Balancing

    University of Maryland College Park

  13. A Replicate-and-Quantize Strategy for Plug-and-Play Load Balancing of Sparse Mixture-of-Experts LLMs

    Feb 23, 2026Zijie Liu, Jie Peng, Jinhao Duan +7Expert Load BalancingMixture of Experts

    University of North Carolina at Chapel Hill · University of Minnesota Twin Cities · North Carolina State University +2

  14. OmniMoE: An Efficient MoE by Orchestrating Atomic Experts at Scale

    Feb 5, 2026Jingze Shi, Zhangyang Peng, Yizhang Zhu +3Mixture-of-Experts InferenceLLM Inference Acceleration

    The Hong Kong University of Science and Technology (Guangzhou) · Beijing Academy of Artificial Intelligence

  15. FlashMoE: Reducing SSD I/O Bottlenecks via ML-Based Cache Replacement for Mixture-of-Experts Inference on Edge Devices

    Jan 22, 2026Byeongju Kim, Jungwan Lee, Donghyeon Han +2Edge InferenceMixture-of-Experts Inference

  16. 3D-MoE: Towards Spatial Intelligence with Mixture-of-Experts for 3D Reasoning and Action Generation

    Jan 28, 2025Yueen Ma, Zenglin Xu, Irwin King3D Spatial ReasoningMixture-of-Experts Inference

    Department of Computer Science and Engineering, The Chinese University of Hong Kong, Hong Kong SAR

  17. Dynamic Expert Quantization for Scalable Mixture-of-Experts Inference

    Date pendingKexin Chu, Dawei Xiang, Zixu Shen +3Mixed-Precision QuantizationGPU Acceleration

    University of Connecticut · University of California, Santa Cruz · Independent Researcher

  18. FluxMoE: Decoupling Expert Residency for High-Performance MoE Serving

    Date pendingQingxiu Liu, Yongchao He, Runhan Jiang +4Expert OffloadingGPU Acceleration

    CUHK · Unaffiliated · SCITIX +1

  19. Cache-Aware Joint Router Adaptation for Memory-Efficient MoE Inference

    Date pendingZhenhe Wu, Yaping Jin, Qinghua Xing +6Mixture of ExpertsMemory-Efficient Optimization

    Huawei Technologies · Beihang University · Tianjin University +2