Mixture-Of-Expert Inference

Ask about this topic

Recent momentum

-62%

5 papers in the last 28 days · 0.1% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Also in Mixture-Of-Experts

Neighbouring directions

Mixture-of-Experts ModelsExpertsMixture-Of-Expert Language ModelsExpert DemonstrationsLoad Balancing

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

2 new papers

A weekly snapshot of new work published in Mixture-Of-Expert Inference.

Period ending 2026-09-07

2 new papers

A weekly snapshot of new work published in Mixture-Of-Expert Inference.

66 papers

Latest in Mixture-Of-Expert Inference

Browse all topics →
CardsList

  1. The Other Half of the Memory Wall: Serving 35B MoEs from SSD with Trained Routing Prediction

    Sep 16, 2026Yu Lin, Yiming Wang, Runyuan Cai +2Mixture-Of-Expert InferenceMixture-of-Experts Models

  2. SeqMoE: Toward Full-Load Performance via Predictive and Graph-Compatible MoE Offloading

    Sep 14, 2026Zihan Wang, Yuqi Wang, Lei Gong +5Mixture-Of-Expert InferenceOffloading

  3. Distribution-Consistent Inference for Dynamic Sparse Mixture-of-Experts

    Sep 10, 2026Dohyeon Kim, Bedionita Soro, Sung Ju HwangMixture-Of-Expert InferenceMixture-of-Experts Models

  4. PCoMoE: Shifting MoE Inference from Monolithic Expert Selection to Fine-Grained Path Composition

    Sep 1, 2026Ziyan Gan, Fangxin Liu, Chenyang Guan +10Mixture-Of-Expert InferenceMixture-of-Experts Models

  5. DynaNDE: Dynamic Near-Data Expert Scheduling for Batched MoE Inference

    Aug 31, 2026Xiaoyang Lu, Belthangady Akash Vi Narayana Pai, Xian-He SunMixture-Of-Expert InferenceNeural Processing Units

  6. TEMPO: Makespan-Aware Expert-Parallel Load Balancing Across Memory- and Compute-Bound Regimes

    Aug 13, 2026Jie Li, Chenxin Jia, Jinliang Shen +5Load BalancingMulti-Gpu Systems

  7. APEX: Adaptive Expert Prefetching for Memory-Efficient Edge MoE Inference

    Aug 12, 2026Alish Kanani, Layan Badawi, Umit Y. OgrasMixture-Of-Expert InferenceMixture-of-Experts Models

  8. EasyBalance: Cross-Layer Load Balancing in Distributed MoE Inference

    Aug 8, 2026Yize Wu, Ke Gao, Ling Li +1Load BalancingMixture-Of-Expert Inference

  9. When Does Trace-Driven Evaluation Mislead MoE Expert Caching? Replay Semantics, Workload Contamination, and Operating Regimes

    Aug 8, 2026Yu ZhangMixture-Of-Expert InferenceExperts

  10. Elbow-Based MoE Routing: A Training-Free Inference Time Plugin for Expert Selection

    Aug 5, 2026Robin Pan, Raymond Liu, Daniel Fang +2Mixture-Of-Expert InferenceMixture-of-Experts Models

  11. AcceptMoE: Commitment-Weighted Self-Sizing Verifier Expert Sets for Efficient MoE Speculative Decoding

    Aug 4, 2026Shuang Liang, Hao Mark Chen, Zhiwen Mo +4Mixture-Of-Expert InferenceSpeculative Decoding

  12. REFLEX: Rethinking MoE Inference as Refinement-Aware Compute Allocation in Diffusion Language Models

    Aug 3, 2026Xiang Xia, Cheng Yan, Yiming Zhang +3Mixture-Of-Expert InferenceDiffusion Language Models

  13. TopoCompress: Topology Aware Token Compression Algorithm for Distributed Edge MoE Inference

    Aug 1, 2026Ning Li, Xinyu Wang, Xin Yuan +3Mixture-Of-Expert InferenceHeterogeneous Edge Devices

  14. HetRoute Heterogeneous and Cost-aware Collaborative Routing Framework for Distributed Edge MoE Inference

    Aug 1, 2026Xin Yuan, Ning Li, Wenchao Xu +2Mixture-Of-Expert InferenceHeterogeneous Edge Devices

  15. TrimMoE A communication aware and adaptive depth framework for distributed edge inference

    Aug 1, 2026Ning Li, Shuting Bai, Xin Yuan +3Mixture-Of-Expert InferenceMixture-of-Experts Models

  16. From Expert Reduction to Behavioral Divergence: Tracing Numerical State through Sparse MoE Inference

    Jul 30, 2026Tianyang ZhuMixture-Of-Expert InferenceMixture-of-Experts Models

  17. Incast-Free MoE Rate-Based Scheduling

    Jul 28, 2026Evyatar Cohen, Jose Yallouz, Alexander Shpiner +3SchedulingMixture-Of-Expert Inference

  18. DraftExpert: Expansion-Aware Self-Speculative Decoding for End-Device MoE Inference

    Jul 27, 2026Dengke HanMixture-Of-Expert InferenceMixture-of-Experts Models

  19. Fine-grained Computation-Communication Overlap via Tile-level Signaling and Scheduling for Mixture-of-Experts

    Jul 21, 2026Minyu Cui, Anna Wingkvist, Morgan EricssonMixture-Of-Expert InferenceMixture-of-Experts Models

  20. OrderMoE: An expert similarity driven distributed edge MoE inference

    Jul 19, 2026Xin Yuan, Ning Li, Quan Chen +2Mixture-Of-Expert InferenceMixture-of-Experts Models

  21. ThAME: 3D Memory-Enabled Heterogeneous Accelerator for LLM Mixture of Experts

    Jul 19, 2026Pratyush Dhingra, Pramit Kumar Pal, Janardhan Rao Doppa +1Mixture-Of-Expert InferenceLLM Inference Efficiency

  22. HCRMap: Pressure-Aware Hot-Expert Residency Mapping for 3.5D MoE Chiplet Inference

    Jul 13, 2026Yongqin ZhangMixture-Of-Expert InferenceMixture-of-Experts Models

  23. UBEP: Re-architecting Expert Parallelism Communication Library for Production Superpods

    Jul 7, 2026Yipeng Liu, Chang Liu, Si Shen +16Mixture-Of-Expert InferenceMixture-of-Experts Models

  24. WiSP: A Working-Set View of Mixture-of-Experts Serving on Extremely Low-Resource Hardware

    Jun 20, 2026Jiamu Zhang, Liang Wu, Mayank Darbari +1Mixture-Of-Expert InferenceMixture-of-Experts Models

  25. Does Mixture-of-Experts Actually Help Inference on Consumer and Edge Hardware? An Empirical Study

    Jun 19, 2026Alfarizy Alfarizy, Hung Truong Thanh Nguyen, René Richard +2Mixture-Of-Expert InferenceMixture-of-Experts Models

  26. MawForge: Memory-Bounded Expert Materialization for Local Mixture-of-Experts Inference

    Jun 17, 2026Craig OpieMixture-Of-Expert InferenceExpert Demonstrations

  27. Attribution-Guided and Coverage-Maximized Pruning for Structural MoE Compression

    Jun 16, 2026Yifu Ding, Jiacheng Wang, Ge Yang +4Mixture-Of-Expert InferenceMixture-of-Experts Models

  28. MoECa: Aligning Feature Reuse with Expert Decomposition in Diffusion Transformers

    Jun 14, 2026Maoliang Li, Haojing Chen, Jiayu Chen +4Mixture-Of-Expert InferenceMultimodal Diffusion Transformers

  29. A Spatio-Temporal Expert Prefetching Framework for Efficient MoE-based LLM Inference

    Jun 13, 2026Yingnan Zhao, Razvan Bunescu, Ahmed Louri +2Mixture-Of-Expert InferenceLLM Inference Efficiency

  30. Director: Accelerating Distributed MoE Serving via Online Proactive Expert Placement

    Jun 13, 2026Qianli Liu, Kaibin Guo, Zicong Hong +5Mixture-Of-Expert InferenceMixture-of-Experts Models

  31. Achieving Cloud-Grade SLOs for Local Mixture-of-Experts Inference through CPU-GPU Hybrid Design

    Jun 9, 2026Wenxin Wang, Yule Hou, Yu Ji +2Mixture-Of-Expert InferenceMixture-of-Experts Models

  32. SHAPE: Coalition-Aware Expert Pruning for Sparse Mixture-of-Experts LLMs

    Jun 3, 2026Yuhao ZhangMixture-of-Experts ModelsMixture-Of-Expert Inference

  33. UltraEP: Unleash MoE Training and Inference on Rack-Scale Nodes with Near-Optimal Load Balancing

    Jun 2, 2026Xinming Wei, Chao Jin, Tuo Dai +10Load BalancingMixture-Of-Expert Inference

  34. DOT-MoE: Differentiable Optimal Transport for MoEfication

    Jun 1, 2026Udbhav Bamba, Arnav Chavan, Aryamaan Thakur +2Mixture-Of-Expert InferenceInference Cost

  35. Beyond Task-Agnostic: Task-Aware Grouping for Communication-Efficient Multi-Task MoE Inference

    May 31, 2026Zhiyao Xu, Aoxue Liu, Zhanjie Ding +3Mixture-Of-Expert InferenceMixture-of-Experts Models

  36. ViBE: Co-Optimizing Workload Skew and Hardware Variability for MoE Serving

    May 30, 2026Seokjin Go, Marko Scrbak, Ephrem Wu +2Mixture-Of-Expert InferenceInference Workloads

  37. How Far Can Disaggregation Go? A Design-Space Exploration of Attention-FFN Disaggregation for Efficient MoE LLM Serving

    May 27, 2026Hanjiang Wu, Abhimanyu Rajeshkumar Bambhaniya, Sarbartha Banerjee +9Mixture-Of-Expert InferenceMixture-Of-Expert Language Models

  38. MobileMoE: Scaling On-Device Mixture of Experts

    May 26, 2026Yanbei Chen, Hanxian Huang, Ernie Chang +5Mixture-Of-Expert Language ModelsMixture-Of-Expert Inference

  39. ReMoE: Boosting Expert Reuse through Router Fine-Tuning in Memory-Constrained MoE LLM Inference

    May 26, 2026Xiongwei Zhu, Xiaojian Liao, Tianyang Jiang +3Mixture-Of-Expert InferenceLLM Inference Efficiency

  40. Dense2MoE: Pushing the Pareto Frontier of On-Device LLMs via Unified Pruning and Upcycling

    May 26, 2026Fengfa Li, Hongjin Ji, Yifeng Ding +2Mixture-Of-Expert InferenceMixture-of-Experts Models

  41. GEM: GPU-Variability-Aware Expert to GPU Mapping for MoE Systems

    May 19, 2026Sourish Wawdhane, Avinash Kumar, Poulami DasMixture-Of-Expert InferenceMixture-of-Experts Models

  42. CoX-MoE: Coalesced Expert Execution for High-Throughput MoE Inference with AMX-Enabled CPU-GPU Co-Execution

    May 18, 2026Muyoung Son, Yi Chen, Seungjae Yoo +2Mixture-Of-Expert InferenceMixture-of-Experts Models

  43. BEAM: Binary Expert Activation Masking for Dynamic Routing in MoE

    May 14, 2026Juntong Wu, Jialiang Cheng, Qishen Yin +5Mixture-Of-Expert InferenceMixture-of-Experts Models

  44. Fast MoE Inference via Predictive Prefetching and Expert Replication

    May 12, 2026Ankit Jyothish, Ali Jannesari, Aishwarya Sarkar +1Mixture-Of-Expert InferenceLLM Inference Efficiency

  45. DECO: Sparse Mixture-of-Experts with Dense-Comparable Performance on End-Side Devices

    May 11, 2026Chenyang Song, Weilin Zhao, Xu Han +3Mixture-Of-Expert InferenceMixture-of-Experts Models

  46. DisagMoE: Computation-Communication overlapped MoE Training via Disaggregated AF-Pipe Parallelism

    May 10, 2026Zhichen Zeng, Chi-Chih Chang, Jiayi Wang +10Mixture-Of-Expert InferenceMixture-of-Experts Models

  47. TileQ: Efficient Low-Rank Quantization of Mixture-of-Experts with 2D Tiling

    May 10, 2026Hongyaoxing Gu, Xinzhe Chen, Lijuan Hu +1Mixture-Of-Expert InferenceMixed-Precision Quantization

  48. Federation of Experts: Communication Efficient Distributed Inference for Large Language Models

    May 7, 2026Muhammad Shahir Abdurrahman, Chun Deng, Azalia Mirhoseini +1Mixture-Of-Expert InferenceLLM Inference Efficiency

  49. Relay Buffer Independent Communication over Pooled HBM for Efficient MoE Inference on Ascend

    May 7, 2026Tianlun Hu, Tiancheng Hu, Shengsheng Litang +8Mixture-Of-Expert InferenceWorkload

  50. Expert Routing for Communication-Efficient MoE via Finite Expert Banks

    May 6, 2026Mohammad Reza Deylam Salehi, Ali KhalesiMixture-Of-Expert InferenceMixture-of-Experts Models

  51. Piper: Efficient Large-Scale MoE Training via Resource Modeling and Pipelined Hybrid Parallelism

    May 6, 2026Sajal Dash, Feiyi WangMixture-Of-Expert InferenceHigh-Performance Computing

  52. AxMoE: Characterizing the Impact of Approximate Multipliers on Mixture-of-Experts DNN Architectures

    May 6, 2026Omkar B Shende, Marcello Traiola, Gayathri AnanthanarayananMixture-Of-Expert InferenceGraph Neural Network Inference

  53. MoE-Prefill: Zero Redundancy Overheads in MoE Prefill Serving

    May 3, 2026Zhaoyuan Su, Olatunji Ruwase, Karthik Ganesan +5Mixture-Of-Expert InferencePrefill

  54. SpaceMoE: Realizing Distributed Mixture-of-Experts Inference over Space Networks

    May 1, 2026Zhanwei Wang, Huiling Yang, Min Sheng +2Mixture-Of-Expert InferenceMixture-of-Experts Models

  55. Prediction-powered Inference by Mixture of Experts

    Apr 30, 2026Yanwu Gu, Linglong Kong, Dong XiaMixture-Of-Expert InferenceProbabilistic Inference

  56. RaMP: Runtime-Aware Megakernel Polymorphism for Mixture-of-Experts

    Apr 28, 2026Vyom Sharma, Debajyoti DattaMixture-Of-Expert InferenceMixture-of-Experts Models

  57. Scaling Multi-Node Mixture-of-Experts Inference Using Expert Activation Patterns

    Apr 25, 2026Abhimanyu Bambhaniya, Geonhwa Jeong, Jason Park +6Mixture-Of-Expert InferenceMixture-of-Experts Models

  58. MISTY: High-Throughput Motion Planning via Mixer-based Single-step Drifting

    Apr 23, 2026Yining Xing, Zehong Ke, Yiqian Tu +3Diffusion PlanningMotion Planners

  59. Efficient Mixture-of-Experts LLM Inference with Apple Silicon NPUs

    Apr 20, 2026Afsara Benazir, Felix Xiaozhu LinNeural Processing UnitsMixture-Of-Expert Inference

  60. MACS: Modality-Aware Capacity Scaling for Efficient Multimodal MoE Inference

    Apr 19, 2026Bo Li, Chuan Wu, Shaolin ZhuMixture-Of-Expert InferenceMultimodal Benchmarks