Prefill-Decode Disaggregation

Ask about this topic

Latest papers

CardsList

14 papers2 papers in the last four weeks, down 50% on the four weeks before. 0.0% of all new papers.

  1. DolphinRouting: Cluster-Level Binary Routing for Disaggregated LLM Inference Serving

    Oct 29, 2026Yishuo Yuan, Shaoyu Yang, Chunrong FangDisaggregated LLM ServingLLM Routing

    Nanjing University, Nanjing, China.

  2. Prorsa: Unleashing the Potential of Prefill-Decode Disaggregation in Agentic Reinforcement Learning

    Oct 12, 2026Chiheng Lou, Xiangwei Deng, Bangjun Xiao +4Prefill-Decode DisaggregationAgentic RL

    †School of Computer Science, Peking University · ‡LLM-Core Xiaomi

  3. FluidPD: In-Place Elasticity for SLO-Aware Prefill-Decode Disaggregated LLM Serving

    Oct 2, 2026Kartik Ramesh, Kaidi Fu, Zihan Zheng +4LLM ServingPrefill-Decode Disaggregation

    University of Illinois Urbana-Champaign · IBM Research

  4. PEARL: Adaptive Prefill-Decode Execution with Elasticity for Agentic Reinforcement Learning

    Sep 28, 2026Jiaan Zhu, Wei Gao, Youhui Bai +6Agentic RLAsynchronous RL

    USTC China

  5. Crossflow: Prefill-Decode Elasticity for Agentic LLM Serving

    Sep 22, 2026Yi Xu, Ehsan K. Ardestani, Wenyin Fu +7Disaggregated LLM ServingLLM Inference Scheduling

    Meta Platforms

  6. Disaggregated Quantization: Specializing LLM Prefill and Decode

    Sep 22, 2026Andrei Panferov, Maximilian Kleinegger, Sweta Priyadarshi +2LLM QuantizationLLM Inference

    NVIDIA · ISTA

  7. Towards Load-Aware Prefill Deflection for Disaggregated LLM Serving

    Jul 2, 2026Shrikara Arun, Anjaly Parayil, Srikant Bharadwaj +2LLM ServingPrefill-Decode Disaggregation

    Microsoft

  8. Prefill/Decode-Aware Evaluation of LLM Inference on Emerging AI Accelerators

    Jun 14, 2026Shun Usami, Venkatram Vishwanath, E. Wes BethelAI Accelerator InferenceLLM Inference

    Department of Computer Science San Francisco State University San Francisco, CA, 94132 · Argonne National Laboratory Lemont, IL, 60439 · Lawrence Berkeley National Laboratory Berkeley, CA, 94720

  9. Prefilling-dLLM: Predictive Prefilling for Long-Context Inference in Diffusion Language Models

    Jun 9, 2026Jing Xiong, Qi Han, Shansan Gong +5Lost-in-the-Middle EffectPrefill-Decode Disaggregation

    The University of Hong Kong · University of Michigan, Ann Arbor · LMSYS Org

  10. Achieving Cloud-Grade SLOs for Local Mixture-of-Experts Inference through CPU-GPU Hybrid Design

    Jun 9, 2026Wenxin Wang, Yule Hou, Yu Ji +2Expert ParallelismOn-Device Language Model Inference

    1Tsinghua University · 2Xingyun Integrated Circuits Co., Ltd. · 3Beijing National Research Center for Information Science and Technology

  11. SpectrumKV: Per-Token Mixed-Precision KV Cache Transfer for Prefill-Decode Disaggregated LLM Serving

    Jun 7, 2026Yang PengjuMixed-Precision QuantizationPrefill-Decode Disaggregation

  12. E2LLM: Towards Efficient LLM Serving in Heterogeneous Edge/Fog Environments

    Jun 2, 2026Truong-Thanh Le, Amir Taherkordi, Hoang-Loc La +3LLM ServingPrefill-Decode Disaggregation

    Department of Informatics University of Oslo Oslo, Norway · Department of Computer Science UiT The Arctic University of Norway Tromsø, Norway

  13. SplitZip: Ultra Fast Lossless KV Compression for Disaggregated LLM Serving

    May 3, 2026Yipin Guo, Siddharth JoshiKV-Cache CompressionLLM Serving

    University of Notre Dame IN, USA

  14. SLO-Aware Compute Resource Allocation for Prefill-Decode Disaggregated LLM Inference

    Mar 5, 2026Luchang Li, Dongfang Li, Bozhao Gong +1Disaggregated LLM ServingPrefill-Decode Disaggregation

    Kingsoft Cloud