KV-Cache Transfer

Ask about this topic

Latest papers

CardsList

21 papers4 papers in the last four weeks, up 33% on the four weeks before. 0.0% of all new papers.

  1. ARK: Avoiding Routing Collisions for KV Cache Transfer in Disaggregated LLM Inference

    Oct 30, 2026Hung-Chun Lin, Ting-Wei Hsu, Chung-En Ho +1KV-Cache TransferDisaggregated LLM Serving

    Georgia Institute of Technology, Atlanta, GA, USA

  2. PriorityFEC: Deadline-Aware Streaming FEC for KV-Cache Handoff in Edge Multi-Agent Systems

    Oct 15, 2026Han Shen, Qifu Tyler Sun, Fanyang Meng +2KV-Cache TransferKV-Cache Management

  3. CacheLink: Functional KV Transport for Zero-Prefill Cross-Model Context Handoff

    Oct 11, 2026Haomiao Qiu, Yining Tang, Zijia Song +3KV-Cache TransferLLM Serving

    Harbin Institute of Technology, Shenzhen · Great Bay University · Zhejiang University

  4. SAFE-KV: Causal Suffix Repair for Behavior-Preserving Non-Prefix KV Cache Reuse in RAG

    Oct 10, 2026Xingjian ZhangKV-Cache ReuseKV-Cache Transfer

    Carnegie Mellon University, Pittsburgh, PA, USA

  5. KV-Lingo: Learning KV-Cache Translators with Distillation

    Sep 26, 2026Valérie Castin, Keitaro Sakamoto, Anastasiia Filippova +3KV-Cache TransferLLM Inference Acceleration

    Apple

  6. Prefill-Free Cross-Family KV Cache Transfer for Heterogeneous Multi-Agent LLMs

    Sep 26, 2026Vincent-Daniel Yun, Woosang Lim, Haneul Yoo +3Multi-Agent LLM SystemsLLM Inference Acceleration

    University of Southern California, USA · Seoul National University, Republic of Korea · New York University, USA

  7. KVShareArena: KV-Cache Reuse Across Contexts and Model Checkpoints

    Sep 9, 2026Xi Shi, Mengxin Zheng, Qian LouKV CachingLLM Inference Acceleration

    University of Central Florida

  8. CacheBridge: Efficient Cross-Model KV Transfer for Multi-Model LLM Serving

    Sep 1, 2026Xingyu Qu, Siyuan Lu, Zhiyu Chen +2Transformer InferenceKV Caching

    Westlake University. · Wuhan University. · Amazon.

  9. A Universal Context-Reuse Layer for Cross-Model KV Sharing

    Aug 31, 2026Yi Li, Dongming Jiang, Yi Zhao +1LLM InferenceKV Caching

    University of Texas at Dallas

  10. PatchKV: Efficient KV Cache Recovery for Dynamically Edited LLM Contexts

    Aug 18, 2026Guotao Yang, Rui Guo, Siwei He +3KV-Cache ReuseLLM Inference Efficiency

    Tianjin University, China

  11. Pallas: A Proactive KV Cache Migration Framework for LLM Inference in AI-RAN

    Aug 17, 2026Tianhang Ding, Jianchun Liu, Hongli XuKV-Cache TransferLLM Inference Serving

    University of Science and Technology of China

  12. ImpactHO: Importance-Aware KV Cache Transfer for Multi-User Edge LLM Handover

    Aug 11, 2026Minwoo Kim, Soochang Song, Namyoon Lee +2KV-Cache TransferKV Caching

    Department of Electrical Engineering, Pohang University of Science and Technology (POSTECH), Pohang 37673, South Korea · Department of Electrical and Computer Engineering, Ajou University, Suwon 16499, South Korea

  13. Cross-Model KV Cache Transfer in LLM Families: A Closed-Form Linear Mapping for Prefill Reuse

    Aug 4, 2026Taekyung Heo, Rasoul Shafipour, Ritchie Zhao +6KV CachingLLM Inference Acceleration

    NVIDIA

  14. Lynx: Progressive Speculative Quantization for accelerating KV Transfer in Long-Context Inference

    Jul 2, 2026Wenchen Han, Gingfung Matthew Yeung, Marco Barletta +3KV-Cache TransferLLM Inference

    University College London · Huawei

  15. SpectrumKV: Per-Token Mixed-Precision KV Cache Transfer for Prefill-Decode Disaggregated LLM Serving

    Jun 7, 2026Yang PengjuMixed-Precision QuantizationPrefill-Decode Disaggregation

  16. Semantic Cache Distillation: Efficient State Transfer via Reuse and Selective Patching

    Jun 5, 2026Qianli Ma, Zhiqing Tang, Hanshuai Cui +2KV-Cache TransferLLM Serving

    Faculty of Arts and Science, Beijing Normal University, Zhuhai 519087, China · Institute of Artificial Intelligence and Future Networks, Beijing Normal University, Zhuhai 519087, Guangdong, China · School of Artificial Intelligence, Beijing Normal University, Beijing 100875, China +1

  17. Latent Cache Flow: Model-to-Model Communication Without Text

    May 19, 2026Maximillian Rossi, Prajwal Raghunath, Eugene WuKV-Cache TransferKV Caching

    Columbia University

  18. ObjectCache: Layerwise Object-Storage Retrieval for KV Cache Reuse

    May 16, 2026Yu Zhu, Aditya Dhakal, Yunming Xiao +2KV CachingKV-Cache Reuse

    ETH Zurich Switzerland · HPE Labs United States of America · The Chinese University of Hong Kong, Shenzhen China

  19. QKVShare: Quantized KV-Cache Handoff for Multi-Agent On-Device LLMs

    May 5, 2026Pratik Honavar, Tejpratap GVSLMixed-Precision QuantizationKV-Cache Transfer

  20. SplitZip: Ultra Fast Lossless KV Compression for Disaggregated LLM Serving

    May 3, 2026Yipin Guo, Siddharth JoshiKV-Cache CompressionLLM Serving

    University of Notre Dame IN, USA

  21. Knowledge Packs: Zero-Token Knowledge Delivery via KV Cache Injection

    Mar 22, 2026Andrey PustovitKV-Cache TransferKnowledge Augmentation for Language Models

    Independent Researcher