KV-Cache Reuse

Ask about this topic

Momentum

14 papers in the last four weeks, up 367% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 47

All topics
CardsList

  1. Request Order Matters: Cache-History Sensitivity in Selective KV-Cache Reuse for Rolling Agents

    Oct 5, 2026Tiffany Gu, Annie Guan, Manshu Huang +3KV-Cache ManagementLLM Inference Acceleration

    Capital One · University of Washington

  2. Working Around the Compute Ceiling: Byte-Exact Memory in Galahad Makes LLM Reading a One-Time Cost LLM Reading a One-Time Cost

    Sep 30, 2026Sietse SchelpeLLM ServingLong-Context Language Model Inference

    Corbenic AI

  3. Dynamic Flow, Static Graph: KV Cache Reuse for Efficient LLM Serving on Mobile NPUs

    Sep 28, 2026Zhengxiang Huang, Shengheng Chen, Chaoyue Niu +6AI Accelerator InferenceOn-Device Language Model Inference

    Shanghai Jiao Tong University Shanghai, China · Alibaba Group Hangzhou, China · Alibaba Group Hangzhou, Zhejiang, China

  4. KVCMAS: Efficient KV cache Correction for Shared Context in Multi-Agent Systems

    Sep 28, 2026Hyesung Jeon, Hyeongju Ha, Seoyoung Lee +2Multi-Agent LLM SystemsKV-Cache Management

    Department of Electrical and Computer Engineering Seoul National University

  5. PReCache: Efficient KV Cache Sharing for Multi-LoRA Agents via Low-Rank Precomputation and Neutral Reconstruction

    Sep 28, 2026Hyesung Jeon, Hyeongju Ha, Jae-Joon KimMulti-Agent LLM SystemsMemory-Efficient Inference

    Department of Electrical and Computer Engineering Seoul National University

  6. Thinking Outside the Box: Retention and Transmission of Information in Sliding-Window KV Inference

    Sep 28, 2026Timothy DeLise, Seth CromelinLong-Context Language Model InferenceKV-Cache Reuse

  7. RelaxKV: Recomputation Guided by the Query with Sparse Context Attention for Efficient KV Cache Reuse

    Sep 27, 2026Ruoling Qi, Yirui Liu, Xuaner Wu +5Retrieval-Augmented GenerationKV-Cache Management

    Shanghai Jiao Tong University · Institute of Artificial Intelligence, China Telecom (TeleAI) · State University of New York at Buffalo

  8. In-Flight KV Cache with Clean Anchors for Faster Autoregressive Video Diffusion

    Sep 26, 2026Yikai Wang, Xiao Han, Mengmeng Xu +9Long-Horizon Video GenerationDiffusion Model Caching

    Meta · S-Lab, Nanyang Technological University

  9. Contiguity, Not Importance: Budgeted Repair of Stale KV Caches After Document Edits

    Sep 16, 2026Mingyang Mao, Wyatt Mackey, Xiaomin LinRetrieval-Augmented GenerationKV Caching

    University of South Florida, Electrical and Computer Engineering · DEVCOM Army Research Laboratory

  10. Shared-Prefix KV Reuse Across Standard LoRA Adapters: Quality and Serving Tradeoffs

    Sep 15, 2026Dushyant RajputLLM Inference EfficiencyLLM Serving

    AltSlate Labs LLP

  11. Shared KV Caching for Replicated 27B Inference: Correctness Failures and Performance Boundaries

    Sep 14, 2026Frank LiKV CachingKV-Cache Management

    UNSW Sydney

  12. Composable CXL Memory as a Kubernetes-Native Shared Memory for LLM Serving

    Sep 9, 2026Hongjian Fan, Kevin Zhang, David Habinsky +1LLM Inference EfficiencyKV Caching

    Research Group, Seagate Technology, LLC

  13. KVShareArena: KV-Cache Reuse Across Contexts and Model Checkpoints

    Sep 9, 2026Xi Shi, Mengxin Zheng, Qian LouKV CachingLLM Inference Acceleration

    University of Central Florida

  14. Fine-Tuning a KV Cache Concatenation-Aware Model or Recomputing KV Caches? Why Not Both?

    Sep 9, 2026Fumihiko Tachibana, Daisuke Miyashita, Jun DeguchiRetrieval-Augmented GenerationKV Caching

    Kioxia Corporation

  15. RedKnot-MLA: Multi-Head Offline-Online Reuse for DeepSeek-V4 Long-Context Serving

    Sep 7, 2026Yang Liu, Zhaokai Luo, Huayi Jin +10KV CachingLLM Inference Acceleration

    Xiaohongshu Inc., China · Huawei Cloud · Shanghai Jiao Tong University +2

  16. CacheBridge: Efficient Cross-Model KV Cache Transfer

    Sep 1, 2026Xingyu Qu, Siyuan Lu, Zhiyu Chen +2Transformer InferenceKV Caching

    Westlake University. · †Work conducted during an internship at Westlake University. · Amazon. +1

  17. A Universal Context-Reuse Layer for Cross-Model KV Sharing

    Aug 31, 2026Yi Li, Dongming Jiang, Yi Zhao +1LLM InferenceKV Caching

    University of Texas at Dallas

  18. Governing the KV Cache: Preventing Timing Side-Channel Leakage in Multi-Tenant LLM Inference

    Aug 10, 2026Tejasvi C. AddagadaKV CachingKV-Cache Management

  19. CoinRAG: Contextualized Information Nugget KV Cache Reuse for Long-Context RAG

    Aug 7, 2026Gyuwan Kim, Cheoneum Park, Tao YangLong-Context RetrievalRetrieval-Augmented Generation

    University of California, Santa Barbara · Hanbat National University

  20. Cross-Model KV Cache Transfer in LLM Families: A Closed-Form Linear Mapping for Prefill Reuse

    Aug 4, 2026Taekyung Heo, Rasoul Shafipour, Ritchie Zhao +6KV CachingLLM Inference Acceleration

    NVIDIA

  21. Stage-Replay Divergence Follows the KV Cache: Fixed-Prefix Precision Controls and Bidirectional Cache Transplantation

    Jul 30, 2026Alexander Boesgaard LorupLLM InferenceKV Caching

    Openhagen

  22. SemPIC: Learning Semantic Position-Independent KV Caches

    Jul 30, 2026Hui Xie, Peng Xiao, Yutong Deng +3KV CachingMemory-Efficient Inference

    Institute of Artificial Intelligence, Beihang University · State Key Laboratory of Complex & Critical Software Environment · Shen Yuan Honors College, Beihang University +1

  23. InferScale: GPU-Native KV Injection for Personalized LLM Serving

    Jul 29, 2026Peter Li, Prashant PandeyLLM ServingMemory-Augmented Language Models

    Northeastern University Boston, Massachusetts, USA

  24. Kalypso: Relational LLM Serving

    Jul 26, 2026Hojae Son, Md Ashraful Islam, Huy Gia Cao +2LLM ServingLLM Inference Scheduling

    UMass Amherst, USA

  25. HijackKV: New Threat in Position-Independent KV Cache Reuse

    Jul 22, 2026Yichi Zhang, Zhiqi Wang, Huan Zhang +1KV CachingLLM Security

    The Pennsylvania State University · University of Illinois Urbana-Champaign

  26. C2^2KV: Compressed and Composable KV Cache Reuse for Efficient LLM Inference

    Jul 20, 2026Chuheng Du, Junyi Chen, Hanlin Tang +7KV CachingLLM Inference Acceleration

    School of Computer Science Shanghai Jiao Tong University Shanghai, China · Alibaba Group Hangzhou, China

  27. Smarter and Cheaper at Once: Byte-Exact KV-Cache Grafting Turns a Frozen Small Model into a Verified-Knowledge Flywheel

    Jul 15, 2026Sietse SchelpeMemory-Augmented Language ModelsKnowledge Augmentation for Language Models

    Corbenic AI

  28. How Query Visibility Changes KV-Cache Compression Rankings: A Matched-Budget Audit

    Jul 11, 2026Daming Luo, Christy Liang, Junyu XuanKV CachingKV-Cache Reuse

    University of Technology Sydney

  29. KV-PRM: Efficient Process Reward Modeling via KV-Cache Transfer for Multi-Agent Test-Time Scaling

    Jul 10, 2026Peng Kuang, Haibo Jin, Xiaoyu Han +5Process Reward ModelsKV Caching

    University of Illinois Urbana-Champaign · Imperial College London · City University of Hong Kong

  30. Affix Cache for Diffusion Large Language Models

    Jun 26, 2026Kaihua Liang, An Zhong, Xin Tan +4KV CachingMemory-Efficient Inference

    KAUST · CUHK · LUMS

  31. Position Rebinding Cache Reuse: Replay-Free Visual Revisiting for Interleaved Multimodal Reasoning

    Jun 25, 2026Mengzhao Wang, Yanli Ji, Wangmeng Zuo +2Efficient Multimodal InferenceKV Caching

    Sun Yat-sen University · Shenzhen Loop Area Institute · Harbin Institute of Technology (HIT) +3

  32. Kamera: Unified Position-Invariant Multimodal KV Cache for Training-Free Reuse

    Jun 22, 2026Bole Ma, Jan Eitzinger, Harald Koestler +1Efficient Multimodal InferenceKV Caching

  33. Models Take Notes at Prefill: KV Cache Can Be Editable and Composable

    Jun 14, 2026Bojie LiKV CachingKV-Cache Management

    Pine AI

  34. Can I Buy Your KV Cache?

    Jun 11, 2026Luoyuan ZhangLLM Inference EfficiencyKV Caching

    Harbin Institute of Technology, Shenzhen (HITSZ)

  35. Functional Cache Grafting: Robust and Rapid Code-Policy Synthesis for Embodied Agents

    Jun 11, 2026Saehun Chun, Wonje Choi, Sera Choi +2LLM-Based Program SynthesisAgentic Code Generation

    Department of Computer Science and Engineering, Sungkyunkwan University, Suwon, Republic of Korea.

  36. RKSC: Reasoning-Aware KV Cache Sharing and Confident Early Exit for Multi-Step LLM Inference

    Jun 7, 2026Anirudh SekarLLM Inference EfficiencyKV Caching

    Accepted to the ICML 2026 Workshop on Statistical Frameworks for Uncertainty in Agentic Systems, Seoul, South Korea, 2026.

  37. RedKnot: Efficient Long-Context LLM Serving with Head-Aware KV Reuse and SegPagedAttention

    Jun 4, 2026Yang Liu, ZhaoKai Luo, HuaYi Jin +5LLM ServingKV Caching

    †Xiaohongshu Inc., China · ¶Huawei Cloud · §Peking University

  38. QCFuse: Query-Aware Cache Fusion via Compressed View for Efficient RAG Serving

    Jun 4, 2026Jianxin Yan, Wangze Ni, Zhenxin Li +8Retrieval-Augmented GenerationKV Caching

    Zhejiang University, Hangzhou, China · Ant Group, Shanghai, China · The Hong Kong Polytechnic University, Hong Kong, China +5

  39. LazyAttention: Efficient Retrieval-Augmented Generation with Deferred Positional Encoding

    Jun 3, 2026Haocheng Xia, Mihir Pamnani, Hanxi Fang +2Retrieval-Augmented GenerationKV Caching

    Siebel School of Computing and Data Science, University of Illinois Urbana-Champaign · Nexla · Amazon +1

  40. Stateful Inference for Low-Latency Multi-Agent Tool Calling

    May 25, 2026Victor NorgrenLLM Inference EfficiencyMulti-Agent LLM Systems

    LayerScale, Inc.

  41. ObjectCache: Layerwise Object-Storage Retrieval for KV Cache Reuse

    May 16, 2026Yu Zhu, Aditya Dhakal, Yunming Xiao +2LLM Inference EfficiencyKV-Cache Offloading

    ETH Zurich Switzerland · HPE Labs United States of America · The Chinese University of Hong Kong, Shenzhen China

  42. PEEK: Predictive Queue-Informed KV Cache Management for LLM Serving

    May 10, 2026Bing Xie, Zhipeng Wang, Masahiro Tanaka +1LLM ServingKV Caching

    †Corresponding author.

  43. Efficient Serving for Dynamic Agent Workflows with Prediction-based KV-Cache Management

    May 7, 2026Haoyu Zheng, Fangcheng Fu, Jia Wu +6LLM Inference EfficiencyKV Caching

    Wuhan University · Shanghai Jiao Tong University · Macquarie University +2

  44. When Hidden States Drift: Can KV Caches Rescue Long-Range Speculative Decoding?

    Apr 29, 2026Tianyu Liu, Yuhao Shen, Xinyi Hu +8Speculative DecodingLLM Inference Acceleration

    1Qwen Applications Business Group of Alibaba · University of Science and Technology of China · 3Zhejiang University

  45. PolyKV: A Shared Asymmetrically-Compressed KV Cache Pool for Multi-Agent LLM Inference

    Apr 27, 2026Ishan Patel, Ishan JoshiLLM Inference EfficiencyMulti-Agent LLM Systems

    Independent Researcher

  46. MTServe: Efficient Serving for Generative Recommendation Models with Hierarchical Caches

    Apr 24, 2026Xin Wang, Chi Ma, Shaobin Chen +14KV-Cache OffloadingKV Caching

    School of Computer Science, Wuhan University · Meituan · Nvidia

  47. Predictive Multi-Tier Memory Management for KV Cache in Large-Scale GPU Inference

    Apr 19, 2026Sanjeev Rao GanjihalKV-Cache OffloadingKV Caching

    Independent Researcher