Key-Value Cache

Ask about this topic

Momentum

30 papers in the last four weeks, up 114% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 163

All topics
CardsList

  1. PatchKV: Weight-Space Compensation of KV Cache

    Sep 30, 2026Chanryeol Lee, Chanhyuk Lee, Yeonwoo Choi +2Key-Value Cache CompressionKey-Value Cache

    KAIST

  2. SPLASH: Switching Parallel Layouts of Attention with Seamless Handoff for LLM Serving

    Sep 29, 2026Chuan Liu, Shuoming Zhang, Zhicheng Li +6Large Language Model ServingKey-Value Cache

    State Key Laboratory of Processors, Institute of Computing Technology, Chinese Academy of Sciences, Beijing, China · University of Chinese Academy of Sciences, Beijing, China

  3. CacheRepair: Learning to Repair Cross-Chunk Context in RAG for KV Cache Fusion

    Sep 28, 2026Genglin Wang, Wangsong Yin, Yeerzhati Abudunuer +3Key-Value CacheCross-Attention

    The Chinese University of Hong Kong · Peking University · The Hong Kong University of Science and Technology

  4. WorldAttention: An Efficient Attention Architecture for Interactive Video World Models

    Sep 28, 2026Zeyu Zhang, Jinyuan Mao, Dakai An +6Video World ModelsDynamic Sparse Attention

    DAMO Academy, Alibaba Group · Zhejiang University · Hong Kong University of Science and Technology +2

  5. KVCMAS: Efficient KV cache Correction for Shared Context in Multi-Agent Systems

    Sep 28, 2026Hyesung Jeon, Hyeongju Ha, Seoyoung Lee +2Kv-Cache ManagementKey-Value Cache

    Department of Electrical and Computer Engineering Seoul National University

  6. PReCache: Efficient KV Cache Sharing for Multi-LoRA Agents via Low-Rank Precomputation and Neutral Reconstruction

    Sep 28, 2026Hyesung Jeon, Hyeongju Ha, Jae-Joon KimKey-Value CacheCache

    Department of Electrical and Computer Engineering Seoul National University

  7. Positions Are Not Facts: The Mismatch Between KV Caches and Memory

    Sep 27, 2026Changhai Zhou, Yuhua Zhou, Shiyang Zhang +5Key-Value CacheLarge Language Model Memory

    Fudan University · Baidu · Zhejiang University +2

  8. PQ-HSA: Reusing Product-Quantized Scores for Hybrid Sparse-Approximate Attention

    Sep 27, 2026Kunming Shao, Jierun Chen, Yanli Wang +4Dynamic Sparse AttentionKey-Value Cache Quantization

    The Hong Kong University of Science and Technology · Huawei Technologies Ltd. · Sun Yat-sen University +1

  9. RelaxKV: Recomputation Guided by the Query with Sparse Context Attention for Efficient KV Cache Reuse

    Sep 27, 2026Ruoling Qi, Yirui Liu, Xuaner Wu +5CacheKey-Value Cache

    Shanghai Jiao Tong University · Institute of Artificial Intelligence, China Telecom (TeleAI) · State University of New York at Buffalo

  10. FoldAttention: Declared-Reference Softmax for Fast Decode and Deterministic Backward

    Sep 27, 2026Sriman AchantaBlock Sparse Flash AttentionAutoregressive Decoding

    Virginia Commonwealth University

  11. In-Flight KV Cache with Clean Anchors for Faster Autoregressive Video Diffusion

    Sep 26, 2026Yikai Wang, Xiao Han, Mengmeng Xu +9Autoregressive Video Diffusion ModelsCache

    Meta · S-Lab, Nanyang Technological University

  12. Prefill-Free Cross-Family KV Cache Transfer for Heterogeneous Multi-Agent LLMs

    Sep 26, 2026Vincent-Daniel Yun, Woosang Lim, Haneul Yoo +3PrefillMulti-Agent Large Language Model Systems

    University of Southern California, USA · Seoul National University, Republic of Korea · New York University, USA

  13. DeltaS: Reading the Gated Linear Attention State for KV Cache Eviction in Streaming Video

    Sep 23, 2026Taeyoun Kwon, Seungjin Kim, Hyeonyu Kim +1Kimi Delta AttentionLinear Attention

    Maum AI Inc. · Seoul National University · Yonsei University

  14. Written as a Record, Read as an Address: What a Forward Pass Leaves in an Operation's KV Cache

    Sep 21, 2026Lingfeng Wu, Behzad ShomaliKeys And ValueKey-Value Cache

    University of Bonn · Lamarr Institute

  15. TierKV: Long-Context On-Device LLMs via Predictive Multi-Tier KV Caching

    Sep 18, 2026Zhihao Shu, Md Musfiqur Rahman Sanim, Jie Hu +4Kv-Cache ManagementDepthweave-Kv

    University of Georgia Athens, GA, USA · Peking University Beijing, China · Western Digital Research San Jose, CA, USA

  16. Marginal utility, matrix factorization, and the Key-Value (KV) cache: a unified information-economic framework for sovereign geo-mining inference

    Sep 17, 2026Caroline Gans CombeGeological Semantic UnderstandingData Mining

    INSEEC · INSEEC Business School / Omnes Education, Paris.

  17. DeepSeek-V4.1-Flash: Pushing the Limits of KV Cache Compression

    Sep 17, 2026DeepSeek-AI, :, Anyi Xu +590Key-Value Cache CompressionKey-Value Cache

  18. D-Quant: Driftable Entropy Coding for KV Cache Quantization

    Sep 17, 2026Yi Su, Hong Liu, Guanghua Yu +1Key-Value Cache QuantizationKey-Value Cache

    Tencent

  19. Ask the Tool, Don't Guess: Agent Tool Calls Hold Their Progress, and the Serving System Should Read It

    Sep 16, 2026Yipeng Liu, Yingqiang Zhang, Feifei Li +1CallKey-Value Cache

    Tsinghua University, China · Alibaba Cloud Computing, China · Zhejiang University, China

  20. MeshKV: A Network-on-Chip KV Cache Fabric for Scalable Transformer Decoding Accelerators

    Sep 16, 2026Dong Liu, Yanxuan YuKey-Value CacheAutoregressive Transformers

    Columbia University New York, NY, USA

  21. Contiguity, Not Importance: Budgeted Repair of Stale KV Caches After Document Edits

    Sep 16, 2026Mingyang Mao, Wyatt Mackey, Xiaomin LinKey-Value CacheMultimodal Knowledge Editing

    University of South Florida, Electrical and Computer Engineering · DEVCOM Army Research Laboratory

  22. The Inference Engineering Pareto Atlas: Which Optimizations Dominate the Cost, Quality, and Latency Frontier?

    Sep 15, 2026Srikanta Datta Tumkur, Jay Iyer, Mehar Simhadri +3LLM Inference OptimizationMatched Fp16 Intermediate

    Vizuara

  23. Shared-Prefix KV Reuse Across Standard LoRA Adapters: Quality and Serving Tradeoffs

    Sep 15, 2026Dushyant RajputKv-Cache ManagementKey-Value Cache

    AltSlate Labs LLP

  24. T-LoopFormer: Token-Level Elastic-Depth Looped Transformers for Latent Reasoning With Dynamic Routing

    Sep 14, 2026Mingqian Yu, Wenpeng Zhang, Peilin ZhaoTransformer ArchitecturesInference Latency

    Institute of Automation Chinese Academy of Sciences Beijing, China · Independent Reasearcher · School of Artificial Intelligence Shanghai Jiao Tong University Shanghai, China

  25. FlexComp: One Model for Every Ratio in Context Compression

    Sep 11, 2026Kaiyan Zhao, Zhongtao Miao, Akiko Aizawa +1Data Compression MethodsKey-Value Cache

    The University of Tokyo · National Institute of Informatics

  26. Building py-kvcache: A Performance Characterization of External KV Caching for vLLM with NVMe SSDs

    Sep 11, 2026Joseph Kanichai, Tiziano De Matteis, Animesh TrivediKv-Cache ManagementKey-Value Cache

    Vrije Universiteit Amsterdam Amsterdam, the Netherlands · IBM Research Zurich Zurich, Switzerland

  27. Composable CXL Memory as a Kubernetes-Native Shared Memory for LLM Serving

    Sep 9, 2026Hongjian Fan, Kevin Zhang, David Habinsky +1Kv-Cache ManagementKey-Value Cache

    Research Group, Seagate Technology, LLC

  28. Fine-Tuning a KV Cache Concatenation-Aware Model or Recomputing KV Caches? Why Not Both?

    Sep 9, 2026Fumihiko Tachibana, Daisuke Miyashita, Jun DeguchiKey-Value CacheCache

    Kioxia Corporation

  29. Grouped Value Attention: Efficient KV Caching via On-Demand Key Reconstruction

    Sep 8, 2026Vishesh Tripathi, Abhay Kumar, Ramsha KhanKey-Value CacheTransformer Architectures

    FrontiersMind

  30. BIO-MEMART: Biometric-Aware KV Cache Memory for Multi-User LLM Agents

    Sep 8, 2026Yanhong Qian, Xuanying He, Qingguo Meng +3Kv-Cache ManagementKey-Value Cache

    Anhui Provincial Key Laboratory of Secure Artificial Intelligence, School of Artificial Intelligence, Anhui University, Hefei 230093, China

  31. VestigeKV: The NoPE-MLA KV Cache Carries Its Own Sparse-Attention Signal in a Vestigial Branch

    Sep 3, 2026WenJie FanKey-Value CacheCache

    Yotta Labs

  32. Random Attention: Rethinking KV Cache Eviction for Efficient Reasoning

    Sep 3, 2026Heng Wang, Jielin Qiu, Wenting Zhao +8Key-Value Cache EvictionKey-Value Cache

    Salesforce AI Research · University of Illinois Urbana-Champaign

  33. HeadWiseKV: Budgeted Per-Head Cache Residency for Hybrid Long-Context Language Models

    Sep 2, 2026Renjie Xie, Juncheng Yang, Aoting Hu +4Efficient Long-Context InferenceKey-Value Cache

    Nanjing University of Posts and Telecommunications · Tylogi AI Lab / TAIL · Anhui University of Technology +2

  34. Faithfulness Is Not Free: Auditing Offline KV-Cache Quantization in Retrieval-Augmented Generation

    Aug 31, 2026Atta Ul Asad, Ahsan Bilal, Muhammad Ali +2Key-Value Cache QuantizationFaithfulness

    1Lahore University of Management Sciences (LUMS) · University of Oklahoma · 3Air University +1

  35. What It Costs to Compose, Rebuild, and Correct Precomputed Memory

    Aug 31, 2026Asa ShepardLarge Language Model MemoryKey-Value Cache

    Department of Computer Science, Williams College

  36. Event-Driven Language Models with Sparse Neural Activity for Neuromorphic Hardware

    Aug 31, 2026Simon Richter, Ruhai Lin, Jason Yik +4Dynamic Sparse AttentionNeuromorphic Computing

    Department of Electrical and Computer Engineering, Aarhus University, Aarhus, Denmark · Department of Computer Science and Engineering, University of California, Santa Cruz, Santa Cruz, USA · School of Engineering and Applied Sciences, Harvard University, Cambridge, USA +1

  37. CateKV: On Sequential Consistency for Long-Context LLM Inference Acceleration

    Aug 31, 2026Haoyun Jiang, Haolin Li, Jianwei Zhang +7Efficient Long-Context InferenceLLM Inference Optimization

    1CMIC, Shanghai Jiao Tong University · 2Alibaba Group · 3Fudan University

  38. DAMP: Decay-Aware Mixed-Precision Recurrent-State Quantization

    Aug 27, 2026Tao Zhang, Jianchao Tan, Pingwei Sun +6Recurrent StateGated Deltanet

    South China University of Technology · Meituan · East China Normal University

  39. Learning how to Forget: Fine-tuning for Long-Context Sparse Attention

    Aug 20, 2026Matthias Seeger, Zeyu Zhang, Vihang Patil +2Dynamic Sparse AttentionEfficient Long-Context Inference

    Amazon Web Services · University of Amsterdam · Amazon +1

  40. WhiteMatter: All-to-All Cross-Layer Connections via KV Source Mixing

    Aug 19, 2026Wenbo Zhang, Xiang RenTransformer ArchitecturesCross-Layer Interactions

    University of Southern California

  41. vToken: Token-Level Virtualization for Reclaimable KV Caches

    Aug 13, 2026Yuanhang Gao, Xiangrui Yang, Yuanfeng Chen +4Kv-Cache ManagementKey-Value Cache

    National University of Defense Technology · Changsha, China · Peking University +1

  42. Keep the Future, Drop the Rollout: RIFT for World Action Models

    Aug 12, 2026Chushan Zhang, Jinguang Tong, Xuesong Li +2World ModelsAutoregressive Rollout

    Australian National University

  43. ImpactHO: Importance-Aware KV Cache Transfer for Multi-User Edge LLM Handover

    Aug 11, 2026Minwoo Kim, Soochang Song, Namyoon Lee +2Kv-Cache ManagementKey-Value Cache

    Department of Electrical Engineering, Pohang University of Science and Technology (POSTECH), Pohang 37673, South Korea · Department of Electrical and Computer Engineering, Ajou University, Suwon 16499, South Korea

  44. Governing the KV Cache: Preventing Timing Side-Channel Leakage in Multi-Tenant LLM Inference

    Aug 10, 2026Tejasvi C. AddagadaKey-Value CacheCache

  45. RippleKV: Cross-Layer KV Cache Allocation via Perturbation Propagation

    Aug 9, 2026Dongjie Xu, Kai Qian, Julius +6Key-Value Cache CompressionKey-Value Cache

    1Soochow University · 2Tencent Inc. · 3The Hong Kong University of Science and Technology +2

  46. Archer: Adaptive Reuse of Cached Hidden States for Efficient Rollback in Diffusion Language Models

    Aug 8, 2026Xuning He, Zinan Sheng, Yongding Tao +4Diffusion Language ModelsDiffusion Models

    School of Computer Science, Shanghai Jiao Tong University · College of Artificial Intelligence, Nankai University · School of Computer Science, Peking University

  47. SPECTRA: Pushing the KV Cache Beyond the 2-Bit Cliff via Spectral Transform Coding

    Aug 8, 2026Jiamu Zhang, Liang Wu, Kelly Wan +2Key-Value CacheCache

    Nokia · Rice University

  48. CommitKV: Lifecycle-Aware KV Cache Compression via Commit Transitions for Multi-Turn Agents

    Aug 8, 2026Weizhong Huang, Jinchao Zhang, Xiawu ZhengKey-Value Cache CompressionDepthweave-Kv

    Xiamen University · WeChat AI, Tencent Inc., China

  49. Runtime Observability for Heterogeneous Attention Memory

    Aug 6, 2026Fanzhe Wei, Li Liu, Ziyang Wang +1Cryptographic Merkle Tree CommitmentsKey-Value Cache

    Metask Lab

  50. When Does Latent Communication Pay? A Causal Audit of Relayed KV Caches in Multi-Agent LLMs

    Aug 5, 2026Jiaming Cheng, Subhransu Das, Rajiv RamnathMulti-Agent Large Language Model SystemsLarge Language Model Memory

    Independent Researcher · The Ohio State University

  51. Cross-Model KV Cache Transfer in LLM Families: A Closed-Form Linear Mapping for Prefill Reuse

    Aug 4, 2026Taekyung Heo, Rasoul Shafipour, Ritchie Zhao +6PrefillKey-Value Cache

    NVIDIA

  52. SAKI: Score-Aware Low-Rank Key Indexing with Random-Matrix Noise Correction for KV Retrieval

    Aug 4, 2026Lin ZhangKey-Value CacheKeys And Value

    Data Science and Platform, Cotality

  53. AnchorKV: Anchor-Residual KV Cache Compression

    Aug 3, 2026Malik Khalaf, Yara Shamshoum, Nitzan Hodos +2Key-Value Cache CompressionKey-Value Cache

    Department of Computer Science, Technion - Israel Institute of Technology

  54. Practical Online KV Cache Compaction for LLM Agents: An Empirical Study

    Aug 2, 2026Yujian Liu, Jiabao Ji, Li An +4Key-Value Cache CompressionCompaction

    UC Santa Barbara · LinkedIn

  55. S4^4R: Selective Sampling, Subspaces, and Sparse Reconstruction for Compressed Long-Context KV Caching

    Aug 1, 2026Jialong Han, You Wu, Kewei TuKey-Value Cache CompressionKey-Value Cache

    School of Information Science and Technology, ShanghaiTech University · Shanghai Engineering Research Center of Intelligent Vision and Imaging

  56. Mixture-of-Translators: Translating KV Caches Across Heterogeneous Large Language Models

    Jul 31, 2026Jin-woo Lee, Minkyung Song, Junghyun Oh +4Key-Value CacheTranslation Quality

    Chungnam National University · KISTI

  57. LinearKV: One Cached State Suffices for Position-Independent Caching in Hybrid LLMs

    Jul 31, 2026Yirui Liu, Ruoling Qi, Longwen Wang +5Kimi Delta AttentionKey-Value Cache

    Institute of Artificial Intelligence, China Telecom (TeleAI) · Shanghai Jiao Tong University · Xi’an Jiaotong University +1

  58. ReToken: One Token to Improve Vision-Language Models for Visual Retrieval

    Jul 30, 2026Yao Xiao, Reuben Tan, Zhen Zhu +3Long Visual-Token SequencesKey-Value Cache

    University of Illinois at Urbana-Champaign · Microsoft Research · Google DeepMind

  59. Stage-Replay Divergence Follows the KV Cache: Fixed-Prefix Precision Controls and Bidirectional Cache Transplantation

    Jul 30, 2026Alexander Boesgaard LorupCacheReplay

    Openhagen

  60. SemPIC: Learning Semantic Position-Independent KV Caches

    Jul 30, 2026Hui Xie, Peng Xiao, Yutong Deng +3Key-Value CacheCache

    Institute of Artificial Intelligence, Beihang University · State Key Laboratory of Complex & Critical Software Environment · Shen Yuan Honors College, Beihang University +1