Key-Value Cache

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-14

13 new papers

A weekly snapshot of new work published in Key-Value Cache.

Period ending 2026-09-07

16 new papers

A weekly snapshot of new work published in Key-Value Cache.

Inside this field

Focused directions

397 papers

Latest in Key-Value Cache

Open your feed →
CardsList

  1. Validating Hybrid-State Cache Recovery for GLM-5.3-Flash with vLLM and LMCache

    Sep 14, 2026Frank LiIntermediate CheckpointsCache

  2. Shared KV Caching for Replicated 27B Inference: Correctness Failures and Performance Boundaries

    Sep 14, 2026Frank LiKv-Cache SteeringGraphics Processing Unit Memory

  3. FlexComp: One Model for Every Ratio in Context Compression

    Sep 11, 2026Kaiyan Zhao, Zhongtao Miao, Akiko Aizawa +1Model and Context CompressionEfficient Long-Context Inference

  4. Building py-kvcache: A Performance Characterization of External KV Caching for vLLM with NVMe SSDs

    Sep 11, 2026Joseph Kanichai, Tiziano De Matteis, Animesh TrivediKv-Cache SteeringKey-Value Cache

  5. OmniKVQuant: KV Cache Quantization for Omni-LLMs

    Sep 11, 2026Suho Yoo, Hyunjong Ok, Jongmin Choi +2Key-Value Cache QuantizationLarge Language Model Quantization

  6. K/V-Cache Interventions Dissociate Representation Alignment from Persona Expression in Decoder-Only Language Models

    Sep 11, 2026Yu Sun, Mengyin Lu, Cong Feng +2Kv-Cache SteeringPersonas

  7. Composable CXL Memory as a Kubernetes-Native Shared Memory for LLM Serving

    Sep 9, 2026Hongjian Fan, Kevin Zhang, David Habinsky +1Kv-Cache SteeringKubernetes

  8. TRACE: Trajectory-robust Admission with Evidence Ordering for Efficient GUI Agents

    Sep 9, 2026Yuhao Wang, Mu Qiao, Xindong Zhang +3Visual Token PruningTraces

  9. KVShareArena: KV-Cache Reuse Across Contexts and Model Checkpoints

    Sep 9, 2026Xi Shi, Qian LouKv-Cache SteeringRetrieval Benchmarks

  10. Fine-Tuning a KV Cache Concatenation-Aware Model or Recomputing KV Caches? Why Not Both?

    Sep 9, 2026Fumihiko Tachibana, Daisuke Miyashita, Jun DeguchiKv-Cache SteeringKey-Value Cache

  11. BIO-MEMART: Biometric-Aware KV Cache Memory for Multi-User LLM Agents

    Sep 8, 2026Yanhong Qian, Xuanying He, Qingguo Meng +3Kv-Cache SteeringKey-Value Cache

  12. What Eviction Destroys: A Restore-Counterfactual Audit of Forgetting in Agent Memory

    Sep 8, 2026Chen ShenEvictionAgent Memory

  13. Jacap: Robust KV Cache Eviction via Jacobian-Based Nonlinear Information Capacity Preservation

    Sep 8, 2026Jiaming Yang, Chenwei Tang, Liangli Zhen +2Key-Value Cache EvictionCatastrophic Forgetting

  14. MetaKV: Adaptive KV Cache Compression for Constrained LLM Inference

    Sep 7, 2026Michael Wang, Keith Li, Roozbeh BostandoostKey-Value Cache CompressionLLM Inference Efficiency

  15. No-Regret Mixing of LRU and LFU with Optimal Switching Cost

    Sep 7, 2026Younes Ben Mazziane, Xinying ZouEvictionLinear Regret

  16. Why Gated DeltaNet Survives 4-Bit Quantization: NVFP4 W4A4 for the Recurrent Half of a Hybrid 27B LLM

    Sep 3, 2026Sergii Kozyrev, Davyd MaiborodaLarge Language Model QuantizationFp8

  17. VestigeKV: The NoPE-MLA KV Cache Carries Its Own Sparse-Attention Signal in a Vestigial Branch

    Sep 3, 2026WenJie FanKey-Value CacheCache

  18. What Matters for Aggressive Decoding-Time KV Eviction? Temporal Aggregation and Ranking Preservation

    Sep 3, 2026Bo Zeng, Yu Zhao, Yefeng Liu +3Key-Value Cache CompressionKey-Value Cache Eviction

  19. Random Attention: Rethinking KV Cache Eviction for Efficient Reasoning

    Sep 3, 2026Heng Wang, Jielin Qiu, Wenting Zhao +7Key-Value Cache EvictionKey-Value Cache

  20. SGD-KV: Summarization Guided KV Cache Compression

    Sep 3, 2026Zeyu Liu, Woomin Song, Xuandi Fu +5Key-Value Cache CompressionEfficient Long-Context Inference

  21. LeanStream: A Speculate-and-Refine Streaming Framework for Efficient on-Device LLM Inference

    Sep 2, 2026Renyuan Liu, Yuyang Leng, Kaiyan Liu +7LLM Inference EfficiencyStreaming

  22. HeadWiseKV: Budgeted Per-Head Cache Residency for Hybrid Long-Context Language Models

    Sep 2, 2026Renjie Xie, Juncheng Yang, Aoting Hu +4Efficient Long-Context InferenceKey-Value Cache

  23. mzCache: On-Device LLM Memory Management under Multitasking

    Sep 1, 2026Hongseung Yu, Minsung Kim, Jongseok Park +1LLM Inference EfficiencyLarge Language Model Memory

  24. Invalidation Contracts for Cross-Episode Agent Memory

    Aug 31, 2026Michael Wu, Arquimedes CanedoState DriftEviction

  25. Faithfulness Is Not Free: Auditing Offline KV-Cache Quantization in Retrieval-Augmented Generation

    Aug 31, 2026Atta Ul Asad, Ahsan Bilal, Muhammad Ali +2Key-Value Cache QuantizationQuantization

  26. A Universal Context-Reuse Layer for Cross-Model KV Sharing

    Aug 31, 2026Yi Li, Dongming Jiang, Yi Zhao +1Kv-Cache SteeringKey-Value

  27. What It Costs to Compose, Rebuild, and Correct Precomputed Memory

    Aug 31, 2026Asa ShepardLarge Language Model MemoryPrefill

  28. Event-Driven Language Models with Sparse Neural Activity for Neuromorphic Hardware

    Aug 31, 2026Simon Richter, Ruhai Lin, Jason Yik +4Dynamic Sparse AttentionNeuromorphic Hardware

  29. Tail-Replay: Escaping the Curse of Linear Attention in Prefix Caching for Hybrid LLMs

    Aug 31, 2026Yirui Liu, Ruoling Qi, Xuaner Wu +2Efficient Long-Context InferenceCache

  30. CateKV: On Sequential Consistency for Long-Context LLM Inference Acceleration

    Aug 31, 2026Haoyun Jiang, Haolin Li, Jianwei Zhang +7Efficient Long-Context InferenceLLM Inference Efficiency

  31. Budget-Aware Compression Pipeline for Single-GPU LLM Inference: Methods, Trade-offs, and Coupling Effects

    Aug 30, 2026Hongyu Yu, Yifei ShenLarge Language Model CompressionLLM Inference Efficiency

  32. RegionCache: Semantic-Aware Region Reuse for Efficient Multi-Turn Image Generation

    Aug 30, 2026Peizheng Li, Xin Ai, Hanyuan Liu +2Diffusion EditingImage Editing

  33. Accelerating Unified Multimodal Models with Core-Expansion Routing and Unified Computation Scheduling

    Aug 29, 2026Wengyi Zhan, Chenqian Yan, Songwei Liu +2Cache

  34. TwinKV: A Composable Repair Pass for KV Cache Eviction via Pairwise Key Redundancy

    Aug 27, 2026Hong Chen, Yudong Zeng, Yongwei Huang +4Key-Value Cache EvictionCache

  35. vToken: Token-Level Virtualization for Reclaimable KV Caches

    Aug 13, 2026Yuanhang Gao, Xiangrui Yang, Yuanfeng Chen +4Key-Value CacheGraphics Processing Unit Memory

  36. LipCache: A Local Inference Proxy with Certified Caching for Edge Image Classification Service

    Aug 13, 2026Zhengzhe Xiang, Yinlin Chen, Fuli Ying +3CacheImage Classification

  37. From Local Mismatch to Global Impact: Optimizing Cache Reuse Policy for Efficient Diffusion

    Aug 13, 2026Xichen Ye, Yifan Wu, Zhikang Xie +3Diffusion ModelsDenoising Trajectory

  38. QV-PIC: Query-Aware Visual Position-Independent Caching for Efficient RAG Serving

    Aug 12, 2026Yilin Liu, Rui Meng, Wangze Ni +5Retrieval-Augmented GenerationComposed Image Retrieval

  39. Keep the Future, Drop the Rollout: RIFT for World Action Models

    Aug 12, 2026Chushan Zhang, Jinguang Tong, Xuesong Li +2Reinforcement Learning RolloutsWorld Models

  40. ImpactHO: Importance-Aware KV Cache Transfer for Multi-User Edge LLM Handover

    Aug 11, 2026Minwoo Kim, Soochang Song, Namyoon Lee +2Key-Value CacheWireless Resource Allocation

  41. KVDiagnosis: A Diagnostic Benchmark for KV-Cache Compression in Long-Context Language Models

    Aug 10, 2026Chen Qiu, Ziwu Liu, Chao Fei +2Key-Value Cache CompressionDiagnostic Benchmark

  42. BAG: Budget-Aware Gating for Diffusion Caching

    Aug 10, 2026Tong Zhao, Mingkun Lei, Yucheng Han +1Diffusion TransformersCache

  43. Governing the KV Cache: Preventing Timing Side-Channel Leakage in Multi-Tenant LLM Inference

    Aug 10, 2026Tejasvi C. AddagadaKv-Cache SteeringKey-Value Cache

  44. DistillCache: KL-Guided Adaptive KV-Cache Eviction for Memory-Efficient LLM Inference

    Aug 9, 2026Asaad AlthoubiKey-Value Cache EvictionLarge Language Model Memory

  45. RippleKV: Cross-Layer KV Cache Allocation via Perturbation Propagation

    Aug 9, 2026Dongjie Xu, Kai Qian, Julius +6Key-Value Cache CompressionKey-Value Cache

  46. VoxZip: Semantic-Anchored Temporal KV Cache Compression for Long-Context Audio Inference

    Aug 9, 2026Wenxu Jia, Dongjie Fu, Xize Cheng +6Audio TokensKey-Value Cache Compression

  47. Archer: Adaptive Reuse of Cached Hidden States for Efficient Rollback in Diffusion Language Models

    Aug 8, 2026Xuning He, Zinan Sheng, Yongding Tao +4Diffusion Language ModelsRollback

  48. RotaryQuant: Fitting 120B MoE Models on Consumer Hardware via Fused Compressed-Space Attention

    Aug 8, 2026Anthony. Lui, Mohamed. Elsaied, N. P. SavaniMixed-Precision QuantizationCold Mixture-Of-Expert Models

  49. KGCache: Amortized Subgraph Retrieval for KG Reasoning with LLMs

    Aug 8, 2026Uros Stanic, Changcheng Yuan, Sabuj Laskar +1Knowledge GraphsKv-Cache Steering

  50. SPECTRA: Pushing the KV Cache Beyond the 2-Bit Cliff via Spectral Transform Coding

    Aug 8, 2026Jiamu Zhang, Liang Wu, Kelly Wan +2Key-Value CacheCache

  51. CommitKV: Lifecycle-Aware KV Cache Compression via Commit Transitions for Multi-Turn Agents

    Aug 8, 2026Weizhong Huang, Jinchao Zhang, Xiawu ZhengKey-Value Cache CompressionKey-Value Cache

  52. CoinRAG: Contextualized Information Nugget KV Cache Reuse for Long-Context RAG

    Aug 7, 2026Gyuwan Kim, Cheoneum Park, Tao YangRetrieval-Augmented GenerationCache

  53. Blast Radius

    Aug 7, 2026MY Pitsane, Hope MogaleEviction

  54. Every Cache Entry Earns Its Place: Global Allocation of Resolution and Coverage for KV Cache Compression

    Aug 7, 2026Haolin Tian, Yuzhe Liu, Tonghan WangKey-Value Cache CompressionGraphics Processing Unit Memory

  55. Test-Time Adaptation with Online Personalized Energy-Based Cache for Fine-Grained Video Expression Recognition

    Aug 6, 2026Masoumeh Sharafi, Muhammad Osama Zeeshan, Soufiane Belharbi +3Facial Expression RecognitionTest-Time Adaptation

  56. Runtime Observability for Heterogeneous Attention Memory

    Aug 6, 2026Fanzhe Wei, Li Liu, Ziyang Wang +1Intermediate CheckpointsKey-Value Cache

  57. DG-FedReuse: Proxy-Gradient-Gated Cached-Update Reuse with Matched Sparse Uplink Accounting

    Aug 5, 2026Rahil Aftab, Vineet Kumar Rakesh, Soumya Mazumdar +1FedavgFederated Averaging

  58. QEvict: Recoverable Quantized KV Eviction for Attention-Drift-Robust Long-Context Decoding

    Aug 5, 2026Ayushman Garg, Akshita Gupta, Shaswata Bhattacharya +3Key-Value Cache EvictionKey-Value

  59. When Does Latent Communication Pay? A Causal Audit of Relayed KV Caches in Multi-Agent LLMs

    Aug 5, 2026Jiaming Cheng, Subhransu Das, Rajiv RamnathMulti-Agent Large Language Model SystemsKey-Value Cache

  60. Fewer Tokens, Smaller Cache: Reward-Coordinated Efficient Reasoning

    Aug 5, 2026Qiyuan Zhu, Dezhi Li, Pengyu Cheng +8Large Reasoning ModelsProcess Reward Modeling