KV Caching

KV: Key-Value

Ask about this topic

Momentum

29 papers in the last four weeks, up 16% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 276

All topics
CardsList

  1. GSRQ: Gain-Shape Residual Quantization for Sub-1-bit KV Cache

    Jul 1, 2026Soosung Kim, Minjae Park, Eui-Young Chung +1LLM CompressionResidual VQ

    Department of Electrical and Electronic Engineering, Yonsei University, Seoul, Republic of Korea · Department of Systems Semiconductor Engineering, Yonsei University, Seoul, Republic of Korea

  2. MosaicKV: Serving Long-Context LLM with Dynamic Two-D KV Cache Compression

    Jul 1, 2026Sheng Qiang, Ruiwei Chen, Yinpeng Wu +5KV CachingLong-Context Language Model Inference

    Institute of Parallel and Distributed Systems, Shanghai Jiao Tong University, Shanghai, China

  3. From Tensor Buffer to Distributed Memory Hierarchy: A Survey of KV Cache Management for LLM Serving

    Jun 30, 2026Jie Li, Tongyang Wang, Yong ChenLLM Inference EfficiencyLLM Serving

    Texas Tech University, Department of Computer Science, Lubbock, Texas, USA

  4. RaBitQCache: Rotated Binary Quantization for KVCache in Long Context LLM Inference

    Jun 30, 2026Wenhao Li, Jinhao Dong, Hailin Zhang +3KV CachingLong-Context Language Model Inference

    School of Information, Renmin University of China, Beijing, China · Peking University, Beijing, China

  5. SeKV: Resolution-Adaptive KV Cache with Hierarchical Semantic Memory for Long-Context LLM Inference

    Jun 30, 2026Amirhossein Abaskohi, Giuseppe Carenini, Peter West +1KV-Cache OffloadingKV Caching

    University of British Columbia · Microsoft Research

  6. HARD-KV: Head-Adaptive Regularization for Decoding-time KV Compression

    Jun 27, 2026Yuxuan Yang, Feiyang Ren, Bowen Zeng +4KV CachingLong-Context Language Model Inference

    The State Key Laboratory of Blockchain and Data Security, Zhejiang University

  7. Affix Cache for Diffusion Large Language Models

    Jun 26, 2026Kaihua Liang, An Zhong, Xin Tan +4KV CachingMemory-Efficient Inference

    KAUST · CUHK · LUMS

  8. Information-Aware KV Cache Compression for Long Reasoning

    Jun 25, 2026Jushi Kai, Zhuiri Xiao, Alexandra Birch +1KV CachingLong-Context Language Model Inference

    LUMIA Lab, School of Artificial Intelligence, Shanghai Jiao Tong University · Shanghai Jiao Tong University · School of Informatics, University of Edinburgh

  9. ProtoKV: Streaming Video Understanding under Delayed Query with Summary-State Memory

    Jun 25, 2026Le Tu Ngoc Minh, Jinyeong Lim, Dongsu HanStreaming Video UnderstandingKV Caching

    KAIST · School of Electrical Engineering, KAIST, Daejeon, Republic of Korea · Kim Jaechul Graduate School of AI, KAIST, Daejeon, Republic of Korea

  10. PersistentKV: Page-Aware Decode Scheduling for Long-Context LLM Serving on Commodity GPUs

    Jun 25, 2026Muhammad AhmedLLM ServingGPU Kernel Optimization

  11. Position Rebinding Cache Reuse: Replay-Free Visual Revisiting for Interleaved Multimodal Reasoning

    Jun 25, 2026Mengzhao Wang, Yanli Ji, Wangmeng Zuo +2Efficient Multimodal InferenceKV Caching

    Sun Yat-sen University · Shenzhen Loop Area Institute · Harbin Institute of Technology (HIT) +3

  12. EpiKV: Epiphany-Aware KV Cache Eviction Without the Attention Matrix

    Jun 25, 2026Steven Kolawole, Virginia SmithKV CachingKV-Cache Eviction

    Language Technologies Institute Carnegie Mellon University · Machine Learning Department Carnegie Mellon University

  13. CrossPool: Efficient Multi-LLM Serving for Cold MoE Models through KV-Cache and Weight Disaggregation

    Jun 23, 2026Zhuoren Ye, Tianyu Wo, Dinghao Xue +4Mixture-of-Experts Language ModelsLLM Serving

    School of Software, Beihang University

  14. CompressKV: Semantic-Retrieval-Guided KV-Cache Compression for Resource-Efficient Long-Context LLM Inference

    Jun 23, 2026Xiaolin Lin, Jingcun Wang, Olga Kondrateva +3LLM Inference EfficiencyKV Caching

    Technical University of Darmstadt, Darmstadt, Germany · University of Notre Dame, Notre Dame, IN, USA · Technical University of Ilmenau, Ilmenau, Germany

  15. RoPE-Aware Bit Allocation for KV-Cache Quantization

    Jun 23, 2026Fengfeng Liang, Yuechen Zhang, Jiaya JiaKV CachingLLM Inference Acceleration

    1Hong Kong University of Science and Technology · 2The Chinese University of Hong Kong · 3MiMo, Xiaomi Corporation

  16. Forget Without Compromise: Nexus Sampling for Streaming KV-Cache Eviction Under Fixed Budgets

    Jun 22, 2026Duc Duong, Hoang Anh Duy Le, Jianwen Xie +2KV CachingLong-Context Language Model Inference

    Department of Computer Science, Grinnell College · Department of Computer Science, Rice University · Lambda, Inc +1

  17. Kamera: Unified Position-Invariant Multimodal KV Cache for Training-Free Reuse

    Jun 22, 2026Bole Ma, Jan Eitzinger, Harald Koestler +1Efficient Multimodal InferenceKV Caching

  18. Keyless Attention: Value-Space Routing and Value-Only Caching for Efficient Transformers

    Jun 20, 2026Xin GaoTransformer InferenceKV Caching

    Department of Mathematics and Statistics York University Toronto, M3J 1P3

  19. Recency/Frequency Adaptive KV Caching for Large Language Model Serving

    Jun 19, 2026Yang Shen, Meghana Madhyastha, Robert Underwood +2LLM ServingKV Caching

    Department of Computer Science, Johns Hopkins University, Baltimore, USA

  20. AnchorKV: Safety-Aware KV Cache Compression via Soft Penalty with a Refusal Anchor

    Jun 16, 2026Ning Ni, Yingjie LaoKV CachingLLM Safety Alignment

    Department of Computer Science Tufts University · Department of Electrical and Computer Engineering Tufts University

  21. KVEraser: Learning to Steer KV Cache for Efficient Localized Context Erasing

    Jun 15, 2026Mufei Li, Shikun Liu, Dongqi Fu +5KV CachingLong-Context Language Model Inference

    Georgia Institute of Technology · Meta

  22. QK-Normed MLA: QK normalization without full key caching

    Jun 15, 2026Yizhou Han, Yao Zhao, Jun Zhou +2KV CachingTransformer Attention

    School of Data Science, The Chinese University of Hong Kong, Shenzhen.

  23. Ablation, Statistical Inference, and Validation for KV-Cache Compression

    Jun 14, 2026Paolo D'Alberto, Ashish Siarasao, Elliott Delaye +1KV CachingRotation-Based Quantization

    Advanced Micro Devices, Inc.

  24. Models Take Notes at Prefill: KV Cache Can Be Editable and Composable

    Jun 14, 2026Bojie LiKV CachingKV-Cache Management

    Pine AI

  25. Exploring a Layer-Wise Design Space for KV Cache Eviction

    Jun 13, 2026Chao Fei, Kaihua Liang, Hanzhi Hu +4KV CachingKV-Cache Eviction

    King Abdullah University of Science and Technology · Fudan University

  26. Can I Buy Your KV Cache?

    Jun 11, 2026Luoyuan ZhangLLM Inference EfficiencyKV Caching

    Harbin Institute of Technology, Shenzhen (HITSZ)

  27. MiniPIC: Flexible Position-Independent Caching in <100LOC

    Jun 11, 2026Nathan Ordonez, Thomas ParnellLLM Inference EfficiencyKV Caching

    IBM Research · IBM Research Zurich, Switzerland

  28. Last But Not Least: Boundary Attention CalibratiON for Multimodal KV Cache Compression

    Jun 10, 2026Tianhao Chen, Yuheng Wu, Kelu Yao +3KV CachingMultimodal Large Language Models

    KAIST · Zhejiang Laboratory · The Chinese University of Hong Kong +1

  29. ReasonAlloc: Hierarchical Decoding-Time KV Cache Budget Allocation for Reasoning Models

    Jun 9, 2026Wenhao Liu, Hao Shi, Yunhe Li +7KV CachingMemory-Efficient Optimization

    1Tsinghua University · 2City University of Hong Kong · 3Peking University +2

  30. FadeMem: Distance-Aware Memory Consolidation for Autoregressive Video Diffusion

    Jun 9, 2026Yu Lu, Junjie Yang, Piotr Koniusz +2KV CachingLong-Horizon Video Generation

    Zhejiang University · University of New South Wales (UNSW) · Data61/CSIRO +1