KV-Cache Pruning

Ask about this topic

Momentum

3 papers in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 27

All topics
CardsList

  1. Dual-QK: Sharp Queries and Flat Keys for Prunable 2-bit KV Caches

    Oct 7, 2026Sunjoo Whang, Jungjun Oh, Minsung Kim +5KV-Cache CompressionKV-Cache Quantization

    KAIST · GIST · Google Research

  2. A Self-Pruning Transformer: Extreme KV-Cache Compression with Universal Attention

    Oct 6, 2026Davis Wertheimer, Haochen Shen, Ahan Gupta +6KV-Cache CompressionTransformer Attention

    IBM Research, USA · SSAIL Lab, University of Illinois Urbana-Champaign

  3. EchoPress: Query-Agnostic KV Cache Pruning via Virtual Context Reconstruction

    Sep 30, 2026Jiawei Lin, Saibo Geng, Thomas BourgeatKV-Cache ManagementLLM Inference Acceleration

    EPFL

  4. DeCoPrune: Efficient KV-Cache Pruning for Autoregressive Video Diffusion via Denoising Consistency

    Sep 30, 2026Zeqi Xiao, Qingle Liu, Kaiwen Zhang +3KV-Cache ManagementAutoregressive Video Generation

    Nanyang Technological University · Tsinghua University · Princeton University

  5. Pixel Decodability Is Not a Compression Signal: Causally Evaluating Importance Proxies for Visual KV-Cache Eviction

    Sep 14, 2026Chenyu Zhou, Qiliang Jiang, Shuning Wu +1KV CachingKV-Cache Eviction

    School of Engineering, Institute of Science Tokyo, Japan · College of Control Science and Engineering, Zhejiang University, China · Department of Electrical and Computer Engineering, National University of Singapore

  6. Small Frequency Corrections Can Change What Survives KV Cache Compression

    Aug 27, 2026Hong Chen, Yudong Zeng, Yongwei Huang +5KV CachingKV-Cache Eviction

    The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China · Bosum Institute of Management Science, Shenzhen, China

  7. StepKV: Step-Aware KV Cache Compression for LLM Agents

    Aug 26, 2026Boyu Feng, Jiahong Liu, Yifan Li +7KV CachingKV-Cache Compression

    The Chinese University of Hong Kong · Huawei Technologies Co., Ltd

  8. CommitKV: Lifecycle-Aware KV Cache Compression via Commit Transitions for Multi-Turn Agents

    Aug 8, 2026Weizhong Huang, Jinchao Zhang, Xiawu ZhengKV CachingLLM Agent Memory

    Xiamen University · WeChat AI, Tencent Inc., China

  9. QEvict: Recoverable Quantized KV Eviction for Attention-Drift-Robust Long-Context Decoding

    Aug 5, 2026Ayushman Garg, Akshita Gupta, Shaswata Bhattacharya +3KV CachingLong-Context Language Model Inference

    Mehta Family School of Data Science and Artificial Intelligence, Indian Institute of Technology Roorkee · Yardi School of Artificial Intelligence, Indian Institute of Technology Delhi · Department of Electrical Engineering, Indian Institute of Technology Delhi

  10. TaskPress: Query-Agnostic KV Cache Compression via Task-Guided Pruning

    Aug 4, 2026Wonpyo Park, Seung-won HwangLLM PruningKV Caching

    Seoul National University · Google

  11. Back from the Future: Key-Value Cache Management by Counter-Causal Surprise

    Jul 30, 2026Stephen Gould, Anton van den HengelKV CachingKV-Cache Eviction

    Metacognition AI · Australian National University · Adelaide University

  12. HiKV: Hierarchical Importance-Aware KV Cache with Hardware Acceleration for LLM Decoding

    Jul 24, 2026Chao Fang, Jun Yin, Man Shi +1KV CachingMemory-Efficient Optimization

    ESAT-MICAS, KU Leuven, Leuven, Belgium · UC Berkley, CA, USA

  13. Adaptive Filtering of the KV Cache: Diagnosing and Correcting Structural-Role Bias in LLM Inference

    Jul 14, 2026Soumil MandalKV CachingLong-Context Language Model Inference

    ServiceNow

  14. KVpop -- Key-Value Cache Compression with Predictive Online Pruning

    Jul 6, 2026Lukas Hauzenberger, Niklas Schmidinger, Anamaria-Roberta Hartl +5KV CachingKV-Cache Eviction

    1NXAI · 2Johannes Kepler University Linz, Austria

  15. Precomputing the Future-Offset Average in TriAttention

    Jul 1, 2026Amarnath MukherjeeLLM Inference EfficiencyKV Caching

    Hozhoke, Inc.

  16. EpiKV: Epiphany-Aware KV Cache Eviction Without the Attention Matrix

    Jun 25, 2026Steven Kolawole, Virginia SmithKV CachingKV-Cache Eviction

    Language Technologies Institute Carnegie Mellon University · Machine Learning Department Carnegie Mellon University

  17. IntentKV: Cross-Turn Intent-Aware KV Cache Pruning for Agent Inference

    Jun 6, 2026Junjie Li, Jiong Lou, Jie LiKV CachingKV-Cache Management

    Shanghai Jiao Tong University

  18. CONF-KV: Confidence-Aware KV Cache Eviction with Mixed-Precision Storage for Long-Horizon LLM

    May 24, 2026Yubo Li, Yidi MiaoKV CachingLong-Context Language Model Inference

    Carnegie Mellon University

  19. Adaptive Mass-Segmented KV Compression for Long-Context Reasoning

    May 22, 2026Junzhe Yang, Xiaoyu ShenKV CachingLong-Context Language Model Inference

    Shanghai Jiao Tong University · Institute of Digital Twin, Eastern Institute of Technology, Ningbo

  20. HeatKV: Head-tuned KV-cache Compression for Visual Autoregressive Modeling

    May 14, 2026Jonathan Cederlund, Axel Berg, William Isaksson +3KV CachingVisual Autoregressive Models

    Dept. of Automatic Control, Lund University · Arm

  21. Self-Pruned Key-Value Attention: Learning When to Write by Predicting Future Utility

    May 13, 2026Gergely Szilvasy, Manuel Faysse, Maria Lomeli +5Self-AttentionKV Caching

    Meta FAIR · MICS, CentraleSupélec

  22. Make Each Token Count: Towards Improving Long-Context Performance with KV Cache Eviction

    May 10, 2026Ngoc Bui, Hieu Trung Nguyen, Arman Cohan +1Self-AttentionKV Caching

    Department of Computer Science, Yale University · The Chinese University of Hong Kong

  23. ProxyKV: Cross-Model Proxy Pruning for Efficient Long-Context LLM Inference

    May 9, 2026Junjie Li, Jiong Lou, Jie LiLLM PruningKV Caching

    Shanghai Jiao Tong University

  24. When Does Value-Aware KV Eviction Help? A Fixed-Contract Diagnostic for Non-Monotone Cache Compression

    May 7, 2026Ruijie Zhang, Haozhe Liang, Da Chang +4KV CachingLong-Context Language Model Inference

  25. Benchmarking KV-Cache Optimizations across Task Quality and System Performance for Long-Context Serving

    May 3, 2026Nikita Agrawal, Ruben MayerLLM ServingKV Caching

    University of Bayreuth

  26. DepthKV: Layer-Dependent KV Cache Pruning for Long-Context LLM Inference

    Apr 27, 2026Zahra Dehghanighobadi, Asja FischerLLM PruningKV Caching

    1Ruhr University Bochum · 2UAR Research Center for Trustworthy Data Science and Security

  27. ReFreeKV: Towards Threshold-Free KV Cache Compression

    Feb 24, 2025Xuanfan Ni, Liyan Xu, Chenyang Lyu +6KV CachingMemory-Efficient Optimization

    Nanjing University of Aeronautics and Astronautics · WeChat AI, Tencent · Independent Researcher +1