KV-Cache Pruning

Follow this topic Ask about this topic

Momentum

3 papers in the last four weeks, against 2 the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 25

All topics

EchoPress: Query-Agnostic KV Cache Pruning via Virtual Context Reconstruction
Sep 30, 2026Jiawei Lin, Saibo Geng, Thomas BourgeatKV-Cache Management LLM Inference Acceleration
EPFL
DeCoPrune: Efficient KV-Cache Pruning for Autoregressive Video Diffusion via Denoising Consistency
Sep 30, 2026Zeqi Xiao, Qingle Liu, Kaiwen Zhang +3KV-Cache Management Autoregressive Video Generation
Nanyang Technological University · Tsinghua University · Princeton University
Pixel Decodability Is Not a Compression Signal: Causally Evaluating Importance Proxies for Visual KV-Cache Eviction
Sep 14, 2026Chenyu Zhou, Qiliang Jiang, Shuning Wu +1KV Caching KV-Cache Eviction
School of Engineering, Institute of Science Tokyo, Japan · College of Control Science and Engineering, Zhejiang University, China · Department of Electrical and Computer Engineering, National University of Singapore
Small Frequency Corrections Can Change What Survives KV Cache Compression
Aug 27, 2026Hong Chen, Yudong Zeng, Yongwei Huang +5KV Caching KV-Cache Eviction
The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China · Bosum Institute of Management Science, Shenzhen, China
StepKV: Step-Aware KV Cache Compression for LLM Agents
Aug 26, 2026Boyu Feng, Jiahong Liu, Yifan Li +7KV Caching KV-Cache Compression
The Chinese University of Hong Kong · Huawei Technologies Co., Ltd
CommitKV: Lifecycle-Aware KV Cache Compression via Commit Transitions for Multi-Turn Agents
Aug 8, 2026Weizhong Huang, Jinchao Zhang, Xiawu ZhengKV Caching LLM Agent Memory
Xiamen University · WeChat AI, Tencent Inc., China
QEvict: Recoverable Quantized KV Eviction for Attention-Drift-Robust Long-Context Decoding
Aug 5, 2026Ayushman Garg, Akshita Gupta, Shaswata Bhattacharya +3KV Caching Long-Context Language Model Inference
Mehta Family School of Data Science and Artificial Intelligence, Indian Institute of Technology Roorkee · Yardi School of Artificial Intelligence, Indian Institute of Technology Delhi · Department of Electrical Engineering, Indian Institute of Technology Delhi
TaskPress: Query-Agnostic KV Cache Compression via Task-Guided Pruning
Aug 4, 2026Wonpyo Park, Seung-won HwangLLM Pruning KV Caching
Seoul National University · Google
Back from the Future: Key-Value Cache Management by Counter-Causal Surprise
Jul 30, 2026Stephen Gould, Anton van den HengelKV Caching KV-Cache Eviction
Metacognition AI · Australian National University · Adelaide University
HiKV: Hierarchical Importance-Aware KV Cache with Hardware Acceleration for LLM Decoding
Jul 24, 2026Chao Fang, Jun Yin, Man Shi +1KV Caching Memory-Efficient Optimization
ESAT-MICAS, KU Leuven, Leuven, Belgium · UC Berkley, CA, USA
Adaptive Filtering of the KV Cache: Diagnosing and Correcting Structural-Role Bias in LLM Inference
Jul 14, 2026Soumil MandalKV Caching Long-Context Language Model Inference
ServiceNow
KVpop -- Key-Value Cache Compression with Predictive Online Pruning
Jul 6, 2026Lukas Hauzenberger, Niklas Schmidinger, Anamaria-Roberta Hartl +5KV Caching KV-Cache Eviction
1NXAI · 2Johannes Kepler University Linz, Austria
Precomputing the Future-Offset Average in TriAttention
Jul 1, 2026Amarnath MukherjeeLLM Inference Efficiency KV Caching
Hozhoke, Inc.
EpiKV: Epiphany-Aware KV Cache Eviction Without the Attention Matrix
Jun 25, 2026Steven Kolawole, Virginia SmithKV Caching KV-Cache Eviction
Language Technologies Institute Carnegie Mellon University · Machine Learning Department Carnegie Mellon University
IntentKV: Cross-Turn Intent-Aware KV Cache Pruning for Agent Inference
Jun 6, 2026Junjie Li, Jiong Lou, Jie LiKV Caching KV-Cache Management
Shanghai Jiao Tong University
CONF-KV: Confidence-Aware KV Cache Eviction with Mixed-Precision Storage for Long-Horizon LLM
May 24, 2026Yubo Li, Yidi MiaoKV Caching Long-Context Language Model Inference
Carnegie Mellon University
Adaptive Mass-Segmented KV Compression for Long-Context Reasoning
May 22, 2026Junzhe Yang, Xiaoyu ShenKV Caching Long-Context Language Model Inference
Shanghai Jiao Tong University · Institute of Digital Twin, Eastern Institute of Technology, Ningbo
HeatKV: Head-tuned KV-cache Compression for Visual Autoregressive Modeling
May 14, 2026Jonathan Cederlund, Axel Berg, William Isaksson +3KV Caching Visual Autoregressive Models
Dept. of Automatic Control, Lund University · Arm
Self-Pruned Key-Value Attention: Learning When to Write by Predicting Future Utility
May 13, 2026Gergely Szilvasy, Manuel Faysse, Maria Lomeli +5Self-Attention KV Caching
Meta FAIR · MICS, CentraleSupélec
Make Each Token Count: Towards Improving Long-Context Performance with KV Cache Eviction
May 10, 2026Ngoc Bui, Hieu Trung Nguyen, Arman Cohan +1Self-Attention KV Caching
Department of Computer Science, Yale University · The Chinese University of Hong Kong
ProxyKV: Cross-Model Proxy Pruning for Efficient Long-Context LLM Inference
May 9, 2026Junjie Li, Jiong Lou, Jie LiLLM Pruning KV Caching
Shanghai Jiao Tong University
When Does Value-Aware KV Eviction Help? A Fixed-Contract Diagnostic for Non-Monotone Cache Compression
May 7, 2026Ruijie Zhang, Haozhe Liang, Da Chang +4KV Caching Long-Context Language Model Inference
Benchmarking KV-Cache Optimizations across Task Quality and System Performance for Long-Context Serving
May 3, 2026Nikita Agrawal, Ruben MayerLLM Serving KV Caching
University of Bayreuth
DepthKV: Layer-Dependent KV Cache Pruning for Long-Context LLM Inference
Apr 27, 2026Zahra Dehghanighobadi, Asja FischerLLM Pruning KV Caching
1Ruhr University Bochum · 2UAR Research Center for Trustworthy Data Science and Security
ReFreeKV: Towards Threshold-Free KV Cache Compression
Feb 24, 2025Xuanfan Ni, Liyan Xu, Chenyang Lyu +6KV Caching Memory-Efficient Optimization
Nanjing University of Aeronautics and Astronautics · WeChat AI, Tencent · Independent Researcher +1

Sep 30, 2026, cs.LGJ/K move · Enter open · S save

EchoPress: Query-Agnostic KV Cache Pruning via Virtual Context Reconstruction

Jiawei Lin, Saibo Geng, Thomas Bourgeat

EPFL

KV-Cache Management LLM Inference Acceleration KV-Cache Compression KV-Cache Pruning

Open paper AskPDF arXiv

KV cache pruning reduces long-context inference memory usage by evicting less important key-value pairs. KVzip estimates importance through context reconstruction: prompting a model to repeat the context chunk by chunk. This achieves strong compression quality at the cost of additional forward passes. Learned approximations reduce this cost but require model-specific training. We analyze how KVzip identifies important cached information and show how to approximate its reconstruction scores using information already computed during prefill. These findings motivate EchoPress, a training-free method that approximates reconstruction attention using queries and keys from standard prefill. For each request, it reconstructs only the first chunk to calibrate importance scores for the remaining context. Experiments on LongBench and RULER with Qwen3-8B and Llama-3.1-8B-Instruct show that EchoPress matches KVzip in task accuracy across eviction ratios from 50% to 90%, while reducing compression overhead by a factor of 1.7-19.6 and total prefill time by a factor of up to 2.9. Code is available at https://github.com/ljwljwljwljw/kvpress/tree/echo-press.

Momentum

Related topics

Latest papers 25