Cache

Ask about this topic

Momentum

31 papers in the last four weeks, up 94% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 196

All topics
CardsList

  1. PatchKV: Weight-Space Compensation of KV Cache

    Sep 30, 2026Chanryeol Lee, Chanhyuk Lee, Yeonwoo Choi +2Key-Value Cache CompressionKey-Value Cache

    KAIST

  2. Low-Discrepancy Dither for Quantized Recurrent State Caches

    Sep 30, 2026Snigdha Chandan KhilarRecurrent StateBounded-Memory

    Independent Researcher

  3. KV-Kaizen: Learning Context-Adaptive Cache Compression Choices

    Sep 29, 2026Joao Monteiro, Louis Béthune, Anastasiia Filippova +3Key-Value Cache CompressionLarge Language Model Compression

    Apple

  4. ARC-KV: Amortizing Anchor Search for Reconstruction-Based KV Cache Compaction

    Sep 29, 2026Zheyu Shen, Guanhua Wang, Dezhan Tu +5Key-Value Cache CompressionCache

    University of Maryland, College Park · Meta

  5. RA-CFGCache: From Branch-Level Criteria to Guided-Risk Control under Classifier-Free Guidance

    Sep 29, 2026Yiming Liu, Ben Wan, Tongxuan Liu +5Classifier-Free GuidanceCache

    School of Software, Tsinghua University, Beijing, China · BNRist, Tsinghua University, Beijing, China · JD.com, Beijing, China

  6. Cartridges++: KV Cache Compression without Off-Context Derailment

    Sep 28, 2026Sonia Laguna, Joao Monteiro, Marco Cuturi +2Key-Value Cache CompressionEfficient Long-Context Inference

    Apple

  7. WavePP: High-Throughput Pipeline Parallel LLM Prefill under Prefix Reuse

    Sep 28, 2026Aaryam SharmaPrefillCache

    Baseten

  8. TempoKV: Timely Staging of LLM KV Caches for Memory-Semantic Flash

    Sep 28, 2026Jay H. Park, Hyungjun Kim, Dong KimKv-Cache ManagementCache

    Samsung Semiconductor

  9. KVCMAS: Efficient KV cache Correction for Shared Context in Multi-Agent Systems

    Sep 28, 2026Hyesung Jeon, Hyeongju Ha, Seoyoung Lee +2Kv-Cache ManagementKey-Value Cache

    Department of Electrical and Computer Engineering Seoul National University

  10. PReCache: Efficient KV Cache Sharing for Multi-LoRA Agents via Low-Rank Precomputation and Neutral Reconstruction

    Sep 28, 2026Hyesung Jeon, Hyeongju Ha, Jae-Joon KimKey-Value CacheCache

    Department of Electrical and Computer Engineering Seoul National University

  11. Thinking Outside the Box: Retention and Transmission of Information in Sliding-Window KV Inference

    Sep 28, 2026Timothy DeLise, Seth CromelinCacheLarge Language Model Memory

  12. EfficientAgent: What Makes KV Cache Offloading Work for Concurrent Agents?

    Sep 27, 2026Kunming Shao, Jierun Chen, Jiangnan Yu +7Kv-Cache ManagementOffloading

    The Hong Kong University of Science and Technology · Huawei Technologies Ltd. · The University of Hong Kong +1

  13. RelaxKV: Recomputation Guided by the Query with Sparse Context Attention for Efficient KV Cache Reuse

    Sep 27, 2026Ruoling Qi, Yirui Liu, Xuaner Wu +5CacheKey-Value Cache

    Shanghai Jiao Tong University · Institute of Artificial Intelligence, China Telecom (TeleAI) · State University of New York at Buffalo

  14. Just Let Linear States Forget the Distant Past: Prefix Caching via Suffix Replay for Hybrid LLMs

    Sep 27, 2026Yirui Liu, Ruoling Qi, Xuaner Wu +6Kimi Delta AttentionCache

    Institute of Artificial Intelligence, China Telecom (TeleAI) China · Shanghai Jiao Tong University · Individual Researcher +1

  15. In-Flight KV Cache with Clean Anchors for Faster Autoregressive Video Diffusion

    Sep 26, 2026Yikai Wang, Xiao Han, Mengmeng Xu +9Autoregressive Video Diffusion ModelsCache

    Meta · S-Lab, Nanyang Technological University

  16. Prefill-Free Cross-Family KV Cache Transfer for Heterogeneous Multi-Agent LLMs

    Sep 26, 2026Vincent-Daniel Yun, Woosang Lim, Haneul Yoo +3PrefillMulti-Agent Large Language Model Systems

    University of Southern California, USA · Seoul National University, Republic of Korea · New York University, USA

  17. When Fancy Eviction Fails: Rethinking Cache Replacement For LLM Prefix Reuse

    Sep 24, 2026Yiyu Liu, Minlan Yu, Juncheng YangEvictionCache

    Harvard University

  18. Marginally Correct Tool Caches Can Reverse Group-Normalized Policy Updates

    Sep 22, 2026Shivam GuptaCacheRollout

    Independent Researcher

  19. KV-COBRA: KV Cache Compression via Co-Optimized Bit-Rank Allocation

    Sep 21, 2026Sihyeon Ha, Jaeho Lee, Yo-Seb JeonKey-Value Cache CompressionCache

    Pohang University of Science and Technology (POSTECH)

  20. H-Spec: Parallel Speculative Decoding Without a Drafter-Side KV Cache

    Sep 21, 2026Weifan Jiang, Krishna Teja Chitty-Venkata, Megan Flynn +6Speculative DecodingBlock-Diffusion Drafter

    Harvard University · Capital One · Red Hat +2

  21. Marginal utility, matrix factorization, and the Key-Value (KV) cache: a unified information-economic framework for sovereign geo-mining inference

    Sep 17, 2026Caroline Gans CombeGeological Semantic UnderstandingData Mining

    INSEEC · INSEEC Business School / Omnes Education, Paris.

  22. D-Quant: Driftable Entropy Coding for KV Cache Quantization

    Sep 17, 2026Yi Su, Hong Liu, Guanghua Yu +1Key-Value Cache QuantizationKey-Value Cache

    Tencent

  23. PrefixBench-H100: Characterizing Prefix Reuse and Time-to-First-Token in H100 LLM Serving

    Sep 17, 2026Omkar Shewale, Deepak Kumar, Divakar Kumar YadavTime-To-First-TokenCache

    Illinois Institute of Technology · University of Wisconsin–Milwaukee

  24. Fathom: Per-Query Read Depth for Sparse Decoding over Offloaded KV Caches

    Sep 15, 2026Vivek KalyanaranganKey-Value Cache QuantizationCache

  25. Fast-Convergent Meta-RL via Gradient-Clustered BS Sampling for Edge Caching

    Sep 14, 2026Farnaz Niknia, Ping WangProximal Policy OptimizationOffline Reinforcement Learning

    Lassonde School of Engineering at York University, Toronto, ON, M3J 1P3, Canada

  26. Validating Hybrid-State Cache Recovery for GLM-5.3-Flash with vLLM and LMCache

    Sep 14, 2026Frank LiCacheReplay

    UNSW Sydney

  27. Fixed State, Long Reach: What a Constant-Size Cache Buys Block Diffusion at Scale

    Sep 14, 2026Vaibhav Singh, Pierre-André Noël, Torsten Scholak +2Diffusion Language ModelsCache

    Mila · Concordia University · ServiceNow Research

  28. OmniKVQuant: KV Cache Quantization for Omni-LLMs

    Sep 11, 2026Suho Yoo, Hyunjong Ok, Jongmin Choi +2Key-Value Cache QuantizationCache

    KAIST · POSTECH

  29. TRACE: Trajectory-robust Admission with Evidence Ordering for Efficient GUI Agents

    Sep 9, 2026Yuhao Wang, Mu Qiao, Xindong Zhang +3Visual Token PruningTraces

    Dalian University of Technology · OPPO Research Institute · The Hong Kong Polytechnic University

  30. Fine-Tuning a KV Cache Concatenation-Aware Model or Recomputing KV Caches? Why Not Both?

    Sep 9, 2026Fumihiko Tachibana, Daisuke Miyashita, Jun DeguchiKey-Value CacheCache

    Kioxia Corporation

  31. SequenceO1: End-to-End Ultra-Long (100K) Sequence Modeling in Recommendation with Low-Rank Caching

    Sep 8, 2026Lin Guan, Jia-Qi Yang, Zhishan Zhao +15Multimodal Recommendation ModelSequential Recommendation

    ByteDance

  32. VestigeKV: The NoPE-MLA KV Cache Carries Its Own Sparse-Attention Signal in a Vestigial Branch

    Sep 3, 2026WenJie FanKey-Value CacheCache

    Yotta Labs

  33. Random Attention: Rethinking KV Cache Eviction for Efficient Reasoning

    Sep 3, 2026Heng Wang, Jielin Qiu, Wenting Zhao +8Key-Value Cache EvictionKey-Value Cache

    Salesforce AI Research · University of Illinois Urbana-Champaign

  34. HeadWiseKV: Budgeted Per-Head Cache Residency for Hybrid Long-Context Language Models

    Sep 2, 2026Renjie Xie, Juncheng Yang, Aoting Hu +4Efficient Long-Context InferenceKey-Value Cache

    Nanjing University of Posts and Telecommunications · Tylogi AI Lab / TAIL · Anhui University of Technology +2

  35. mzCache: On-Device LLM Memory Management under Multitasking

    Sep 1, 2026Hongseung Yu, Minsung Kim, Jongseok Park +1LLM Inference OptimizationLarge Language Model Memory

    Seoul National University · UC Berkeley

  36. Invalidation Contracts for Cross-Episode Agent Memory

    Aug 31, 2026Michael Wu, Arquimedes CanedoGradient StalenessContracts

    Siemens Digital Industries Software Princeton, NJ, USA

  37. Tail-Replay: Escaping the Curse of Linear Attention in Prefix Caching for Hybrid LLMs

    Aug 31, 2026Yirui Liu, Ruoling Qi, Xuaner Wu +2Kimi Delta AttentionLinear Attention

    Institute of Artificial Intelligence, China Telecom (TeleAI) · Shanghai Jiao Tong University

  38. RegionCache: Semantic-Aware Region Reuse for Efficient Multi-Turn Image Generation

    Aug 30, 2026Peizheng Li, Xin Ai, Hanyuan Liu +2Diffusion-Based Image EditingImage Editing

    School of Computer Science and Engineering, Northeastern University, China · School of Computer Science

  39. Accelerating Unified Multimodal Models with Core-Expansion Routing and Unified Computation Scheduling

    Aug 29, 2026Wengyi Zhan, Chenqian Yan, Songwei Liu +2Multimodal ModelFast Inference

    1Xiamen University · 2ByteDance

  40. TwinKV: A Composable Repair Pass for KV Cache Eviction via Pairwise Key Redundancy

    Aug 27, 2026Hong Chen, Yudong Zeng, Yongwei Huang +4Key-Value Cache EvictionCache

    The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China · Bosum Institute of Management Science, Shenzhen, China

  41. StepKV: Step-Aware KV Cache Compression for LLM Agents

    Aug 26, 2026Boyu Feng, Jiahong Liu, Yifan Li +7Key-Value Cache CompressionCache

    The Chinese University of Hong Kong · Huawei Technologies Co., Ltd

  42. Beyond Attention Masks: Instruction Anchoring for Efficient In-Context Diffusion Generation

    Aug 21, 2026Yangshuai Liu, Zheming Li, Jiaao Li +4Diffusion TransformersMultimodal Generation

    Harbin Institute of Technology · KlingAI Research

  43. LipCache: A Local Inference Proxy with Certified Caching for Edge Image Classification Service

    Aug 13, 2026Zhengzhe Xiang, Yinlin Chen, Fuli Ying +3Fast InferenceCache

  44. From Local Mismatch to Global Impact: Optimizing Cache Reuse Policy for Efficient Diffusion

    Aug 13, 2026Xichen Ye, Yifan Wu, Zhikang Xie +3Diffusion ModelsDenoising Trajectory

    College of Computer Science and Artificial Intelligence, Fudan University · Faculty of Engineering, The Chinese University of Hong Kong · School of Data Science, Fudan University

  45. Neural Introspection Gating for Adaptive KV-Cache Reuse in Vision-Language-Action Models

    Aug 11, 2026Zhijie Wu, Kento Kawaharazuka, Kei OkadaDiffusion-Based Vision-Language-ActionsCache

    Graduate School of Information Science and Technology, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8656, Japan

  46. BAG: Budget-Aware Gating for Diffusion Caching

    Aug 10, 2026Tong Zhao, Mingkun Lei, Yucheng Han +1Diffusion TransformersCache

    Zhejiang University · AGI Lab, Westlake University · StepFun

  47. Governing the KV Cache: Preventing Timing Side-Channel Leakage in Multi-Tenant LLM Inference

    Aug 10, 2026Tejasvi C. AddagadaKey-Value CacheCache

  48. DistillCache: KL-Guided Adaptive KV-Cache Eviction for Memory-Efficient LLM Inference

    Aug 9, 2026Asaad AlthoubiCacheLarge Language Model Memory

    Oklahoma State University Stillwater, OK USA

  49. RippleKV: Cross-Layer KV Cache Allocation via Perturbation Propagation

    Aug 9, 2026Dongjie Xu, Kai Qian, Julius +6Key-Value Cache CompressionKey-Value Cache

    1Soochow University · 2Tencent Inc. · 3The Hong Kong University of Science and Technology +2

  50. KGCache: Amortized Subgraph Retrieval for KG Reasoning with LLMs

    Aug 8, 2026Uros Stanic, Changcheng Yuan, Sabuj Laskar +1Knowledge GraphsCache

    Texas A&M University College Station, TX, USA

  51. SPECTRA: Pushing the KV Cache Beyond the 2-Bit Cliff via Spectral Transform Coding

    Aug 8, 2026Jiamu Zhang, Liang Wu, Kelly Wan +2Key-Value CacheCache

    Nokia · Rice University

  52. CoinRAG: Contextualized Information Nugget KV Cache Reuse for Long-Context RAG

    Aug 7, 2026Gyuwan Kim, Cheoneum Park, Tao YangRetrieval-Augmented Generation PipelinesCache

    University of California, Santa Barbara · Hanbat National University

  53. Every Cache Entry Earns Its Place: Global Allocation of Resolution and Coverage for KV Cache Compression

    Aug 7, 2026Haolin Tian, Yuzhe Liu, Tonghan WangKey-Value Cache CompressionCache

    Tsinghua University Beijing, China

  54. Test-Time Adaptation with Online Personalized Energy-Based Cache for Fine-Grained Video Expression Recognition

    Aug 6, 2026Masoumeh Sharafi, Muhammad Osama Zeeshan, Soufiane Belharbi +3Facial Expression RecognitionTest-Time Adaptation

    LIVIA, Department of Systems Engineering, École de technologie supérieure, Montreal, Canada · LIVIA, Department of Software and IT Engineering, École de technologie supérieure, Montreal, Canada

  55. DG-FedReuse: Proxy-Gradient-Gated Cached-Update Reuse with Matched Sparse Uplink Accounting

    Aug 5, 2026Rahil Aftab, Vineet Kumar Rakesh, Soumya Mazumdar +1Federated LearningFedavg

    Department of Computer Science and Engineering Jamia Hamdard New Delhi 110062, India · Engineering Science Homi Bhabha National Institute Anushaktinagar, Mumbai 400094, Maharashtra, India · Computer and Informatics Group Variable Energy Cyclotron Centre 1/AF, Bidhannagar, Kolkata 700064, West Bengal, India +1

  56. Fewer Tokens, Smaller Cache: Reward-Coordinated Efficient Reasoning

    Aug 5, 2026Qiyuan Zhu, Dezhi Li, Pengyu Cheng +8Large Reasoning ModelsKey-Value Cache Compression

    1HKUST · 2XJTU · 3TSE +1

  57. Caching for the Future: Scrub Jay Episodic Memory Principles for Agent Memory Systems

    Aug 5, 2026Kartikey Singh Bhandari, Aarya Wadhwani, Dhruv Kumar +1Episodic MemoryCache

    Birla Institute of Technology and Science, Pilani

  58. Spend Bits Where Queries Look: KV Cache Vector Quantization with Attention-Preserving Transforms

    Aug 4, 2026Samuel Fernández-Menduiña, Amir Ziashahabi, Eduardo Pavez +2Key-Value Cache QuantizationResidual Vector Quantization

    Department of Electrical and Computer Engineering, University of Southern California

  59. TaskPress: Query-Agnostic KV Cache Compression via Task-Guided Pruning

    Aug 4, 2026Wonpyo Park, Seung-won HwangKey-Value Cache CompressionKey-Value Cache Eviction

    Seoul National University · Google

  60. AnchorKV: Anchor-Residual KV Cache Compression

    Aug 3, 2026Malik Khalaf, Yara Shamshoum, Nitzan Hodos +2Key-Value Cache CompressionKey-Value Cache

    Department of Computer Science, Technion - Israel Institute of Technology