Cache

Ask about this topic

Recent momentum

-66%

13 papers in the last 28 days · 0.3% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Also in Key-Value Cache

Neighbouring directions

Key-Value CacheKey-Value Cache CompressionKey-ValueKv-Cache SteeringKey-Value Cache QuantizationKey-Value Cache EvictionEviction

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-14

4 new papers

A weekly snapshot of new work published in Cache.

Period ending 2026-09-07

5 new papers

A weekly snapshot of new work published in Cache.

170 papers

Latest in Cache

Open your feed →
CardsList

  1. Validating Hybrid-State Cache Recovery for GLM-5.3-Flash with vLLM and LMCache

    Sep 14, 2026Frank LiIntermediate CheckpointsCache

  2. OmniKVQuant: KV Cache Quantization for Omni-LLMs

    Sep 11, 2026Suho Yoo, Hyunjong Ok, Jongmin Choi +2Key-Value Cache QuantizationLarge Language Model Quantization

  3. TRACE: Trajectory-robust Admission with Evidence Ordering for Efficient GUI Agents

    Sep 9, 2026Yuhao Wang, Mu Qiao, Xindong Zhang +3Visual Token PruningTraces

  4. Fine-Tuning a KV Cache Concatenation-Aware Model or Recomputing KV Caches? Why Not Both?

    Sep 9, 2026Fumihiko Tachibana, Daisuke Miyashita, Jun DeguchiKv-Cache SteeringKey-Value Cache

  5. No-Regret Mixing of LRU and LFU with Optimal Switching Cost

    Sep 7, 2026Younes Ben Mazziane, Xinying ZouEvictionLinear Regret

  6. VestigeKV: The NoPE-MLA KV Cache Carries Its Own Sparse-Attention Signal in a Vestigial Branch

    Sep 3, 2026WenJie FanKey-Value CacheCache

  7. Random Attention: Rethinking KV Cache Eviction for Efficient Reasoning

    Sep 3, 2026Heng Wang, Jielin Qiu, Wenting Zhao +7Key-Value Cache EvictionKey-Value Cache

  8. LeanStream: A Speculate-and-Refine Streaming Framework for Efficient on-Device LLM Inference

    Sep 2, 2026Renyuan Liu, Yuyang Leng, Kaiyan Liu +7LLM Inference EfficiencyStreaming

  9. HeadWiseKV: Budgeted Per-Head Cache Residency for Hybrid Long-Context Language Models

    Sep 2, 2026Renjie Xie, Juncheng Yang, Aoting Hu +4Efficient Long-Context InferenceKey-Value Cache

  10. mzCache: On-Device LLM Memory Management under Multitasking

    Sep 1, 2026Hongseung Yu, Minsung Kim, Jongseok Park +1LLM Inference EfficiencyLarge Language Model Memory

  11. Tail-Replay: Escaping the Curse of Linear Attention in Prefix Caching for Hybrid LLMs

    Aug 31, 2026Yirui Liu, Ruoling Qi, Xuaner Wu +2Efficient Long-Context InferenceCache

  12. RegionCache: Semantic-Aware Region Reuse for Efficient Multi-Turn Image Generation

    Aug 30, 2026Peizheng Li, Xin Ai, Hanyuan Liu +2Diffusion EditingImage Editing

  13. Accelerating Unified Multimodal Models with Core-Expansion Routing and Unified Computation Scheduling

    Aug 29, 2026Wengyi Zhan, Chenqian Yan, Songwei Liu +2Cache

  14. TwinKV: A Composable Repair Pass for KV Cache Eviction via Pairwise Key Redundancy

    Aug 27, 2026Hong Chen, Yudong Zeng, Yongwei Huang +4Key-Value Cache EvictionCache

  15. LipCache: A Local Inference Proxy with Certified Caching for Edge Image Classification Service

    Aug 13, 2026Zhengzhe Xiang, Yinlin Chen, Fuli Ying +3CacheImage Classification

  16. From Local Mismatch to Global Impact: Optimizing Cache Reuse Policy for Efficient Diffusion

    Aug 13, 2026Xichen Ye, Yifan Wu, Zhikang Xie +3Diffusion ModelsDenoising Trajectory

  17. QV-PIC: Query-Aware Visual Position-Independent Caching for Efficient RAG Serving

    Aug 12, 2026Yilin Liu, Rui Meng, Wangze Ni +5Retrieval-Augmented GenerationComposed Image Retrieval

  18. BAG: Budget-Aware Gating for Diffusion Caching

    Aug 10, 2026Tong Zhao, Mingkun Lei, Yucheng Han +1Diffusion TransformersCache

  19. Governing the KV Cache: Preventing Timing Side-Channel Leakage in Multi-Tenant LLM Inference

    Aug 10, 2026Tejasvi C. AddagadaKv-Cache SteeringKey-Value Cache

  20. RippleKV: Cross-Layer KV Cache Allocation via Perturbation Propagation

    Aug 9, 2026Dongjie Xu, Kai Qian, Julius +6Key-Value Cache CompressionKey-Value Cache

  21. SPECTRA: Pushing the KV Cache Beyond the 2-Bit Cliff via Spectral Transform Coding

    Aug 8, 2026Jiamu Zhang, Liang Wu, Kelly Wan +2Key-Value CacheCache

  22. CoinRAG: Contextualized Information Nugget KV Cache Reuse for Long-Context RAG

    Aug 7, 2026Gyuwan Kim, Cheoneum Park, Tao YangRetrieval-Augmented GenerationCache

  23. Test-Time Adaptation with Online Personalized Energy-Based Cache for Fine-Grained Video Expression Recognition

    Aug 6, 2026Masoumeh Sharafi, Muhammad Osama Zeeshan, Soufiane Belharbi +3Facial Expression RecognitionTest-Time Adaptation

  24. DG-FedReuse: Proxy-Gradient-Gated Cached-Update Reuse with Matched Sparse Uplink Accounting

    Aug 5, 2026Rahil Aftab, Vineet Kumar Rakesh, Soumya Mazumdar +1FedavgFederated Averaging

  25. Fewer Tokens, Smaller Cache: Reward-Coordinated Efficient Reasoning

    Aug 5, 2026Qiyuan Zhu, Dezhi Li, Pengyu Cheng +8Large Reasoning ModelsProcess Reward Modeling

  26. Spend Bits Where Queries Look: KV Cache Vector Quantization with Attention-Preserving Transforms

    Aug 4, 2026Samuel Fernández-Menduiña, Amir Ziashahabi, Eduardo Pavez +2Key-Value Cache QuantizationCalibration-Free Low-Bit Vector Quantization

  27. TaskPress: Query-Agnostic KV Cache Compression via Task-Guided Pruning

    Aug 4, 2026Wonpyo Park, Seung-won HwangKey-Value Cache CompressionKey-Value Cache Eviction

  28. AnchorKV: Anchor-Residual KV Cache Compression

    Aug 3, 2026Malik Khalaf, Yara Shamshoum, Nitzan Hodos +2Key-Value Cache CompressionKey-Value Cache

  29. EchoCache: Energy-Guided Cross-Modal Caching for Efficient Audio-Driven Video Generation

    Aug 3, 2026Jiayu Chen, Xiaoyu Wu, Rongshan Gao +6Joint Audio-Video GenerationAudio-Visual Consistency

  30. LaCache: Robust Semantic Caching for LLM Serving

    Aug 3, 2026Jiacheng Liang, Yuhui Wang, Tanqiu Jiang +1CacheLanguage Model Evasion Attacks

  31. StreamSplat: Streaming Feed-Forward 3D Gaussian Splatting

    Aug 3, 2026Changhao Song, Yuxuan Wang, Qibiao Li +2Feed-Forward 3D Gaussian SplattingNovel View Synthesis

  32. Does Accuracy Equal Evidence? Reasoning Faithfulness under KV Cache Compression

    Aug 3, 2026Mengting Ai, Jingrui He, Yue GuoKey-Value Cache CompressionReasoning Traces

  33. RestoreKV: Recovering Full-Cache Behavior Under Aggressive Query-Agnostic KV Cache Eviction

    Aug 2, 2026Changwoo Baek, Seungjun Shin, Kyeongbo KongKey-Value Cache CompressionKey-Value Cache Eviction

  34. The Gate, Not the Cache: Gate Provenance Bounds the Closed-Loop Reliability of Training-Free VLA Token Skipping

    Aug 1, 2026Qi Luo, Shuaijun Liu, Hao Zhao +5Vision-Language-ActionClosed Loop

  35. ResKV: Reconstructing Omitted Attention Contributions for Fixed-Budget KV Cache Compression

    Jul 31, 2026Yuhang Zhan, Lisi Chen, Shuo ShangKey-Value Cache CompressionCache

  36. OnlineCache: Learning Dynamic Caching Policies with Error Correction for Efficient Diffusion Inference

    Jul 31, 2026Zhikang Xie, Xichen Ye, Yifan Wu +5Diffusion ModelsCache

  37. Analysis of Memory-Runtime Trade-offs in Caching Strategies for Genetic Programming Symbolic Regression

    Jul 31, 2026Jiaming Shi, Kei Sen Fong, Mehul MotaniCacheSymbolic Regression

  38. Faster but Different: Diagnosing and Controlling Content Drift in Accelerated Multimodal Diffusion Language Models

    Jul 31, 2026Yaoxuan Dou, Yang ShuDiffusion Language ModelsTraining-Inference Mismatch

  39. LinearKV: One Cached State Suffices for Position-Independent Caching in Hybrid LLMs

    Jul 31, 2026Yirui Liu, Ruoling Qi, Longwen Wang +5CacheKey-Value Cache

  40. Stage-Replay Divergence Follows the KV Cache: Fixed-Prefix Precision Controls and Bidirectional Cache Transplantation

    Jul 30, 2026Alexander Boesgaard LorupCachePrefill

  41. Understanding Is Done Early: A Depth Division of Labor in Large Language Models and Its Use for Unbounded-Context Memory

    Jul 30, 2026Hanzuo Liu, Xuan Qi, Chunyu Liu +6Efficient Long-Context InferenceLarge Language Model Memory

  42. SemPIC: Learning Semantic Position-Independent KV Caches

    Jul 30, 2026Hui Xie, Peng Xiao, Yutong Deng +3Key-Value CacheCache

  43. Back from the Future: Key-Value Cache Management by Counter-Causal Surprise

    Jul 30, 2026Stephen Gould, Anton van den HengelKey-Value CacheCache

  44. Memory Layer: Train the In-Model Cache for Recommendation Models

    Jul 27, 2026Liangyuan Na, Gufan Yin, Yixin Bao +19CacheKey-Value

  45. DynaCalKV: Key-Value Cache Compression via Head Grouping and Adaptive Rank Allocation

    Jul 27, 2026Tan T. Nguyen, Quan V. DangKey-Value Cache CompressionLarge Language Model Compression

  46. SpecBox: Speculative Sandbox Scheduling for Efficient LLM Agent Serving

    Jul 27, 2026Yihui Zhang, Tianyu Wo, Jinghao Wang +7SandboxLarge Language Model Agents

  47. OmniCache: Multidimensional Hierarchical Feature Caching For Diffusion Models

    Jul 26, 2026Zhaoyuan He, Muhammad Muaz, Lili QiuVideo Diffusion ModelsDiffusion Models

  48. CachedSearch: Training-Free Cached Exploration for Test-Time Search in Video Diffusion

    Jul 25, 2026Shreshth Saini, Neil Birkbeck, Yilin Wang +2Video Diffusion ModelsTest Time

  49. Beyond Independent Optimization: Compression, MoE Routing, and Quantization Interactions in Multimodal Edge Intelligence

    Jul 23, 2026Jay Gor, Karm Dave, Akshita Abrol +3Mixture-Of-Expert RoutingIntelligent Edge

  50. Evolving Cache Schedules for Fast Diffusion Policy Inference

    Jul 22, 2026Siying Wang, Kangye Ji, Di Wang +1Diffusion PoliciesCache

  51. HijackKV: New Threat in Position-Independent KV Cache Reuse

    Jul 22, 2026Yichi Zhang, Zhiqi Wang, Huan Zhang +1Key-Value CacheKey-Value

  52. C^2KV: Compressed and Composable KV Cache Reuse for Efficient LLM Inference

    Jul 20, 2026Chuheng Du, Junyi Chen, Hanlin Tang +7Key-Value CacheEfficient Long-Context Inference

  53. Cache-Aware Prompt Compression:A Two-Tier Cost Model for LLM API Caching

    Jul 17, 2026Yan SongCacheLarge Language Model Serving

  54. A JoLT for the KV Cache: Near-Lossless KV Cache Compression via Joint Tucker and JL-Residual Allocation for LLMs

    Jul 14, 2026Rahul Krishnan, Volker SchulzKey-Value Cache CompressionKey-Value Cache

  55. ACID: Adaptive Caching for vIDeo generation

    Jul 14, 2026Om Agrawal, Saurabh Agarwal, Aditya AkellaVideo Diffusion ModelsCache

  56. Full-Pipeline Inference Optimization for MiMo-V2.5 Series: Pushing Hybrid SWA Efficiency to the Limit

    Jul 14, 2026Xiaomi MiMo Team, Anqi Liu, Aoxin Ma +28Faster InferenceCache

  57. MemDecay: Region-Aware KV Cache Eviction for Efficient LLM Agent Inference

    Jul 12, 2026Venkatesha Matam, Keon KimKey-Value Cache EvictionLarge Language Model Memory

  58. Context by Distinct Information: An Auditable Dirichlet-Process Working Memory for Long, Redundant Context Streams

    Jul 11, 2026Siddharth Pal, Viktoria RojkovaEfficient Long-Context InferenceWorking Memory

  59. Stateful Worlds, Stateless Elasticity: Exact-State Serving for Interactive World Models

    Jul 11, 2026Jin Li, Jiawei ChenPersistent StateWorld Models and Dynamics

  60. ML in a Box: Analyzing Containerization Practices in Open Source ML Projects

    Jul 11, 2026Faten Jebari, Emna Ksontini, Amine Barrak +1Machine LearningCapacity