Cache

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

20 new papers

A weekly snapshot of new work published in Cache.

Period ending 2026-09-14

13 new papers

A weekly snapshot of new work published in Cache.

Period ending 2026-09-07

16 new papers

A weekly snapshot of new work published in Cache.

Inside this field

Focused directions

400 papers

Latest in Cache

Browse all topics →
CardsList

  1. HijackKV: New Threat in Position-Independent KV Cache Reuse

    Jul 22, 2026Yichi Zhang, Zhiqi Wang, Huan Zhang +1Key-Value CacheKey-Value

  2. MoA-Structured Decode Attention DNF Derivation, KV-Cache Accumulation, GQA/MQA, and OpenACC Kernel

    Jul 21, 2026Lenore Mulin, Gaetan HainsQuadratic AttentionTransformer Attention

  3. C2^2KV: Compressed and Composable KV Cache Reuse for Efficient LLM Inference

    Jul 20, 2026Chuheng Du, Junyi Chen, Hanlin Tang +7Key-Value CacheEfficient Long-Context Inference

  4. FlowBlock: Wavefront-Parallel Decoding for Self-Correcting Diffusion Language Models

    Jul 20, 2026Bing Tian, Haikun Liu, Xiaocheng Zhong +5Diffusion Language ModelsParallel

  5. SALT: Salience-Aware Lexical Trie for Long-Context Compression

    Jul 20, 2026Oteo Mamo, Hyunjin Yi, Joydhriti Choudhury +2Efficient Long-Context InferenceLarge Language Model Memory

  6. Regularize or Localize: When Training-Time KV-Cache Geometry Pays Under Quantization

    Jul 19, 2026Libo Sun, Po-Wei Harn, Zewei Zhang +2Key-Value Cache QuantizationQuantization

  7. Cache-Aware Prompt Compression:A Two-Tier Cost Model for LLM API Caching

    Jul 17, 2026Yan SongCacheContext Compression

  8. Smarter and Cheaper at Once: Byte-Exact KV-Cache Grafting Turns a Frozen Small Model into a Verified-Knowledge Flywheel

    Jul 15, 2026Sietse SchelpeFrozen ModelsLLM Inference Efficiency

  9. CayleyR: Solving the TopSpin puzzle via cycle intersection

    Jul 14, 2026Yuri BaramykovPermutationPuzzle

  10. Adaptive Filtering of the KV Cache: Diagnosing and Correcting Structural-Role Bias in LLM Inference

    Jul 14, 2026Soumil MandalKey-Value Cache EvictionKey-Value Cache

  11. A JoLT for the KV Cache: Near-Lossless KV Cache Compression via Joint Tucker and JL-Residual Allocation for LLMs

    Jul 14, 2026Rahul Krishnan, Volker SchulzKey-Value Cache CompressionKey-Value Cache

  12. ACID: Adaptive Caching for vIDeo generation

    Jul 14, 2026Om Agrawal, Saurabh Agarwal, Aditya AkellaCacheThroughput

  13. Full-Pipeline Inference Optimization for MiMo-V2.5 Series: Pushing Hybrid SWA Efficiency to the Limit

    Jul 14, 2026Xiaomi MiMo Team, Anqi Liu, Aoxin Ma +28Sliding-Window AttentionReal-Time Inference

  14. Efficient and Privacy Aware Edge Cloud Collaborative Inference for Large Language Models

    Jul 14, 2026Yi Li, Chen Li, Jiexiong LiuLLM Inference EfficiencyHeterogeneous Edge Devices

  15. MemDecay: Region-Aware KV Cache Eviction for Efficient LLM Agent Inference

    Jul 12, 2026Venkatesha Matam, Keon KimKey-Value Cache EvictionCache

  16. Context by Distinct Information: An Auditable Dirichlet-Process Working Memory for Long, Redundant Context Streams

    Jul 11, 2026Siddharth Pal, Viktoria RojkovaEfficient Long-Context InferenceWorking Memory

  17. Stateful Worlds, Stateless Elasticity: Exact-State Serving for Interactive World Models

    Jul 11, 2026Jin Li, Jiawei ChenPersistent StateWorld Models

  18. How Query Visibility Changes KV-Cache Compression Rankings: A Matched-Budget Audit

    Jul 11, 2026Daming Luo, Christy Liang, Junyu XuanKey-Value Cache CompressionTop-K

  19. ML in a Box: Analyzing Containerization Practices in Open Source ML Projects

    Jul 11, 2026Faten Jebari, Emna Ksontini, Amine Barrak +1Machine LearningCapacity

  20. Remembering Distinct Items, Not Tokens: A Learnable Dirichlet-Process Cache Between State-Space Models and Attention

    Jul 10, 2026Siddharth Pal, Viktoria RojkovaRecurrent StateCache

  21. COBS: Cumulant Order Block Sparse Attention

    Jul 10, 2026Alexander Tian, Aditya Ghai, Sanjit Neelam +2Dynamic Sparse AttentionLongbench

  22. Towards Efficient Large Language Model Serving: A Survey on System-Aware KV Cache Optimization

    Jul 9, 2026Jiantong Jiang, Peiyu Yang, Rui Zhang +1Key-Value CacheLarge Language Model Serving

  23. What to Keep, What to Forget: A Rate--Distortion View of Memory Compaction in LLMs and Agents

    Jul 9, 2026Ashwin Gerard Colaco, Nada LahjoujiCompactionAgent Memory

  24. Fractal KV-Cache Archives: Lossless Symbolic Storage with In-Place Retrieval for Long-Context LLM Inference

    Jul 8, 2026Vladimir GusevKey-Value CacheLLM Inference Efficiency

  25. Compress the Cache, Not the Speech Embedding: KV Compression for Efficient Speech LLMs

    Jul 7, 2026Ke-Han Lu, Keqi Deng, Ruchao Fan +2Speech Large Language ModelsAutoregressive Decoding

  26. DepthWeave-KV: Token-Adaptive Cross-Layer Residual Factorization for Long-Context KV Cache Compression

    Jul 7, 2026Anna Cordoba, Adam Puente Tercero, Nerea Angulo Hijo +4Key-Value Cache CompressionEfficient Long-Context Inference

  27. FreqDepthKV: Frequency-Guided Depth Sharing for Robust KV Cache Compression in Long-Context LLM Inference

    Jul 7, 2026Anna Córdoba, Adam Puente Tercero, Nerea Angulo Hijo +4Key-Value Cache CompressionLLM Inference Efficiency

  28. Training-Free Acceleration for Vision-Language-Action Models with Action Caching and Refinement

    Jul 7, 2026Ryuji Oi, Hikari Otsuka, Kosuke Matsushima +4Flow-Matching Vision-Language-ActionVision-Language-Action Models

  29. TriRoute: Unified Learned Routing for Joint Adaptive Attention, Experts, and KV-Cache Allocation

    Jul 7, 2026Andrii Balashov, Olena PonomarovaAdaptive RoutingQuadratic Attention

  30. KVpop -- Key-Value Cache Compression with Predictive Online Pruning

    Jul 6, 2026Lukas Hauzenberger, Niklas Schmidinger, Anamaria-Roberta Hartl +5Key-Value Cache EvictionKey-Value Cache Compression

  31. Risk-Constrained Freshness-Aware Semantic Caching for Open-Web Retrieval-Augmented LLMs

    Jul 5, 2026Muhammad Mansoor, Tahir Ahmad, Yeo-Chan YoonCacheGradient Staleness

  32. Sangam: Efficiently Serving Diffusion LLMs with the AR Stack

    Jul 5, 2026Nitin Kedia, Saurabh Agarwal, Myungjin Lee +1Large Language Model ServingDiffusion Language Models

  33. AdaptiveSD A Stability-Aware, Runtime-Adaptive Speculative Decoding Framework with Multi-Policy Orchestration for CPU-Constrained LLM Inference

    Jul 4, 2026Sadra SaremiSpeculative DecodingLLM Inference Efficiency

  34. Metronome: Bound the Cache, Keep the Beat for Real-Time Interaction Model Serving

    Jul 2, 2026Jiaying Meng, Bojie LiLow-Latency SystemsLarge Language Model Serving

  35. Lynx: Progressive Speculative Quantization for accelerating KV Transfer in Long-Context Inference

    Jul 2, 2026Wenchen Han, Gingfung Matthew Yeung, Marco Barletta +3Key-Value Cache QuantizationKey-Value Cache

  36. The risk of KV cache compression

    Jul 1, 2026Lukas Haverbeck, Carmen Amo Alonso, Andres Felipe Posada-Moreno +2Key-Value Cache CompressionContext Compression

  37. Precomputing the Future-Offset Average in TriAttention

    Jul 1, 2026Amarnath MukherjeeQuadratic AttentionKey-Value Cache

  38. Cache Merging as a Convergent Replicated State for Multi-Agent Latent Reasoning

    Jul 1, 2026Carlos Baquero, Luís BritoCacheEfficient Latent Reasoning

  39. GSRQ: Gain-Shape Residual Quantization for Sub-1-bit KV Cache

    Jul 1, 2026Soosung Kim, Minjae Park, Eui-Young Chung +1Key-Value Cache QuantizationKey-Value Cache

  40. Latent Visual Cache for Video Reasoning

    Jul 1, 2026Yongheng Zhang, Zhipeng Xu, Hao Wu +4Latent Visual ReasoningVisual Reasoning

  41. MosaicKV: Serving Long-Context LLM with Dynamic Two-D KV Cache Compression

    Jul 1, 2026Sheng Qiang, Ruiwei Chen, Yinpeng Wu +5Key-Value Cache CompressionEfficient Long-Context Inference

  42. Towards Memory-Efficient Autoregressive Video Generation via Instance-Specific Parametric Absorption

    Jul 1, 2026Xiaomeng Fu, Jia Li, Yiming Hu +5Autoregressive Video GenerationKey-Value Cache Compression

  43. When Classic Cache Policies Fail: Learning-Augmented Replacement for Semantic Retrieval Buffers

    Jul 1, 2026Yushi Sun, Bowen Cao, Wai LamCacheLearning-Augmented Algorithms

  44. From Tensor Buffer to Distributed Memory Hierarchy: A Survey of KV Cache Management for LLM Serving

    Jun 30, 2026Jie Li, Tongyang Wang, Yong ChenCacheLarge Language Model Serving

  45. RaBitQCache: Rotated Binary Quantization for KVCache in Long Context LLM Inference

    Jun 30, 2026Wenhao Li, Jinhao Dong, Hailin Zhang +3LLM Inference EfficiencyDynamic Sparse Attention

  46. SeKV: Resolution-Adaptive KV Cache with Hierarchical Semantic Memory for Long-Context LLM Inference

    Jun 30, 2026Amirhossein Abaskohi, Giuseppe Carenini, Peter West +1Key-Value Cache CompressionKey-Value Cache

  47. Speculative Pre-Positioning: Decoding Stateful Sessions to the Next Decision Point Off the Critical Path

    Jun 28, 2026Victor NorgrenPrefillLLM Inference Efficiency

  48. Coverage-Driven KV Cache Eviction for Efficient and Improved Inference of LLM

    Jun 28, 2026Shuvendu Roy, Mengyao Zhai, Hossein Hajimirsadeghi +1Key-Value Cache EvictionLLM Inference Efficiency

  49. DiLaServe: High SLO Attainment Serving for Diffusion Language Models

    Jun 27, 2026Tzu-Tao Chang, Benjamin Yuanyang Hong, Kiet Pham +1Large Language Model ServingThroughput

  50. When Latent Agents Lie: KV-Cache Integrity in Multi-Agent LLM Collaboration

    Jun 27, 2026Luís Brito, Carlos BaqueroLarge Language Model AgentsAgent Memory

  51. HARD-KV: Head-Adaptive Regularization for Decoding-time KV Compression

    Jun 27, 2026Yuxuan Yang, Feiyang Ren, Bowen Zeng +4Key-Value Cache CompressionLLM Inference Efficiency

  52. CacheMPC: Certified Cached Model Predictive Control for Quadruped Locomotion

    Jun 26, 2026Nimesh Khandelwal, Mehul Anand, Shakti S. Gupta +1Model Predictive ControlCache

  53. Information-Aware KV Cache Compression for Long Reasoning

    Jun 25, 2026Jushi Kai, Zhuiri Xiao, Alexandra Birch +1Key-Value Cache CompressionKey-Value

  54. LearniBridge: Learnable Calibration of Feature Caching for Diffusion Models Acceleration

    Jun 25, 2026Xuyue Huang, Zhe Chen, Wang Shen +1Multimodal Diffusion TransformersIntermediate Representations

  55. ProtoKV: Streaming Video Understanding under Delayed Query with Summary-State Memory

    Jun 25, 2026Le Tu Ngoc Minh, Jinyeong Lim, Dongsu HanKv-Cache BlocksKey-Value Cache

  56. Position Rebinding Cache Reuse: Replay-Free Visual Revisiting for Interleaved Multimodal Reasoning

    Jun 25, 2026Mengzhao Wang, Yanli Ji, Wangmeng Zuo +2Multimodal ReasoningMultimodal Reasoning Benchmarks

  57. Epiphany-Aware KV Cache Eviction Without the Attention Matrix

    Jun 25, 2026Steven Kolawole, Virginia SmithKey-Value Cache EvictionKey-Value Cache

  58. CrossPool: Efficient Multi-LLM Serving for Cold MoE Models through KV-Cache and Weight Disaggregation

    Jun 23, 2026Zhuoren Ye, Tianyu Wo, Dinghao Xue +4Kv-Cache BlocksLarge Language Model Serving

  59. CompressKV: Semantic-Retrieval-Guided KV-Cache Compression for Resource-Efficient Long-Context LLM Inference

    Jun 23, 2026Xiaolin Lin, Jingcun Wang, Olga Kondrateva +3Key-Value Cache CompressionLLM Inference Efficiency

  60. RoPE-Aware Bit Allocation for KV-Cache Quantization

    Jun 23, 2026Fengfeng Liang, Yuechen Zhang, Jiaya JiaKey-Value Cache QuantizationQuadratic Attention