Kv-Cache Blocks

Ask about this topic

Recent momentum

emerging

8 papers in the last 28 days · 0.1% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Also in Cache

Neighbouring directions

CacheKey-Value CacheKey-Value Cache CompressionKey-ValueKey-Value Cache QuantizationKey-Value Cache EvictionEviction

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

2 new papers

A weekly snapshot of new work published in Kv-Cache Blocks.

Period ending 2026-09-14

6 new papers

A weekly snapshot of new work published in Kv-Cache Blocks.

Period ending 2026-09-07

1 new paper

A weekly snapshot of new work published in Kv-Cache Blocks.

35 papers

Latest in Kv-Cache Blocks

Open your feed →
CardsList

  1. Shared KV Caching for Replicated 27B Inference: Correctness Failures and Performance Boundaries

    Sep 14, 2026Frank LiKv-Cache BlocksCache

  2. DiffSynth-Music: Audio-Conditioned KV-Cache Adapters for Controllable Music Generation

    Sep 14, 2026Zhongjie Duan, Shengchuan Gao, Hong Zhang +1Music GenerationMusic Editing

  3. K/V-Cache Interventions Dissociate Representation Alignment from Persona Expression in Decoder-Only Language Models

    Sep 11, 2026Yu Sun, Mengyin Lu, Cong Feng +2Kv-Cache BlocksPersona

  4. Building py-kvcache: A Performance Characterization of External KV Caching for vLLM with NVMe SSDs

    Sep 11, 2026Joseph Kanichai, Tiziano De Matteis, Animesh TrivediKv-Cache BlocksKey-Value Cache

  5. Composable CXL Memory as a Kubernetes-Native Shared Memory for LLM Serving

    Sep 9, 2026Hongjian Fan, Kevin Zhang, David Habinsky +1Kv-Cache BlocksKey-Value Cache

  6. KVShareArena: KV-Cache Reuse Across Contexts and Model Checkpoints

    Sep 9, 2026Xi Shi, Qian LouKv-Cache BlocksLongbench

  7. BIO-MEMART: Biometric-Aware KV Cache Memory for Multi-User LLM Agents

    Sep 8, 2026Yanhong Qian, Xuanying He, Qingguo Meng +3Kv-Cache BlocksKey-Value Cache

  8. A Universal Context-Reuse Layer for Cross-Model KV Sharing

    Aug 31, 2026Yi Li, Dongming Jiang, Yi Zhao +1Kv-Cache BlocksKey-Value

  9. Governing the KV Cache: Preventing Timing Side-Channel Leakage in Multi-Tenant LLM Inference

    Aug 10, 2026Tejasvi C. AddagadaKv-Cache BlocksKey-Value Cache

  10. Output-Aware Rotation for INT2 KV-Cache Quantization

    Aug 3, 2026Vincent-Daniel Yun, Woosang Lim, Minsoo Cheong +4Key-Value Cache QuantizationKv-Cache Blocks

  11. SALT: Salience-Aware Lexical Trie for Long-Context Compression

    Jul 20, 2026Oteo Mamo, Hyunjin Yi, Joydhriti Choudhury +2Efficient Long-Context InferenceLarge Language Model Memory

  12. Smarter and Cheaper at Once: Byte-Exact KV-Cache Grafting Turns a Frozen Small Model into a Verified-Knowledge Flywheel

    Jul 15, 2026Sietse SchelpeFrozen ModelsLLM Inference Efficiency

  13. TriRoute: Unified Learned Routing for Joint Adaptive Attention, Experts, and KV-Cache Allocation

    Jul 7, 2026Andrii Balashov, Olena PonomarovaAdaptive RoutingQuadratic Attention

  14. When Latent Agents Lie: KV-Cache Integrity in Multi-Agent LLM Collaboration

    Jun 27, 2026Luís Brito, Carlos BaqueroLarge Language Model AgentsAgent Memory

  15. ProtoKV: Streaming Video Understanding under Delayed Query with Summary-State Memory

    Jun 25, 2026Le Tu Ngoc Minh, Jinyeong Lim, Dongsu HanKv-Cache BlocksKey-Value Cache

  16. CrossPool: Efficient Multi-LLM Serving for Cold MoE Models through KV-Cache and Weight Disaggregation

    Jun 23, 2026Zhuoren Ye, Tianyu Wo, Dinghao Xue +4Kv-Cache BlocksLarge Language Model Serving

  17. See What I See, Know What I Think: Dense Latent Communication Across Heterogeneous Agents

    Jun 11, 2026Siyi Chen, Xiaoyan Zhang, Meng Wu +7Kv-Cache BlocksLatent Representation Alignment

  18. RKSC: Reasoning-Aware KV Cache Sharing and Confident Early Exit for Multi-Step LLM Inference

    Jun 7, 2026Anirudh SekarKv-Cache BlocksLLM Inference Efficiency

  19. IntentKV: Cross-Turn Intent-Aware KV Cache Pruning for Agent Inference

    Jun 6, 2026Junjie Li, Jiong Lou, Jie LiKv-Cache BlocksCache

  20. Move the Query, Not the Cache: Characterizing Cross-Instance Latent Attention Redistribution Across GPU Fabrics

    May 31, 2026Bole Ma, Jan Eitzinger, Harald Köstler +1Dynamic Sparse AttentionKv-Cache Blocks

  21. CIVIC: End-to-End Sequence Compactness for Efficient Vision-Language Models

    May 27, 2026Fengze Yang, Bo Yu, Xuewen Luo +2Large Vision Language ModelsVision Encoders

  22. A Token/KV-Cache Communication Media Selection and Resource Allocation Strategy for Multi-Agent Collaboration

    May 25, 2026Lipeng Dai, Luping Xiang, Kun YangWireless Resource AllocationCommunication

  23. CONF-KV: Confidence-Aware KV Cache Eviction with Mixed-Precision Storage for Long-Horizon LLM

    May 24, 2026Yubo Li, Yidi MiaoKv-Cache BlocksKey-Value Cache Eviction

  24. Continuous Discovery of Vulnerabilities in LLM Serving Systems with Fuzzing

    May 11, 2026Yunze Zhao, Yibo Zhao, Yuchen Zhang +2Vulnerability Detection & RepairLarge Language Model Serving

  25. KV-RM: Regularizing KV-Cache Movement for Static-Graph LLM Serving

    May 10, 2026Zhiqing Zhong, Zhijing Ye, Jian Zhang +3Kv-Cache BlocksGraphics Processing Unit Memory

  26. ProxyKV: Cross-Model Proxy Pruning for Efficient Long-Context LLM Inference

    May 9, 2026Junjie Li, Jiong Lou, Jie LiLLM Inference EfficiencyEfficient Long-Context Inference

  27. Echo: KV-Cache-Free Associative Recall with Spectral Koopman Operators

    May 7, 2026Anupama Sridhar, Alexander JohansenKv-Cache BlocksRetrievers

  28. Efficient Serving for Dynamic Agent Workflows with Prediction-based KV-Cache Management

    May 7, 2026Haoyu Zheng, Fangcheng Fu, Jia Wu +6Kv-Cache BlocksAgentic Workflows

  29. Shallow Prefill, Deep Decoding: Efficient Long-Context Inference via Layer-Asymmetric KV Visibility

    May 7, 2026Jungsuk Oh, Hyeseo Jeon, Hyunjune Ji +2Efficient Long-Context InferenceLLM Inference Efficiency

  30. When Hidden States Drift: Can KV Caches Rescue Long-Range Speculative Decoding?

    Apr 29, 2026Tianyu Liu, Yuhao Shen, Xinyi Hu +8Speculative DecodingKv-Cache Blocks

  31. Latent Phase-Shift Rollback: Inference-Time Error Correction via Residual Stream Monitoring and KV-Cache Steering

    Apr 20, 2026Manan Gupta, Dhruv KumarError CorrectionReasoning Errors

  32. SLO-Guard: Crash-Aware, Budget-Consistent Autotuning for SLO-Constrained LLM Serving

    Apr 19, 2026Christian LysenstøenLarge Language Model ServingTuning

  33. Bit-Flip Vulnerability of Shared KV-Cache Blocks in LLM Serving Systems

    Apr 19, 2026Yuji Yamamoto, Satoshi MatsuuraKv-Cache BlocksSystematic Fp16 Divergence

  34. KV Cache Offloading for Context-Intensive Tasks

    Apr 9, 2026Andrey Bocharnikov, Ivan Ermakov, Denis Kuznedelev +2Kv-Cache BlocksEfficient Long-Context Inference

  35. LLM Serving Optimization with Variable Prefill and Decode Lengths

    Aug 8, 2025Meixuan Wang, Yinyu Ye, Zijie ZhouLarge Language Model ServingOptimal Scheduling