Key-Value Cache Quantization

Ask about this topic

Momentum

7 papers in the last four weeks, against 2 the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 44

All topics
CardsList

  1. Shared Stopping Decisions Change Answers in HQQ Cache Quantization

    Oct 5, 2026Seunghui Jwa, Minsu Oh, Chanjun Park +1Key-Value Cache Quantization

    Department of Artificial Intelligence, Jeju National University · School of Software, Soongsil University

  2. QuantMLA: Function-Aligned Dual-Path Quantization for Low-Bit MLA KV Caching

    Sep 29, 2026Zunhai Su, Yuxuan Sun, Jianchao Tan +5Key-Value Cache QuantizationMulti-Head Attention

    The University of Hong Kong · Meituan LongCat Team · South China University of Technology +1

  3. PQ-HSA: Reusing Product-Quantized Scores for Hybrid Sparse-Approximate Attention

    Sep 27, 2026Kunming Shao, Jierun Chen, Yanli Wang +4Dynamic Sparse AttentionKey-Value Cache Quantization

    The Hong Kong University of Science and Technology · Huawei Technologies Ltd. · Sun Yat-sen University +1

  4. QuantWM: Temporally Consistent 2-Bit KV Cache Quantization for Video World Models

    Sep 22, 2026Jiaqi Zhao, Xiaobin Hu, Bo Yin +3Key-Value Cache QuantizationQantis

    Harbin Institute of Technology (Shenzhen), Shenzhen, China · National University of Singapore, Singapore

  5. D-Quant: Driftable Entropy Coding for KV Cache Quantization

    Sep 17, 2026Yi Su, Hong Liu, Guanghua Yu +1Key-Value Cache QuantizationKey-Value Cache

    Tencent

  6. Fathom: Per-Query Read Depth for Sparse Decoding over Offloaded KV Caches

    Sep 15, 2026Vivek KalyanaranganKey-Value Cache QuantizationCache

  7. Attention Quantization for Tabular Foundation Models

    Sep 14, 2026Jonas M. Kübler, Benjamin Jäger, Klemens Flöge +2Tabular Foundation ModelsKey-Value Cache Quantization

    Prior Labs

  8. OmniKVQuant: KV Cache Quantization for Omni-LLMs

    Sep 11, 2026Suho Yoo, Hyunjong Ok, Jongmin Choi +2Key-Value Cache QuantizationCache

    KAIST · POSTECH

  9. Why Gated DeltaNet Survives 4-Bit Quantization: NVFP4 W4A4 for the Recurrent Half of a Hybrid 27B LLM

    Sep 3, 2026Sergii Kozyrev, Davyd MaiborodaLarge Language Model QuantizationFp8

  10. Faithfulness Is Not Free: Auditing Offline KV-Cache Quantization in Retrieval-Augmented Generation

    Aug 31, 2026Atta Ul Asad, Ahsan Bilal, Muhammad Ali +2Key-Value Cache QuantizationFaithfulness

    1Lahore University of Management Sciences (LUMS) · University of Oklahoma · 3Air University +1

  11. Spend Bits Where Queries Look: KV Cache Vector Quantization with Attention-Preserving Transforms

    Aug 4, 2026Samuel Fernández-Menduiña, Amir Ziashahabi, Eduardo Pavez +2Key-Value Cache QuantizationResidual Vector Quantization

    Department of Electrical and Computer Engineering, University of Southern California

  12. Output-Aware Rotation for INT2 KV-Cache Quantization

    Aug 3, 2026Vincent-Daniel Yun, Woosang Lim, Minsoo Cheong +4Key-Value Cache QuantizationKv-Cache Management

    University of Southern California · Seoul National University · Inha University

  13. CACHE-UK: A Stability-Aware Memory Editor for Sequentially Updated Quantized LLMs in Finance

    Jul 30, 2026Anubhav Lakra, Yue FengLarge Language Model QuantizationLarge Language Model Memory

    University of Birmingham, Birmingham, United Kingdom

  14. WitCert: Sound Runtime Risk Observability and Gating for KV-Cache Quantization

    Jul 30, 2026Fanzhe Wei, Li Liu, Ziyang Wang +1Key-Value Cache QuantizationCache

    Metask Lab

  15. Regularize or Localize: When Training-Time KV-Cache Geometry Pays Under Quantization

    Jul 19, 2026Libo Sun, Po-Wei Harn, Zewei Zhang +2Key-Value Cache QuantizationRegularization

    Department of Computer Science and Software Engineering, Auburn University, Auburn, AL 36830, USA · Department of Information Management, National Central University, Taoyuan 320317, Taiwan

  16. TriRoute: Unified Learned Routing for Joint Adaptive Attention, Experts, and KV-Cache Allocation

    Jul 7, 2026Andrii Balashov, Olena PonomarovaKey-Value Cache QuantizationMixture-Of-Experts

    Ukrainian State University of Science and Technologies

  17. Lynx: Progressive Speculative Quantization for accelerating KV Transfer in Long-Context Inference

    Jul 2, 2026Wenchen Han, Gingfung Matthew Yeung, Marco Barletta +3Key-Value Cache QuantizationKey-Value Cache

    University College London · Huawei

  18. GSRQ: Gain-Shape Residual Quantization for Sub-1-bit KV Cache

    Jul 1, 2026Soosung Kim, Minjae Park, Eui-Young Chung +1Key-Value Cache QuantizationKey-Value Cache

    Department of Electrical and Electronic Engineering, Yonsei University, Seoul, Republic of Korea · Department of Systems Semiconductor Engineering, Yonsei University, Seoul, Republic of Korea

  19. RoPE-Aware Bit Allocation for KV-Cache Quantization

    Jun 23, 2026Fengfeng Liang, Yuechen Zhang, Jiaya JiaKey-Value Cache QuantizationPeak Memory

    1Hong Kong University of Science and Technology · 2The Chinese University of Hong Kong · 3MiMo, Xiaomi Corporation

  20. QK-Normed MLA: QK normalization without full key caching

    Jun 15, 2026Yizhou Han, Yao Zhao, Jun Zhou +2Multi-Head AttentionBatch Normalization

    School of Data Science, The Chinese University of Hong Kong, Shenzhen.

  21. SpectrumKV: Per-Token Mixed-Precision KV Cache Transfer for Prefill-Decode Disaggregated LLM Serving

    Jun 7, 2026Yang PengjuKey-Value Cache QuantizationKey-Value Cache

  22. KVarN: Variance-Normalized KV-Cache Quantization Mitigates Error Accumulation in Reasoning Tasks

    Jun 2, 2026Lorenz K. Muller, Philippe Bich, Chiara Boretti +3Key-Value Cache QuantizationAutoregressive Decoding

    Huawei

  23. Do Transformers Need Three Projections? Systematic Study of QKV Variants

    Jun 1, 2026Ali Kayyam, Anusha Madan Gopal, M Anthony LewisKey-Value Cache QuantizationTransformer Architectures

    BrainChip Inc., Laguna Hills, CA, USA.

  24. Alignment Collapse Under KV Cache Quantization: Diagnosis and Mitigation

    Jun 1, 2026Bruce Changlong Xu, Adarsh Kumarappan, Mu ZhouKey-Value Cache QuantizationLarge Language Model Quantization

    †Stanford University · ‡California Institute of Technology

  25. Hurwitz Quaternion Multiplicative Quantization for KV Cache Compression

    May 26, 2026Kabir Swain, Sijie Han, Daniel Karl I. Weidele +3Key-Value Cache QuantizationKey-Value Cache Compression

    Massachusetts Institute of Technology, Cambridge, MA, USA · University of Toronto, Toronto, Canada · IBM Research, Cambridge, MA, USA.

  26. Quantized Keys Steal Attention: Bias Correction for KV-Cache Compression in Video Diffusion

    May 25, 2026Tuna Tuncer, Felix Becker, Thomas PfeilAutoregressive Video Diffusion ModelsKey-Value Cache Quantization

    1Technical University of Munich · 2Tensordyne

  27. OCTOPUS: Optimized KV Cache for Transformers via Octahedral Parametrization Under optimal Squared error quantization

    May 20, 2026Mark Boss, Vikram Voleti, Simon Donné +1Key-Value Cache QuantizationKey-Value Cache Compression

    Stability AI

  28. Runtime-Certified Bounded-Error Quantized Attention

    May 20, 2026Dean CalverKey-Value Cache QuantizationMatched Fp16 Intermediate

    Independent Researcher

  29. OScaR: The Occam's Razor for Extreme KV Cache Quantization in LLMs and Beyond

    May 19, 2026Zunhai Su, Rui Yang, Chao Zhang +11Key-Value Cache QuantizationKey-Value Cache Compression

    Tsinghua University · Meituan LongCat Team · The University of Hong Kong +3

  30. OSCAR: Offline Spectral Covariance-Aware Rotation for 2-bit KV Cache Quantization

    May 18, 2026Zhongzhu Zhou, Donglin Zhuang, Jisen Li +4Key-Value Cache QuantizationLarge Language Model Tool Use

    Together AI · University of Sydney · University of Illinois Urbana-Champaign

  31. TriAxialKV: Toward Extreme Low-Precision KV-Cache Quantization for Agentic Inference Tasks

    May 16, 2026Hanzhang Shen, Haoran Wu, Yiren Zhao +1Key-Value Cache QuantizationAgentic Inference

    University of Cambridge · Imperial College London

  32. FibQuant: Universal Vector Quantization for Random-Access KV-Cache Compression

    May 12, 2026Namyoon Lee, Yongjune KimKey-Value Cache QuantizationResidual Vector Quantization

    POSTECH

  33. When Quantization Is Free: An int4 KV Cache That Outruns fp16 on Apple Silicon

    May 7, 2026Mohamed Amine BergachKey-Value Cache QuantizationMatched Fp16 Intermediate

    Illumina, San Diego, CA, USA

  34. QKVShare: Quantized KV-Cache Handoff for Multi-Agent On-Device LLMs

    May 5, 2026Pratik Honavar, Tejpratap GVSLKey-Value Cache QuantizationLLM Inference Optimization

  35. HeadQ: Model-Visible Distortion and Score-Space Correction for KV-Cache Quantization

    May 5, 2026Jorge L. Ruiz WilliamsKey-Value Cache QuantizationCache

    Independent Researcher

  36. WindowQuant: Mixed-Precision KV Cache Quantization based on Window-Level Similarity for VLMs Inference Optimization

    May 4, 2026Wei Tao, Xiaoyang Qu, Peiqiang Wang +4Key-Value Cache QuantizationQuantizer

    Huazhong University of Science and Technology, Wuhan, Hubei, China · Ping An Technology (Shenzhen) Co., Ltd., Shenzhen, Guangdong, China · Tsinghua University, Shenzhen International Graduate School, Shenzhen, Guangdong, China

  37. Statistical Inference and Quality Measures of KV Cache Quantisations Inspired by TurboQuant

    Apr 27, 2026Paolo D'AlbertoKey-Value Cache QuantizationRate-Distortion Theory

    AMD

  38. RateQuant: Optimal Mixed-Precision KV Cache Quantization via Rate-Distortion Theory

    Apr 22, 2026Fei Zuo, Zikang Zhou, Hao Cong +2Key-Value Cache QuantizationKey-Value Cache

    1BA TechWorks (BMW Group) · 2National University of Singapore · 3Tsinghua University

  39. Revisiting RaBitQ and TurboQuant: A Symmetric Comparison of Methods, Theory, and Experiments

    Apr 21, 2026Jianyang Gao, Yutong Gou, Yuexuan Xu +5Key-Value Cache QuantizationComparison

    ETH Zurich · Nanyang Technological University · University of Michigan +2

  40. SAW-INT4: System-Aware 4-Bit KV-Cache Quantization for Real-World LLM Serving

    Apr 21, 2026Jinda Jia, Jisen Li, Zhongzhu Zhou +8Key-Value Cache QuantizationKey-Value Cache Compression

    Together AI

  41. Open-TQ-Metal: Fused Compressed-Domain Attention for Long-Context LLM Inference on Apple Silicon

    Apr 18, 2026Sai VegasenaMatched Fp16 IntermediateLLM Inference Optimization

    Ensue

  42. ResidualKV: Residual-Based KV Cache Compression for Efficient Long-Context Inference

    Feb 8, 2026Jitai Hao, Qiang Huang, Yaowei Wang +2Efficient Long-Context InferenceKey-Value Cache Compression

    Harbin Institute of Technology (Shenzhen), China

  43. NSNQuant: A Double Normalization Approach for Calibration-Free Low-Bit Vector Quantization of KV Cache

    May 23, 2025Donghyun Son, Euntae Choi, Sungjoo YooKey-Value Cache QuantizationResidual Vector Quantization

    Seoul National University

  44. UltraQuant: 4-bit KV Caching for Context-Heavy Agents

    Date pendingInesh Chakrabarti, David Limpus, Aditi Ghai Rana +4Key-Value Cache QuantizationKey-Value Cache Compression

    Advanced Micro Devices · University of California, Los Angeles · Purdue University