LLM Quantization

LLM: Large Language Model

Ask about this topic

Momentum

33 papers in the last four weeks, up 43% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 251

All topics
CardsList

  1. Spike-Aware INT8 Execution for Spiking Language Models on Commodity CPUs

    Jun 2, 2026Ting LiuLLM QuantizationOn-Device Language Model Inference

    SymbolicLight Research Foshan, Guangdong, China

  2. Perplexity Can Miss SAE Feature Damage Under Quantization

    Jun 2, 2026Evan DuanLLM QuantizationLLM Interpretability

    University of Michigan

  3. Qift: Shift-Friendly No-Zero W2 Post-Training Quantization for Rotated W2A4/KV4 LLM Inference

    Jun 1, 2026Chi-Wei Huang, Chia-Chi TsaiLLM QuantizationRotation-Based Quantization

    National Cheng Kung University

  4. Massive Spikes in LLMs are Bias Vectors: Mechanistic Uncovering and Spike-Free Quantization

    Jun 1, 2026Yung-Chin Chen, Chung Peng Lee, Ze-Wei Liou +1LLM QuantizationActivation Outliers

    Princeton University, NJ, USA · EnCharge AI, CA, USA

  5. Extreme Low-Bit Inference in Reasoning Models: Failure Modes and Targeted Recovery

    Jun 1, 2026Ekaterina Alimaskina, Darya Rudas, Denis Shveykin +3LLM QuantizationEfficient Language Model Reasoning

    BRAIn Lab, Moscow, Russia

  6. Does Compression Preserve Uncertainty? A Unified Benchmark for Quantized and Sparse LLMs via Conformal Prediction

    Jun 1, 2026Yujia Tong, Yuxi Wang, Yunyang Wan +3LLM QuantizationLLM Evaluation

    Wuhan University of Technology · Nanyang Technological University

  7. Alignment Collapse Under KV Cache Quantization: Diagnosis and Mitigation

    Jun 1, 2026Bruce Changlong Xu, Adarsh Kumarappan, Mu ZhouLLM QuantizationKV Caching

    †Stanford University · ‡California Institute of Technology

  8. GPTQ-intrinsic LoRA: A Near-optimal Algorithm for Low-precision Quantization with Low-rank Adaptation

    May 31, 2026Shihao Zhang, Rayan SaabLLM QuantizationLow-Rank Adaptation

    Department of Mathematics, University of California San Diego

  9. ScaleSweep: Accurate NVFP4 Post-Training Quantization of LLMs via Block Scale Initialization

    May 30, 2026Li Lin, Xiaojun WanLLM Quantization4-Bit Quantization

    Wangxuan Institute of Computer Technology, Peking University

  10. ProjQ: Project-and-Quantize for Adapter-Aware LLM Compression

    May 30, 2026Wenya Yu, Chao Zhang, Li Wang +2LLM QuantizationPost-Training Quantization

    School of Mathematics and Statistics, Central South University, Changsha, China · Department of Computer Science, Central South University, Changsha, China · CRAN, Université de Lorraine, CNRS, Nancy, France +1

  11. HARP: Hadamard-Preconditioned Adaptive Rotation Processor for Extreme LLM Quantization

    May 28, 2026Artur Zagitov, Gleb Molodtsov, Aleksandr BeznosikovLLM QuantizationRotation-Based Quantization

    1MIRAI · 2BRAIn Lab · 3Innopolis University

  12. LFQ: Logit-aware Final-block Quantization for Boosting the Generation Quality of Low-Bit Quantized LLMs

    May 28, 2026Jung Hyun Lee, June Yong Yang, Jungwook Choi +1LLM QuantizationWeight-Only Quantization

    Kim Jaechul Graduate School of AI, KAIST, Daejeon, South Korea · LG AI Research, Seoul, South Korea · Hanyang University, Seoul, South Korea +1

  13. Apertus LLM Family Expansion via Distillation and Quantization

    May 27, 2026Andrei Panferov, Davit Melikidze, Martin Jaggi +1LLM QuantizationLLM Compression

    ISTA · EPFL · ETH Zürich +1

  14. Hurwitz Quaternion Multiplicative Quantization for KV Cache Compression

    May 26, 2026Kabir Swain, Sijie Han, Daniel Karl I. Weidele +3LLM QuantizationKV Caching

    Massachusetts Institute of Technology, Cambridge, MA, USA · University of Toronto, Toronto, Canada · IBM Research, Cambridge, MA, USA.

  15. WINDQuant: Weight-Informed Neural Decision-Making for Global Mixed-Precision LLM Quantization

    May 26, 2026Phong Nam Huu Nguyen, Khoi M. Le, Cong-Duy T Nguyen +3Mixed-Precision QuantizationLLM Quantization

    CAIR, VinUniversity, Vietnam

  16. QAM-W: Joint 2D Codebook Quantization for LLM Weights via Hadamard Rotation and Activation-Aware Scaling

    May 25, 2026Preetam Sharma, Kacper DobekLLM QuantizationRotation-Based Quantization

    Independent Research · Institute of Computing Science Poznan University of Technology, Poznan, Poland

  17. GoQuant: Geometric Orthogonal Residual Projection for Multiplier-Free Power-of-Two Transformer Quantization

    May 25, 2026Maoyang Xiang, Tao Luo, Bo WangLLM QuantizationEfficient Neural Network Inference

    Information Systems Technology and Design Singapore University of Technology and Design Singapore · Institute of High Performance Computing (IHPC) Agency for Science, Technology and Research (A*STAR) Singapore

  18. Mapping the Schedule x Bit-Width Boundary in Sub-100M Quantisation-Aware Training

    May 25, 2026Christian Brandt ThomassenLLM QuantizationLearning Rate Scheduling

    Dwarf A/S, Copenhagen, Denmark

  19. Max-Window Scale Estimation for Near-Lossless HiF8 W8A8 Quantization-Aware Training

    May 25, 2026Yingying Cheng, Jinquan Shi, Li Zhou +4LLM QuantizationQuantization-Aware Training

  20. Pre-Registering the Detectable Effect: A Paired-MDE Budget for 4-bit Quantization Benchmarks, with a Pilot Audit

    May 25, 2026Zexin Zhuang, Yanhang Li, Zhichao FanLLM QuantizationStatistical Power Analysis

    1Southern Methodist University · 2Northeastern University · University of Illinois Urbana-Champaign

  21. JacQuant: STE-Free Quantization-Aware Training via Learned Jacobian Surrogates

    May 25, 2026Kai Yi, Vignesh Vivekraja, Harshit Khaitan +1LLM QuantizationQuantization-Aware Training

    Meta AI

  22. InfoQuant: Shaping Activation Distributions for Low-Bit LLM Quantization

    May 25, 2026Ke Li, Dong An, Xiaoling Zang +6LLM QuantizationActivation Quantization

    School of Software Technology, Zhejiang University · Ant Group · College of Computer Science and Technology, Zhejiang University of Technology +3

  23. Influence-Inspired Spectral Rotations for Extreme Low-Bit LLM Quantization

    May 24, 2026Gorgi PavlovLLM QuantizationRotation-Based Quantization

    Lehigh University

  24. BitsMoE: Cost-Aware Bit Allocation in Spectral Space for MoE LLM Quantization

    May 22, 2026Jiayu Zhao, Zihan Teng, Minhao Fan +4Mixed-Precision QuantizationLLM Quantization

    School of Microelectronics, University of Science and Technology of China · College of Computing and Data Science, Nanyang Technological University · School of Electrical and Electronic Engineering, Nanyang Technological University

  25. Signs Beat Floats: Low-Rank Double-Binary Adaptation for On-Device Fine-Tuning

    May 22, 2026Yoshihiko Fujisawa, Yuma Ichikawa, Yudai Fujimoto +2LLM QuantizationMemory-Efficient Fine-Tuning

    Fujitsu Limited · Institute of Science Tokyo · RIKEN Center for AIP +1

  26. GEMQ: Global Expert-Level Mixed-Precision Quantization for MoE LLMs

    May 21, 2026Jianing Deng, Song Wang, Dongwei Wang +4Mixed-Precision QuantizationLLM Quantization

    University of Pittsburgh · University of Central Florida · University of Arizona +1

  27. Decomposing MXFP4 quantization error for LLM reinforcement learning: reducible bias, recoverable deadzone, and an irreducible floor

    May 19, 2026Xiaocan Li, Shiliang Wu, Zheng ShenLLM Quantization4-Bit Quantization

    Huawei Canada

  28. Mix-Quant: Quantized Prefilling, Precise Decoding for Agentic LLMs

    May 19, 2026Haiquan Lu, Zigeng Chen, Gongfan Fang +2LLM QuantizationLong-Context Language Model Inference

    National University of Singapore

  29. Quant.npu: Enabling Efficient Mobile NPU Inference for on-device LLMs via Fully Static Quantization

    May 19, 2026Jinghe Zhang, Daliang Xu, Chenghua Wang +5Mixed-Precision QuantizationLLM Quantization

  30. K-Quantization and its Impact on Output Performance

    May 19, 2026Robin Baki Davidsson, Pierre NuguesLLM QuantizationLLM Evaluation

    Lund University · Lund, Sweden