LLM Quantization

LLM: Large Language Model

Ask about this topic

Momentum

33 papers in the last four weeks, up 43% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 246

All topics
CardsList

  1. Align, Then Correct: Training-Free Two-Stage Low-Rank Compensation for Extremely Quantized Large Language Models

    Oct 6, 2026Seobin Song, Geonho Lee, Janghwan Lee +1LLM QuantizationPost-Training Quantization

    Hanyang University, Seoul, Republic of Korea · Qualcomm AI Research, Qualcomm Korea YH, Seoul, Republic of Korea

  2. ApexQuant: Data-Free Elastic Quantization by Residual Re-Isotropization

    Oct 6, 2026Aksel Fristrup, Sumit Pandey, Ankit KariryaaLLM QuantizationRotation-Based Quantization

    Henselian (henselian.com) · Department of Computer Science University of Copenhagen Denmark · Towards Deep Learning

  3. Lost in the bf16 Cast: Exporting Ternary Language Models Can Revert Most Low-Learning-Rate Code Changes

    Oct 6, 2026Avichal Sahai, Nishant Raj, Animesh SrivastavaLLM QuantizationTernary Quantization

    Ofbusiness

  4. TRACE: Rollout-Guided Quantization-Aware Training for FP4 Reinforcement Learning of MoE Language Models

    Oct 6, 2026Xin Wang, Hao Yu, Zhengyang Zhuge +9LLM QuantizationQuantization-Aware Training

    Alibaba Token Hub, Alibaba Group · Ohio State University

  5. Activation Denoising: A Robustness View on Parallel vs Sequential LLM Quantization

    Oct 5, 2026Yan Scholten, Rachel Lawrence, James Hensman +3LLM QuantizationPost-Training Quantization

    Dept. of Computer Science & Munich Data Science Institute, Technical University of Munich · Microsoft Research Cambridge, UK

  6. AlignQuant: Tile-Aligned Mixed-Precision Quantization for Efficient LLM Generation

    Oct 5, 2026Hanzhi Zhang, Qiao Zhang, Qinglei Cao +4Mixed-Precision QuantizationLLM Quantization

    LLaVi Lab, Computer Science & Engineering, University of North Texas

  7. Differentiable Bit-Widths: Co-optimizing Pruning and Quantization via SVD for Ultra-Efficient LLM Compression

    Oct 5, 2026Hankyul Kang, Jongbin RyuLLM QuantizationLLM Pruning

    Ajou University

  8. StagQ: Constraint-Driven Multi-Precision Weight Quantization for LLMs

    Oct 5, 2026Zhe Wei, Mengqi Guo, Yuan Yuan +3Mixed-Precision QuantizationLLM Quantization

    Huawei Technologies Ltd.

  9. Understanding the Weight Averaging Mechanism in LLM Training for Post-Training Quantization

    Oct 4, 2026Hanzhang Wang, Tianqi Shen, Zonglin Liu +3LLM QuantizationPost-Training Quantization

    City University of Hong Kong · The University of Hong Kong

  10. Loopy: Low-Bit Quantization Framework for Looped Language Models

    Oct 4, 2026Zeyu LI, Yipu ZHANG, Jintao Chen +2LLM QuantizationPost-Training Quantization

    The Hong Kong University of Science and Technology · Duke Kunshan University

  11. The Devil Is in the Reconstruction Loss Scale: Rethinking Optimization in LLM Quantization

    Oct 1, 2026Chao Li, Shigeng Wang, Anbang YaoLLM QuantizationPost-Training Quantization

    Intel Labs China

  12. XOR-Trellis: Ultra-Low-Complexity Dequantization and Curvature-Aware Hadamard-Free LLM Quantization

    Sep 30, 2026Xiaofan Que, Nir Elkayam, Spandan Pyakurel +2LLM QuantizationLLM Inference Acceleration

    Arm, Inc. · Rochester Institute of Technology

  13. RATIO: Reasoning Analysis and Token-level Inference Optimization for Quantized Reasoning Models

    Sep 30, 2026Chengzhu Bao, Xianglong Yan, Tianao Zhang +3LLM QuantizationOverthinking in Language Models

    Shanghai Jiao Tong University

  14. QATFactory: A Versatile, Deployment-Aligned Framework for Quantization-aware Training and Distillation of LLMs

    Sep 30, 2026Weili Xu, Jisen Li, Yuqing Jian +8LLM QuantizationQuantization-Aware Training

    Together AI · University of Illinois Urbana-Champaign · The University of Texas at Austin

  15. Low-Discrepancy Dither for Quantized Recurrent State Caches

    Sep 30, 2026Snigdha Chandan KhilarLLM QuantizationNeural Network Quantization

    Independent Researcher

  16. JARQ: Joint Alternating Refinement for Quantization

    Sep 29, 2026Xinyu Wang, Sicheng Lyu, Xiao-Wen ChangLLM QuantizationWeight-Only Quantization

    McGill University

  17. ShamAN-Q: Shampoo Augmented NanoQuant for Sub-1-bit LLM Weights

    Sep 29, 2026Jonathan Mei, Sang Hyub Kim, Oliver Knitter +2LLM QuantizationWeight-Only Quantization

    Applications R&D IonQ College Park, MD 20740, USA

  18. Security-Enhanced Seed-Based Weight Quantization for Large Language Models

    Sep 29, 2026Qiuyu Ren, Sudipta Paria, Aritra Dasgupta +1LLM QuantizationLLM Compression

    Department of Electrical and Computer Engineering (ECE) University of Florida Gainesville, FL 32611, USA

  19. STEPQuant: When and Where Errors Matter in Delta-Rule Recurrent State Quantization

    Sep 29, 2026Bingchen Yao, Haobo Xu, Haokun Lin +6LLM QuantizationLLM Inference Acceleration

    Zhejiang University · Tsinghua University · NLPR & MAIS, Institute of Automation, CAS +3

  20. LeapQuant: Efficient Linear Attention with Accurate Recurrent State Quantization

    Sep 29, 2026Yi Pan, Haocheng Xi, Kan Zhu +10LLM QuantizationLLM Inference Acceleration

    UC Berkeley · University of Washington · MIT +2

  21. Calibrate the Decisions That Change the Future: On-Policy Post-Training Quantization for Multimodal Large Language Models

    Sep 29, 2026Wenxiao Fan, Jingling Fu, Lichen Ma +6LLM QuantizationVLM Quantization

    School of Computer Science and Technology, Beijing Institute of Technology · Institute of Artificial Intelligence and Robotics, Xi’an Jiaotong University

  22. Bits Under ZK-LLM: Evaluating Zero-Knowledge-Friendly Quantization for Verifiable Private LLM Inference

    Sep 29, 2026Taeung Yoon, Yupeng Zhang, Xiaojing LiaoLLM QuantizationLLM Inference

    Siebel School of Computing and Data Science University of Illinois Urbana-Champaign

  23. ThinQuant: Scalable Rotation Learning for Weight and Activation Quantization of LLMs

    Sep 28, 2026Mehdi Makni, Ryan Lucas, Rahul MazumderLLM QuantizationRotation-Based Quantization

    Operations Research Center Massachusetts Institute of Technology

  24. IMC-CLINIC: Coupled Loss-Informed Newton Iterations for Clipping in Analog In-Memory Computing

    Sep 28, 2026Yung-Chin Chen, Chia-Yu Chen, Naveen VermaLLM QuantizationCompute-in-Memory

    Princeton University, NJ, USA · EnCharge AI, CA, USA

  25. Tetra: Serving Leech-Lattice Quantized LLMs at 2.7 Bits per Parameter

    Sep 28, 2026Pier-Jean MalandrinoLLM QuantizationLLM Inference Acceleration

    Scub, Bordeaux, France

  26. From Attention Sensitivity to Layer Role: Revisiting Mixed-Precision Quantization of Transformers

    Sep 28, 2026Nafiseh HosseinpourFardi, Negar Alihadi, Mahmoudreza Babaei +2Mixed-Precision QuantizationLLM Quantization

    Sharif University of Technology, Tehran, Iran · GISMA University of Applied Sciences, Potsdam, Germany · BRAINS, Brandenburg Research Center for Applied Intelligent Systems, Potsdam, Germany +3

  27. QuantForge: Discovering Residual Decompositions for MXFP4 Post-Training Quantization

    Sep 28, 2026Qiulin Shang, Zhoutong Wu, Jie Hu +1LLM QuantizationLarge Language Model-Guided Optimization

    Peking University

  28. QuantaSpike: Short-Window Spike-Driven Quantization for Large Language Models

    Sep 28, 2026Bang Hu, Guowei Zhu, Changze Lv +4LLM QuantizationSpiking Neural Networks

    School of Computer Science, Fudan University, Shanghai, China

  29. Quantization Error Is Spectrally Flat: A Single Random Probe Is a Calibrated, Data-Free Sensitivity Estimator, with Application to Budget-Targeted Mixed-Precision Quantization

    Sep 27, 2026I Kennedy, T KennedyMixed-Precision QuantizationLLM Quantization

    baa.ai Auckland, New Zealand

  30. Softmax Reparameterization for Output-Head Quantization

    Sep 25, 2026Asim Kadav, Christian Flores, Chirag Arora +5LLM QuantizationPost-Training Quantization

    Adobe Search, Discovery & ContentAI

  31. Train Where the Quantized Model Goes: On-Policy Distillation for Low-Bit Reasoning

    Sep 22, 2026Yuanteng Chen, Zhilei Liu, Peisong Wang +7LLM QuantizationQuantization-Aware Training

    Institute of Automation, Chinese Academy of Sciences · School of Artificial Intelligence, University of Chinese Academy of Sciences · Zhongguancun Academy +2

  32. Disaggregated Quantization: Specializing LLM Prefill and Decode

    Sep 22, 2026Andrei Panferov, Maximilian Kleinegger, Sweta Priyadarshi +2LLM QuantizationLLM Inference

    NVIDIA · ISTA

  33. Beyond Scalar Sensitivity: Activation-Aware Mixed-Precision LLM Quantization with Cross-Layer Refinement

    Sep 22, 2026Akihiro Yoshida, Yuma IchikawaMixed-Precision QuantizationLLM Quantization

    Fujitsu Limited, Institute of Science Tokyo · Fujitsu Limited, RIKEN Center for AIP

  34. When Quantization Preserves Accuracy but Not Evidence: Explanation-Aware Post-Training Quantization for Medical LLMs

    Sep 21, 2026Yeji Kim, Mi-Young Kim, Randy GoebelLLM QuantizationFaithfulness of Language Model Explanations

    University of Alberta

  35. A Calibrated Instrument for Measuring How Inference Optimizations Affect Output Quality

    Sep 16, 2026Jerry KaplanLLM QuantizationLLM Evaluation

    Adjunct Lecturer, Computer Science and Masters in International Policy, Stanford University

  36. The Inference Engineering Pareto Atlas: Which Optimizations Dominate the Cost, Quality, and Latency Frontier?

    Sep 15, 2026Srikanta Datta Tumkur, Jay Iyer, Mehar Simhadri +3LLM Inference EfficiencyLLM Quantization

    Vizuara

  37. LLM Inference in a Flash!

    Sep 14, 2026Sebastian Zhao, Minseo Kim, Coleman Hooper +5LLM QuantizationCompute-in-Memory

    UC Berkeley · ICSI · LBNL

  38. Structured Transforms for Low-Overhead Quantization of Language Models

    Sep 11, 2026Daria Cherniuk, Alexander Rudikov, Boris Kashin +1LLM QuantizationWeight-Only Quantization

    Institute of Numerical Mathematics · Steklov Mathematical Institute

  39. Why Does Post-Training Quantization Work?

    Sep 10, 2026Yuxiang Chen, Michael Beyer, Jun Zhu +1LLM QuantizationPost-Training Quantization

    Dept. of Comp. Sci. and Tech., Institute for AI, BNRist Center, THBI Lab, Tsinghua-Bosch Joint ML Center, Tsinghua University · College of AI, Tsinghua University · Bosch AI Research, Renningen, Germany

  40. Scaling Post-Training Ternarisation to Qwen3-8B Capability Retention, Reproduction, Lossless Packing, and Packed Execution

    Sep 10, 2026Anirudh Malik, M Sparsh Mehra, Poojith DevanLLM QuantizationTernary Quantization

    OneBit AI

  41. Quantization Amplifies Determinism, Not Bias: Scale-Dependent Behavioral Effects of Serving-Time Weight Compression

    Sep 7, 2026Dachi KurtskhaliaLLM QuantizationWeight-Only Quantization

    Impel

  42. Why Gated DeltaNet Survives 4-Bit Quantization: NVFP4 W4A4 for the Recurrent Half of a Hybrid 27B LLM

    Sep 3, 2026Sergii Kozyrev, Davyd MaiborodaLLM Quantization4-Bit Quantization

  43. Post-Training Ternarization of Qwen3-4B Capability, Effective Bit Budget, Storage Compression, and Deployment

    Sep 2, 2026Anirudh Malik, M Sparsh Mehra, Poojith DevanLLM QuantizationTernary Quantization

    OneBit AI

  44. The Structure of Quantization Damage in LLMs: Why the Next Bit Should Be Spent Globally

    Sep 1, 2026Jundong Hu, Shekar RamachandranMixed-Precision QuantizationLLM Quantization

    PayPal AI

  45. Triple-Bottom-Line Sustainability of Language Models for Edge AI: A Comparison Between SLMs and Quantized LLMs

    Sep 1, 2026Jainil Dharmil ShahLLM QuantizationLLM Evaluation

    Elmore Family School of Electrical and Computer Engineering · Purdue University, West Lafayette, Indiana, USA

  46. HBQ: Hierarchical Scaling Block Quantization with Hardware-Efficiency-Aware Design for Accurate LLM Inference

    Aug 31, 2026Chun-Ting Chen, Dongmin Han, Hangyeol Mun +6LLM QuantizationLLM Inference Acceleration

    Cornell University New York, NY, USA · Intel Corporation Santa Clara, CA, USA · Intel Corporation Hillsboro, OR, USA

  47. QTEA: Ternary LLMs with Sparse Residual Salient Weight and By-Column Optimization

    Aug 31, 2026Yipin Guo, Arun M George, Jie Fu +3LLM QuantizationTernary Quantization

    University of Notre Dame

  48. Q-Strata: Hierarchical Bit Allocation for Mixed-Precision Quantization of Mixture-of-Experts LLMs

    Aug 31, 2026Deokjae Lee, Sihun Chu, Hyun Oh SongMixed-Precision QuantizationLLM Quantization

    Department of Computer Science and Engineering, Seoul National University · Neural Processing Research Center · 3Neural Processing Research Center +2

  49. Budget-Aware Compression Pipeline for Single-GPU LLM Inference: Methods, Trade-offs, and Coupling Effects

    Aug 30, 2026Hongyu Yu, Yifei ShenLLM QuantizationLLM Pruning

    Lenovo Research · University of Washington

  50. A Target-Centric Survey of Quantization-Aware Training

    Aug 30, 2026Jiamin Song, Mengjie Zhao, Zijing Wang +6LLM QuantizationQuantization-Aware Training

    1Northeastern University, China · 2Shandong University, China · 3CIS, LMU Munich; MCML, Germany

  51. HyQuant: Hybrid-Precision Quantization for LLM Attention

    Aug 28, 2026Jiatong Ding, Bingxin Xing, Yu Zhang +9Mixed-Precision QuantizationLLM Quantization

    Shanghai Jiao Tong University · Xi’an Jiaotong University · Xiamen University +1

  52. DAMP: Decay-Aware Mixed-Precision Recurrent-State Quantization

    Aug 27, 2026Tao Zhang, Jianchao Tan, Pingwei Sun +6Mixed-Precision QuantizationLLM Quantization

    South China University of Technology · Meituan · East China Normal University

  53. When Personality Meets Quantization: A Layer-wise MBTI Analysis of Quantized LLMs

    Aug 26, 2026Yao Fu, Lijia Huang, Xiaomin Li +3LLM QuantizationLLM Interpretability

    Case Western Reserve University Cleveland, OH 44106, USA · Northeastern University Boston, MA 02115, USA · Microsoft Research Redmond, WA 98052, USA

  54. FAMPWQ: Fisher Information-based Adaptive Mixed Precision Weight Quantization for Effective LLM Inference

    Aug 24, 2026Gongwei Lee, Ji Liu, Juncheng Jia +1Mixed-Precision QuantizationLLM Quantization

    School of Computer Science and Technology, Soochow University, Suzhou, China · Hithink Research, Hangzhou, China · Electronic Engineering, Tsinghua University, Beijing, China

  55. Activation-Weighted Seeded Residual Coding for Low-Bit LLM Weight Repair

    Aug 24, 2026Zehao Liu, Chuangchuang Fang, Yang RenLLM QuantizationWeight-Only Quantization

    Huawei Technologies Research & Development (UK) Limited, Edinburgh, United Kingdom

  56. How Weight Encoding Affects Language Model Placement and Performance on the Apple Neural Engine

    Aug 22, 2026Shahir M ALLM QuantizationAI Accelerator Inference

    Independent researcher

  57. In-Cell Learning: Language Models That Update Their Own Weights in Sequence Without Changing the File They Ship

    Aug 21, 2026Zifeng Liu, Yaxin Lu, Xuanhan Wu +6LLM QuantizationKnowledge Editing

    Big Data and Artificial Intelligence Center, The Third Affiliated Hospital of Sun Yat-sen University · Institute for Frontier Interdisciplinary Research in Health Sciences and Technology, Sun Yat-sen University · Sun Yat-sen University Institute of Artificial Intelligence +7

  58. QUASAR: Lowering the Loss Floor of Quantization-Aware Training with Loss-Aware Reconstruction

    Aug 14, 2026Vincent Counathe, Ben Athiwaratkun, Christopher De Sa +1LLM QuantizationQuantization-Aware Training

    Cornell University · Together AI

  59. When Local Variance Optimality Is Not Enough: RoPE-Aligned Q/K Rotations for Dynamic 4-Bit Quantisation

    Aug 13, 2026Shuhan Wang, Yilin Luo, Nan Xu +1LLM Quantization4-Bit Quantization

  60. SoftWater: Class-Aware Rate Allocation for Softmax Quantization

    Aug 12, 2026Joao V. Cavalcanti, Ashia C. WilsonLLM QuantizationPost-Training Quantization

    Department of Electrical Engineering and Computer Science · Massachusetts Institute of Technology · Cambridge, MA 02139, USA