Large Language Model Quantization

Ask about this topic

Momentum

28 papers in the last four weeks, up 367% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 154

All topics
CardsList

  1. Anosognosia in LLMs: Probing Self-Awareness of Quantized Computational Substrate

    Oct 5, 2026Yoshihiro Izawa, Gouki Minegishi, Yoko YamakataLarge Language Models FailLarge Language Model Quantization

    The University of Tokyo

  2. Loopy: Low-Bit Quantization Framework for Looped Language Models

    Oct 4, 2026Zeyu LI, Yipu ZHANG, Jintao Chen +2Large Language Model Quantization

    The Hong Kong University of Science and Technology · Duke Kunshan University

  3. MOMAT: Mixture of Multiple Atlases for Low-Power Jailbreak Defense of Quantized LLMs

    Oct 1, 2026Boyang Li, Bingyu Shen, Weihao Hong +6Large Language Model QuantizationJailbreak Success Rates

    Department of Computer Science, Kean University, 1000 Morris Ave, Union, 07083, NJ, USA · Department of Computer Science and Engineering, University of Notre Dame, 257 Fitzpatrick Hall of Engineering, Notre Dame, 46556, IN, USA · McGill University, 845 Sherbrooke Street, Montréal, H3A 0G4, Québec, Canada +2

  4. The Devil Is in the Reconstruction Loss Scale: Rethinking Optimization in LLM Quantization

    Oct 1, 2026Chao Li, Shigeng Wang, Anbang YaoPost-Training QuantizationLarge Language Model Quantization

    Intel Labs China

  5. Analysis of Quantized and Efficiently Adapted Protein Language Models

    Sep 30, 2026Ilan Yaniv Zeisler, Sebastian Clancy, Pouriya Bayat +8Large Language Model QuantizationLanguage Modeling

    Leslie Dan Faculty of Pharmacy, University of Toronto, Toronto, ON, Canada. · Department of Electrical and Computer Engineering, University of Toronto, Toronto, Ontario, Canada. · Department of Computer Science, University of Toronto, Toronto, Ontario, Canada. +2

  6. XOR-Trellis: Ultra-Low-Complexity Dequantization and Curvature-Aware Hadamard-Free LLM Quantization

    Sep 30, 2026Xiaofan Que, Nir Elkayam, Spandan Pyakurel +2Large Language Model QuantizationQuantizer

    Arm, Inc. · Rochester Institute of Technology

  7. QATFactory: A Versatile, Deployment-Aligned Framework for Quantization-aware Training and Distillation of LLMs

    Sep 30, 2026Weili Xu, Jisen Li, Yuqing Jian +8Large Language Model QuantizationQuantization-Aware Training

    Together AI · University of Illinois Urbana-Champaign · The University of Texas at Austin

  8. ShamAN-Q: Shampoo Augmented NanoQuant for Sub-1-bit LLM Weights

    Sep 29, 2026Jonathan Mei, Sang Hyub Kim, Oliver Knitter +2Large Language Model QuantizationQuantized

    Applications R&D IonQ College Park, MD 20740, USA

  9. LeapQuant: Efficient Linear Attention with Accurate Recurrent State Quantization

    Sep 29, 2026Yi Pan, Haocheng Xi, Kan Zhu +10Large Language Model QuantizationKimi Delta Attention

    UC Berkeley · University of Washington · MIT +2

  10. SQUARE: Structured Quantum Representation Adapters as Compact Quadratic Feature Maps for Frozen Language Models

    Sep 29, 2026Emily Jimin Roh, Hyojun Ahn, Hoyeong Lee +4Large Language Model QuantizationFrozen Language Model

    Korea University · Sookmyung Women’s University · Ulsan National Institute of Science and Technology +2

  11. Bits Under ZK-LLM: Evaluating Zero-Knowledge-Friendly Quantization for Verifiable Private LLM Inference

    Sep 29, 2026Taeung Yoon, Yupeng Zhang, Xiaojing LiaoLarge Language Model QuantizationLLM Inference Optimization

    Siebel School of Computing and Data Science University of Illinois Urbana-Champaign

  12. ThinQuant: Scalable Rotation Learning for Weight and Activation Quantization of LLMs

    Sep 28, 2026Mehdi Makni, Ryan Lucas, Rahul MazumderLarge Language Model QuantizationQantis

    Operations Research Center Massachusetts Institute of Technology

  13. Tetra: Serving Leech-Lattice Quantized LLMs at 2.7 Bits per Parameter

    Sep 28, 2026Pier-Jean MalandrinoLarge Language Model QuantizationModel Weights

    Scub, Bordeaux, France

  14. P4Q: Co-designing Token Pruning and Quantization for Vision-Language Model Acceleration

    Sep 28, 2026Haizhao Jing, Zhenhao Shang, Haokui Zhang +2Visual Token PruningLarge Language Model Quantization

    Northwest Polytechnical University · Intellifusion

  15. QuantaSpike: Short-Window Spike-Driven Quantization for Large Language Models

    Sep 28, 2026Bang Hu, Guowei Zhu, Changze Lv +4Large Language Model QuantizationLLM Inference Optimization

    School of Computer Science, Fudan University, Shanghai, China

  16. Optimizing the Phi-2 Small Language Model for Real-time Chatbot Applications Using Parameter-Efficient Fine-Tuning (PEFT) with QLoRA Quantization

    Sep 27, 2026PhanTan Khanh Nguyen, Ashfaq Ali Shafin, Khandaker Mamun AhmedLarge Language Model QuantizationSmall Large Language Models

    Beacom College of Computer and Cyber Sciences, Dakota State University · Mathematics and Computer Science, Augustana College

  17. TerMeZO: Ternary Sparse Zeroth-Order Optimization for Fine-tuning BitNet Models at the Edge

    Sep 27, 2026Houssem Sifaou, Prabodh Katti, Bipin Rajendran +1Zeroth-Order OptimizationZeroth-Order

    Institute for Intelligent Networked Systems, Northeastern University London, UK

  18. Quantization-Robust Unlearning through the Lens of Retain-Forget Loss Landscapes Interaction

    Sep 23, 2026Jialu Wang, Jianing Deng, Shuqing Luo +6Large Language Model UnlearningLarge Language Model Quantization

    University of North Carolina at Chapel Hill · University of Pittsburgh · University of Arizona +1

  19. Disaggregated Quantization: Specializing LLM Prefill and Decode

    Sep 22, 2026Andrei Panferov, Maximilian Kleinegger, Sweta Priyadarshi +2Large Language Model QuantizationQuantizer

    NVIDIA · ISTA

  20. Beyond Scalar Sensitivity: Activation-Aware Mixed-Precision LLM Quantization with Cross-Layer Refinement

    Sep 22, 2026Akihiro Yoshida, Yuma IchikawaMixed-Precision QuantizationLarge Language Model Quantization

    Fujitsu Limited, Institute of Science Tokyo · Fujitsu Limited, RIKEN Center for AIP

  21. RGSQ: Riemannian Geometry-Sensitive Quantization for Large Vision-Language Models

    Sep 21, 2026Zhiping Wu, Dongdong Ren, Yangchengyu Zhou +4Large Language Model QuantizationPost-Training Quantization

    State Key Laboratory for Novel Software Technology and the School of Intelligence Science and Technology, Nanjing University, Suzhou Campus, Suzhou 215163, China

  22. Circuit Hypernetworks for Quantum-Augmented Diffusion Language Models

    Sep 21, 2026Xiaoqiang Wang, Mengyang Xiong, Jun Dai +1Large Language Model QuantizationDiffusion Language Models

    D´epartement d´informatique et de recherche op´erationnelle, Universit´e de Montr´eal, Montr´eal, QC, Canada. · Mila, Quebec AI Institute, Montr´eal, QC, Canada. · McGill University, Montr´eal, QC, Canada.

  23. QuanText: Protecting Dataset-Level Secrets in Textual Data Sharing

    Sep 16, 2026Shuaiqi Wang, Zinan Lin, Giulia FantiTextual DatasetLarge Language Model Quantization

    Carnegie Mellon University · Microsoft Research

  24. Where Post-Training Quantization Breaks Text Embedders: A Measured Map Across Four Embedder Families

    Sep 14, 2026Hyojung HanPost-Training QuantizationLarge Language Model Quantization

    ThakiCloud

  25. Breaking the 1.58-bit Barrier for Ternary LLMs

    Sep 14, 2026Evangelos Georganas, Alexander Heinecke, Pradeep DubeyLarge Language Model QuantizationModel Weights

    Intel Corporation

  26. Behavior Quotient Learning for Low-Rank Adaptation of LLM Agents

    Sep 14, 2026Pengyang Zhou, Xiaobin Tu, Zhengxi Liu +7Low-Rank Adaptation FrameworkLow-Rank Adaptation Adapters

    Alibaba Cloud

  27. Structured Transforms for Low-Overhead Quantization of Language Models

    Sep 11, 2026Daria Cherniuk, Alexander Rudikov, Boris Kashin +1Large Language Model QuantizationModel Weights

    Institute of Numerical Mathematics · Steklov Mathematical Institute

  28. Forgetting Only What Matters: Layer-Selective Unlearning toward Robust LLMs

    Sep 9, 2026Ravi Ranjan, Olivera Kotevska, Agoritsa PolyzouLarge Language Model UnlearningLarge Language Model Quantization

    Florida International University (FIU), Miami, FL, USA · Oak Ridge National Laboratory (ORNL), Oak Ridge, TN, USA

  29. Quantization Amplifies Determinism, Not Bias: Scale-Dependent Behavioral Effects of Serving-Time Weight Compression

    Sep 7, 2026Dachi KurtskhaliaLarge Language Model QuantizationQuantized

    Impel

  30. Why Gated DeltaNet Survives 4-Bit Quantization: NVFP4 W4A4 for the Recurrent Half of a Hybrid 27B LLM

    Sep 3, 2026Sergii Kozyrev, Davyd MaiborodaLarge Language Model QuantizationFp8

  31. The Structure of Quantization Damage in LLMs: Why the Next Bit Should Be Spent Globally

    Sep 1, 2026Jundong Hu, Shekar RamachandranLarge Language Model QuantizationQuantized

    PayPal AI

  32. HyQuant: Hybrid-Precision Quantization for LLM Attention

    Aug 28, 2026Jiatong Ding, Bingxin Xing, Yu Zhang +9Large Language Model QuantizationQantis

    Shanghai Jiao Tong University · Xi’an Jiaotong University · Xiamen University +1

  33. When Personality Meets Quantization: A Layer-wise MBTI Analysis of Quantized LLMs

    Aug 26, 2026Yao Fu, Lijia Huang, Xiaomin Li +3PersonalityLarge Language Model Quantization

    Case Western Reserve University Cleveland, OH 44106, USA · Northeastern University Boston, MA 02115, USA · Microsoft Research Redmond, WA 98052, USA

  34. Activation-Weighted Seeded Residual Coding for Low-Bit LLM Weight Repair

    Aug 24, 2026Zehao Liu, Chuangchuang Fang, Yang RenLarge Language Model QuantizationModel Weights

    Huawei Technologies Research & Development (UK) Limited, Edinburgh, United Kingdom

  35. Language-Conditional Dequantization: Recovering What Quantization Steals from Non-English Languages

    Aug 12, 2026Nirmal ThomasLarge Language Model QuantizationQuantized

    Prathama International

  36. Quantization Degradation in Large Language Models: A Signal-Noise Perspective

    Aug 8, 2026Chenxi Zhou, Pengfei Cao, Jinyu Ye +5Large Language Model QuantizationPost-Training Quantization

    School of Advanced Interdisciplinary Sciences, University of Chinese Academy of Sciences, Beijing, China · The Key Laboratory of Cognition and Decision Intelligence for Complex Systems, Institute of Automation, Chinese Academy of Sciences, Beijing, China · School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China +1

  37. CubicQuant: Parametric Non-Uniform Codebooks for High-Throughput LLM Inference with 1-8-Bit Weights

    Aug 7, 2026Xuetian GaoLarge Language Model QuantizationCodebooks

  38. Beyond Rotations: AuroOFT for Expressive Quantized Orthogonal Fine-Tuning

    Aug 5, 2026Yue Han, Dianlin WangLarge Language Model QuantizationParameter-Efficient Fine-Tuning Methods

    College of Systems Engineering, National University of Defense Technology · College of Computer Science and Technology, National University of Defense Technology

  39. Separating quantum circuits from classical LLMs

    Aug 4, 2026Srinivasan Arunachalam, Arkopal Dutt, Hari Krovi +1Quantum CircuitsLarge Language Model Quantization

    IBM Research

  40. Quantization Effects on Biomedical LLM Reliability

    Aug 4, 2026Anton Rasmussen, Hong QinLarge Language Model ReliabilityLarge Language Model Quantization

    Old Dominion University Norfolk, VA 23529, USA

  41. Recurrent Residual Quantization: A Progressive Multi-Precision Representation for LLMs

    Aug 4, 2026Yu Luo, Bo Dong, Wenhua Cheng +1Large Language Model QuantizationNvidia

    Intel

  42. ARCHead: Activation-Metric Residual Correction for Large Language Model Output Heads

    Aug 3, 2026Şuayp Talha Kocabay, Talha Rüzgar Akkuş, Kamer Ali YukselLarge Language Model QuantizationMatched Fp16 Intermediate

    Independent Researcher · aiXplain, Inc.

  43. FOCUS: FP4 Optimization via Coupled-Relaxation and Dual-Granularity Scaling

    Aug 3, 2026Xianglong Yan, Hong Liu, Chengzhu Bao +4Large Language Model QuantizationFp8

    Shanghai Jiao Tong University · Tencent

  44. Attend to Your Own Thoughts: Breaking the Barrier for Post-Training Quantization of Reasoning LLMs through the Lens of 1.58-Bit Quantization

    Aug 2, 2026Shigeng Wang, Chao Li, Yangyuxuan Kang +2Large Language Model QuantizationPost-Training Quantization

    Intel Labs China

  45. Studying quantization trade-offs for efficient inference deployment in machine translation

    Jul 31, 2026Jim Zhao, Sohir Maskey, Koen Oostermeijer +2Large Language Model QuantizationLLM Inference Optimization

    University of Basel · Aleph Alpha Research · Graphcore

  46. CACHE-UK: A Stability-Aware Memory Editor for Sequentially Updated Quantized LLMs in Finance

    Jul 30, 2026Anubhav Lakra, Yue FengLarge Language Model QuantizationLarge Language Model Memory

    University of Birmingham, Birmingham, United Kingdom

  47. GyRot: Leveraging Hidden Synergy between Rotation and Fine-grained Group Quantization for Low-bit LLM Inference

    Jul 30, 2026Sangjin Kim, Yuseon Choi, Byeongcheol Kim +2Large Language Model QuantizationLLM Inference Optimization

    School of Electrical Engineering, Korea Advanced Institue of Science and Technology (KAIST)

  48. How Small Can You Go? A Controlled Study of LoRA Rank, Target Modules, and Quantization Trade-offs for Text-to-SQL on a 60M-Parameter Model

    Jul 28, 2026Mahendra Singh Rathor, Anagheem AzzamLarge Language Model QuantizationParameter-Efficient Fine-Tuning Methods

    Independent Researcher · Jaipur, India · Hamburg, Germany

  49. Bits and Memories: Measuring Verbatim Extraction Across LLM Quantization

    Jul 28, 2026Akshay SasiLarge Language Model QuantizationLarge Language Model Memory

    Independent Researcher

  50. Stable FP4 Training via Transposition-Invariant Block Quantization

    Jul 27, 2026Mehdi Rahimifar, Amin Darabi, Mehran Taghian Jazi +6Large Language Model QuantizationFp8

  51. QuantiBias: Benchmarking Quantization-Induced Bias in LLMs

    Jul 23, 2026Emilio FerraraLarge Language Model BiasLarge Language Model Quantization

    Thomas Lord Department of Computer Science University of Southern California

  52. MXSens: Sensitivity-Aware Mixed-Precision Quantization for Efficient LLM Inference

    Jul 20, 2026Simla Burcu Harma, Danila Mishin, Zhengyuan Su +7Large Language Model QuantizationMixed-Precision Quantization

    EcoCloud, EPFL · Tsinghua University · MangoBoost Inc. +2

  53. Cross-Layer Error Compensation and Finite-Sample Feature-Statistics Matching for Extreme Low-Bit Quantization of Large Language Models

    Jul 16, 2026Ryona NodaLarge Language Model QuantizationCross-Layer Interactions

    Ryo Noda

  54. ExTernD: Expanded-Rank Ternary Decomposition Ternary LLM PTQ with Accuracy Approaching Any Quantization Level

    Jul 15, 2026Chethan Reddy G. PLarge Language Model QuantizationModel Weights

  55. Reliability Scaling Laws for Quantized Large Language Models

    Jul 12, 2026Sirine Ayadi, Sándor Daróczi, Stephan Günnemann +1Large Language Model QuantizationLarge Language Model Reliability

    School of Computation, Information and Technology, Technical University of Munich Munich Data Science Institute · Pruna AI

  56. Silent Failures in Quantized LLM Reasoning: A Taxonomy-Based Analysis of Hollow Convergence and Failure Mode Shifts

    Jul 10, 2026Renuka Oladri, Mohan Vamsi Varadaraju Priya, Jerry WuLarge Language Model QuantizationLarge Language Models Fail

    Science Academy University of Maryland College Park, MD, USA · Electrical and Computer Engineering University of Maryland College Park, MD, USA

  57. The Illusion of Equivalency: Statistical Characterization of Quantization Effects in LLMs

    Jul 9, 2026Baha Rababah, Cuneyt Gurcan Akcora, Carson K. LeungLarge Language Model QuantizationPost-Training Quantization

    Department of Computer Science, University of Manitoba, Canada · AI Initiative, University of Central Florida, USA

  58. Rethinking Small VLM Quantization: From Component-Wise Analysis to Hardware-Aware Edge Deployment

    Jul 9, 2026Hyeju Shin, Chorwon Kim, Ryangsoo Kim +2Large Language Model QuantizationQuantized

    1ETRI, Republic of Korea.

  59. KronQ: LLM Quantization via Kronecker-Factored Hessian

    Jul 8, 2026Donghyun Lee, Yuhang Li, Ruokai Yin +1Large Language Model QuantizationPost-Training Quantization

    University of Southern California · Yale University

  60. GeoFP8: Geometry-Aware FP8 Gradient Compression for Distributed LLM Training

    Jul 8, 2026Jieying Wang, Zizhong Wang, Fangru Linghu +3Large Language Model QuantizationLarge Language Model Pretraining

    Department of Computer Science, Rutgers University, Piscataway, NJ, USA · Department of Electrical and Computer Engineering, Rutgers University, Piscataway, NJ, USA