Quantization-Aware Training

Also known as QAT

Overview

Quantization-aware training (QAT) simulates low-precision arithmetic during training so models can learn to withstand rounding and clipping errors at deployment. Common approaches use straight-through estimators, learned or mixed-precision quantizers, progressive bit reduction, and teacher-guided distillation. The methods are applied to settings from ImageNet vision models and edge devices to large language models, where evaluations include accuracy, perplexity, reasoning, and real-device speed. A central challenge is balancing accuracy against bit width and hardware cost: results depend on the numerical format and deployment path, and low-precision training can become unstable or diverge from inference behavior.

Latest papers

CardsList

94 papers11 papers in the last four weeks, down 39% on the four weeks before. 0.1% of all new papers.

  1. A Target-Centric Survey of Quantization-Aware Training

    Aug 30, 2026Jiamin Song, Mengjie Zhao, Zijing Wang +6LLM QuantizationQuantization-Aware Training

  2. QUASAR: Lowering the Loss Floor of Quantization-Aware Training with Loss-Aware Reconstruction

    Aug 14, 2026Vincent Counathe, Ben Athiwaratkun, Christopher De Sa +1LLM QuantizationQuantization-Aware Training

  3. FQTree: Fine-grained Quantization and Hardware Generation of Boosted Decision Trees

    Aug 12, 2026Zhiqiang Que, Chang Sun, Haiyang Wang +6Gradient-Boosted Decision TreesQuantization-Aware Training

  4. APQF: Agentic Profiling-Guided Structured Pruning and Mixed-Precision Quantization with Adaptive Fine-Tuning

    Aug 6, 2026Sadegh Jafari, Mohiuddin Bilwal, Fan Zhou +2Model CompressionMixed-Precision Quantization

  5. Low-Dimensional High-Leverage Subspace Optimization: Beyond Full-Parameter Coupled Training for Neural Network Quantization

    Aug 4, 2026Peng Xia, Junbiao Pang, Zheng HuangQuantization-Aware TrainingPost-Training Quantization

  6. M+Adam: Low-Precision Training via Additive-Multiplicative Optimization

    Jul 12, 2026Xiaoyuan Liang, Sebastian Loeschcke, Mads Toftrup +1Quantization-Aware TrainingLow-Precision Training

  7. It Takes Few to TANGO: A Quantized Distributed Model for Binaural Speech Enhancement

    Jul 9, 2026Zahra Benslimane, Pierre Chouteau, Martyna Poreba +4Quantization-Aware TrainingSpeech Enhancement

  8. Lyapunov-Guided Training for Hardware-Safe Neural Networks Under Fixed-Point Arithmetic

    Jul 5, 2026Anis Hamadouche, Amir HussainLyapunov-Based ControlQuantization-Aware Training

  9. Zero-Shot Quantization for Object Detectors using Off-the-Shelf Generative Models

    Jun 30, 2026Hyunho Lee, Kyomin Hwang, Hyeonjin Kim +3Quantization-Aware TrainingSynthetic Data Generation

  10. Ternary Mamba: Grouped Quantization-Aware Training of W1.58A16 State Space Models

    Jun 16, 2026Ramprasath Ganesaraja, Sahil Dilip Panse, Swathika NLLM QuantizationTernary Quantization

  11. ReQAT: Achieving Full-Precision Reasoning Accuracy with 4-bit Floating-Point Quantization-Aware Training

    Jun 14, 2026Janghwan Lee, Sihwa Lee, Jinseok Kim +4Activation QuantizationQuantization-Aware Training

  12. SPARK: Spatial Policy-driven Adaptive Reinforcement learning for Knowledge distillation

    Jun 13, 2026Mohamed Jismy Aashik Rasool, Shabir Ahmad, Gisong Oh +1RL for Knowledge DistillationQuantization-Aware Training

  13. LC-QAT: Data-Efficient 2-Bit QAT for LLMs via Linear-Constrained Vector Quantization

    Jun 9, 2026Haoyu Wang, Xingyu Yu, Haiyan Zhao +2LLM QuantizationQuantization-Aware Training

  14. Understanding Quantization-Aware Training: Gradients at Quantized Weights Bias to the Low-Loss Basin

    Jun 8, 2026Hanyang Li, Jianhao Ma, Ying CuiNeural Network OptimizationStraight-Through Estimator

  15. On Low-Bit Quantization Errors in Speaker Verification: Diagnostic and Mitigation

    Jun 6, 2026Hugo Leguillier, Driss Matrouf, Guillaume Lechien +1Mixed-Precision QuantizationAdaptive Inference

  16. Scale When Needed: Adaptive Neuron-level Mixed Precision Quantization Aware Training

    May 24, 2026Ayush K. Varshney, Konstantinos Vandikas, Šarūnas Girdzijauskas +2Mixed-Precision QuantizationQuantization-Aware Training

  17. QuantSR+: Pushing the Limit of Quantized Image Super-Resolution Networks

    May 21, 2026Haotong Qin, Xudong Ma, Xianglong Liu +4Quantization-Aware TrainingLow-Bit Quantization

  18. WinQ: Accelerating Quantization-Aware Training of Language Models Around Saddle Points

    May 17, 2026Dongyue Li, Zechun Liu, Kai Yi +6LLM QuantizationQuantization-Aware Training

  19. When Bits Break Recourse: Counterfactual-Faithful Quantization

    May 16, 2026Chaymae Yahyati, Ismail Lamaakal, Khalid El Makkaoui +1Mixed-Precision QuantizationCounterfactual Evaluation

  20. Lite3R: A Model-Agnostic Framework for Efficient Feed-Forward 3D Reconstruction

    May 12, 2026Haoyu Zhang, Zeyu Zhang, Zedong Zhou +2Quantization-Aware Training3D Reconstruction