Quantization-Aware Training

Also known as QAT

Overview

Quantization-aware training (QAT) simulates low-precision arithmetic during training so models can learn to withstand rounding and clipping errors at deployment. Common approaches use straight-through estimators, learned or mixed-precision quantizers, progressive bit reduction, and teacher-guided distillation. The methods are applied to settings from ImageNet vision models and edge devices to large language models, where evaluations include accuracy, perplexity, reasoning, and real-device speed. A central challenge is balancing accuracy against bit width and hardware cost: results depend on the numerical format and deployment path, and low-precision training can become unstable or diverge from inference behavior.

Latest papers

CardsList

94 papers11 papers in the last four weeks, down 39% on the four weeks before. 0.1% of all new papers.

  1. Topology-Constrained Quantized nnUNet for Efficient and Anatomically Accurate 3D Tooth Segmentation

    May 5, 2026Paarth Prasad, Ruchika MalhotraQuantization-Aware TrainingTopology-Preserving Image Segmentation

  2. Efficient INT8 Single-Image Super-Resolution via Deployment-Aware Quantization and Teacher-Guided Training

    Apr 22, 2026Pham Phuong Nam Nguyen, Nam Tien Le, Thi Kim Trang Vo +1Efficient Neural Network InferenceQuantization-Aware Training

  3. Device-Conditioned Neural Architecture Search for Efficient Robotic Manipulation

    Apr 11, 2026Yiming Wu, Huan Wang, Zhenghao Chen +2Hardware-Aware NASRobotic Manipulation

  4. EdgeRazor: A Lightweight Framework for Large Language Models via Mixed-Precision Quantization-Aware Distillation

    Apr 10, 2026Shu-Hao Zhang, Le-Tong Huang, Xiang-Sheng Deng +5Quantization-Aware DistillationLLM Quantization

  5. Bit-by-Bit: Progressive QAT Strategy with Outlier Channel Splitting for Stable Low-Bit LLMs

    Apr 9, 2026Binxing Xu, Hao Gu, Lujun Li +8LLM QuantizationQuantization-Aware Training

  6. QaRL: Rollout-Aligned Quantization-Aware RL for Fast and Stable Training under Training--Inference Mismatch

    Apr 9, 2026Hao Gu, Hao Wang, Jiacheng Liu +9Reinforcement LearningRL Fine-Tuning

  7. BWTA: Accurate and Efficient Binarized Transformer by Algorithm-Hardware Co-design

    Apr 5, 2026Yifu Ding, Xianglong Liu, Shenghao Jin +2Binary QuantizationLow-Bit Quantization

  8. AdaHOP: Fast and Accurate Low-Precision Training via Outlier-Pattern-Aware Rotation

    Apr 2, 2026Seonggon Kim, Alireza Khodamoradi, Pranathi Vasireddy +2Walsh-Hadamard TransformLow-Precision Training

  9. AdaLoRA-QAT: Adaptive Low-Rank and Quantization-Aware Segmentation

    Apr 1, 2026Prantik Deb, Srimanth Dhondy, N. Ramakrishna +3Medical Image SegmentationMedical Imaging Foundation Models

  10. MF-QAT: Multi-Format Quantization-Aware Training for Elastic Inference

    Apr 1, 2026Zifei Xu, Sayeh Sharify, Hesham MostafaQuantization-Aware TrainingNeural Network Quantization

  11. SynQ: Accurate Zero-shot Quantization by Synthesis-aware Fine-tuning

    Mar 19, 2026Minjun Kim, Jongjin Kim, U KangNeural Network QuantizationQuantization-Aware Training

  12. The Curse and Blessing of Mean Bias in FP4-Quantized LLM Training

    Mar 11, 2026Hengjie Cao, Zhendong Huang, Mengyi Chen +15LLM Quantization4-Bit Quantization

  13. Decoder-Free Distillation for Quantized Image Restoration

    Mar 10, 2026S. M. A. Sharif, Abdur Rehman, Seongwan Kim +1Image RestorationQuantization-Aware Distillation

  14. QATMA: Quantization-Aware Training with Multimodal Alignment for Open-Vocabulary Object Detection

    Mar 6, 2026Jinyeong Park, Donghwa Kang, Seunghwan An +4VLM QuantizationQuantization-Aware Training

  15. Trainable Bitwise Soft Quantization for Input Feature Compression

    Mar 5, 2026Karsten Schrödter, Jan Stenkamp, Nina Herrmann +1Neural Network QuantizationQuantization-Aware Training

  16. SageBwd: A Trainable Low-bit Attention

    Mar 2, 2026Jintao Zhang, Marco Chen, Haoxu Wang +5Attention QuantizationLow-Precision Training

  17. Boosting Entropy with Bell Box Quantization

    Mar 2, 2026Ningfeng Yang, Tor M. AamodtQuantizationNeural Network Quantization

  18. FairQuant: Fairness-Aware Mixed-Precision Quantization for Medical Image Classification

    Feb 26, 2026Thomas Woergaard, Raghavendra SelvanMixed-Precision QuantizationAlgorithmic Fairness

  19. pQuant: Towards Effective Low-Bit Language Models via Decoupled Linear Quantization-Aware Training

    Feb 26, 2026Wenzheng Zhang, Bingzheng Liu, Yang Hu +3LLM QuantizationLow-Bit Quantization

  20. Rank-Aware Spectral Bounds on Attention Logits for Stable Low-Precision Training

    Feb 21, 2026Seyed Morteza EmadiTransformer AttentionAttention Quantization

  21. UFO: Unlocking Ultra-Efficient Quantized Private Inference with Protocol and Algorithm Co-Optimization

    Feb 21, 2026Wenxuan Zeng, Chao Yang, Tianshi Xu +4Secure Multi-Party ComputationConvolutional Neural Networks

  22. 1-Bit Wonder: Improving QAT Performance in the Low-Bit Regime through K-Means Quantization

    Feb 17, 2026Sohir Maskey, Constantin Eichenberg, Johannes Messner +1QuantizationLLM Quantization

  23. Gated Relational Alignment via Confidence-based Distillation for Efficient VLMs

    Jan 30, 2026Yanlong Chen, Amirhossein Habibian, Luca Benini +1Cross-Modal Knowledge DistillationVision-Language Models

  24. QuantKAN: A Unified Quantization Framework for Kolmogorov Arnold Networks

    Nov 24, 2025Kazi Ahmed Asif Fuad, Lizhong ChenQuantization-Aware TrainingKolmogorov-Arnold Networks

  25. Quantization Effects of Artificial Neural Networks for Embedded Edge-Computing Applications

    Nov 7, 2025Alperen Aksoy, Ilja Bekman, Vesselin Dimitrov +6Neural Network QuantizationBinary Neural Networks