Overview

Four-bit quantization studies how to run or train neural networks with compact INT4 or FP4 values, reducing memory use and data movement for deployment. Post-training methods use calibration, learned scales or codebooks, rotations, and outlier or residual compensation; quantization-aware training instead adapts model parameters to low precision during training. Work spans large language models, vision and diffusion models, and inference components such as attention and KV caches, with evaluations measuring accuracy alongside latency, throughput, and memory. Many systems now approach higher-precision quality in specific settings, but results remain sensitive to activation outliers, calibration data, model architecture, and hardware format, so robustness and practical speedups are still key challenges.

Latest papers

CardsList

103 papers11 papers in the last four weeks, down 35% on the four weeks before. 0.1% of all new papers.

  1. CertiSum: Bitwise-Identical MXFP4 Training Across Platforms and Parallelism Layouts

    Nov 16, 2026Steve Rhyner, Yubo Gao, Stefan de Lasa +2ML ReproducibilityMixed-Precision Training

  2. SoScale: Second-Order Scale Search for FP4 Quantization

    Nov 12, 2026Pengxiang Zhao, Xing Li, Hui-Ling Zhen +3LLM QuantizationNeural Network Quantization

  3. BitDecoding-FP4: Native FP4 KV Cache Decoding via Algorithm-System Co-Design

    Nov 6, 2026Dayou Du, Woon Yee Ng, Guangming Sheng +3LLM Inference AccelerationKV-Cache Quantization

  4. FP4Quant: Efficient 4-Bit Communication Compression for Model-Parallel LLM Training

    Nov 3, 2026Man Liu, Xingchen Liu, Hairui Zhao +2Communication-Efficient Distributed Training4-Bit Quantization

  5. What Does 4-Bit Microscaling Cost a Wearable Activity Recognizer?

    Nov 3, 2026Megan Healy, Hossein Valavi4-Bit QuantizationActivation Quantization

  6. Audit at the Precision You Deploy: Quantization Reshapes a Subliminally Learned Preference

    Oct 31, 2026Md Rayhanul Masud, Mst Suraiya Akter ShefaQuantization RobustnessLLM Quantization

  7. Integer-Exact Microscaling: Running MXFP4 Language Models on INT8 Matrix Units

    Oct 31, 2026Shinyoung Kang, Junhyung Ahn, Yujun Kim +1LLM QuantizationNeural Network Quantization

  8. PACE: Periodic and Channel-Aligned Encoding of Four-Bit Recurrent States

    Oct 21, 2026Patrick Haller, Filipe Laitenberger, Alan AkbikRecurrent-State QuantizationLLM Quantization

  9. PACT: NVFP4 Data-Flow LoRA Fine-Tuning on Consumer GPUs

    Oct 18, 2026Lei Gao, Hossein Entezari Zarch, Chaoyi Jiang +1Memory-Efficient Fine-TuningParameter-Efficient Fine-Tuning

  10. What Matters for NVFP4 Training? A Comparative Study of Low-Precision Pretraining Recipes

    Oct 17, 2026Anjulie Agrusa, Andrei Panferov, Elizabeth Wei +7Low-Precision TrainingLanguage Model Pretraining

  11. Fractional Power-of-Two Quantization for Efficient and Effective Multiplier-Free LLM Inference

    Oct 15, 2026Sunghyun Wee, Geunjae Choi, Hyeonjin Kim +2LLM QuantizationNeural Network Quantization

  12. Mixed Precision Scaling Laws for Quantized Pretraining

    Oct 13, 2026Jinuk Kim, Rajarshi Saha, Muhammed Fatih Balin +1Mixed-Precision QuantizationLLM Quantization

  13. Error-Based Bidirectional Predictive Coding Enables Deep, 4-Bit Predictive Coding Networks

    Oct 11, 2026Garrett Kinman, Zeljko ZilicPredictive Coding4-Bit Quantization

  14. Rounding in Preconditioner Space: Redesigning 4-bit AdamW Optimizer-State Quantization

    Oct 8, 2026Hanyang Li, Shao Tang, Daniel Thomas Braithwaite +7Stochastic Rounding4-Bit Quantization

  15. Deflating the Hessian: Rank-4 W4A4 Quantization for Multimodal Diffusion Transformers

    Oct 8, 2026Shiwen Wang, Pengxiang Zhao, Xiaoming YuanDiffusion Model QuantizationPost-Training Quantization

  16. OSFP4: Joint Optimization of Diagonal Smoothing and Block Scales for NVFP4 Quantization

    Oct 6, 2026Neriah Ben David, Ori Meir, Or OrdentlichLLM QuantizationNeural Network Quantization

  17. LatentQuant: Preserving the Policy-Facing Latent Contract under NVFP4 VAE Quantization

    Oct 2, 2026Ziye Deng, Lufang Chen, Shuyu Feng +7Neural Network Quantization4-Bit Quantization

  18. Replay the Curvature: Accurate and Scalable NVFP4 Quantization for Large Language Model Inference

    Sep 29, 2026Ruiyi Ding, Jie Li, Kang He +4LLM QuantizationPost-Training Quantization

  19. JustQuant: You Don't Need Smoothing, SVD, or Rotation for 4-Bit Activation Quantization

    Sep 27, 2026Kaicheng Yang, Kaisen Yang, Chunyu Liu +8Neural Network QuantizationDiffusion Model Quantization

  20. PulseQuant: Propagation-Guided Subspace Correction for 4-Bit Video Diffusion Transformers

    Sep 27, 2026Yutong Wang, Xingtong Ge, Enhuai Liu +4Video Diffusion ModelsDiffusion Transformer

  21. Q-WAM: 4-Bit Quantization of World Action Models with Action-Subspace Protection

    Sep 27, 2026Arash Akbari, Arman Akbari, Jingwu Luo +7Mixed-Precision Quantization4-Bit Quantization

  22. PrismQuant: Optimal Null-Space Rotations for Grouped Quantizers

    Sep 26, 2026Yanlong Chen, Yining Chen, Song Zhang +2LLM QuantizationRotation-Based Quantization