Low-Bit Quantization

Ask about this topic

Recent momentum

-26%

14 papers in the last 28 days · 0.4% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Also in Low-Bit Quantization

Neighbouring directions

QuantizationLarge Language Model QuantizationPost-Training QuantizationMixed-Precision QuantizationQuantization EffectsResidual Quantization

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-14

4 new papers

A weekly snapshot of new work published in Low-Bit Quantization.

Period ending 2026-09-07

7 new papers

A weekly snapshot of new work published in Low-Bit Quantization.

131 papers

Latest in Low-Bit Quantization

Open your feed →
CardsList

  1. Structured Transforms for Low-Overhead Quantization of Language Models

    Sep 11, 2026Daria Cherniuk, Alexander Rudikov, Boris Kashin +1Large Language Model QuantizationLow-Bit Quantization

  2. When Does Low-Bit Quantization Preserve the Decisions of Vector Search?

    Sep 9, 2026Wenxuan Xiao, Xu CaoLow-Bit QuantizationVector Database

  3. It's Not RoPE that Creates Sinks: The Role of Self-Concentration and Value-Non-Mixing in Attention

    Sep 8, 2026Raito Kiya, Satoki Ohashi, Kosuke Sato +6Large Language Model QuantizationLow-Bit Quantization

  4. KBBQ: A Predictive Noise Law and the Limits of Spectrum Flattening in FP4 Quantization

    Sep 8, 2026Lexington Whalen, Yuki Ito, Ryo SakamotoLow-Bit QuantizationMatrix Multiplication

  5. Hardware-Aware FP4 FlashAttention-4

    Sep 3, 2026Robert HuFp8Tensor Programs

  6. Compressing Streaming Neural Audio Encoders via Latent-Space Distillation

    Sep 3, 2026Prasanth Yadla, Mohammad Samragh, Dongseong Hwang +7Neural Audio CodecsTokenizer

  7. Why Gated DeltaNet Survives 4-Bit Quantization: NVFP4 W4A4 for the Recurrent Half of a Hybrid 27B LLM

    Sep 3, 2026Sergii Kozyrev, Davyd MaiborodaLarge Language Model QuantizationFp8

  8. From Ordered Bernoulli Levels to Critical-Line Geometry: Integer Quantization, Bernoulli Residual Phase, and Prime-Power Spectra

    Sep 3, 2026Y. Kenan YılmazLow-Bit QuantizationGeometric Reasoning

  9. PACodec: A Low-bitrate Neural Speech Codec with Parallel Additive Vector Quantization

    Sep 3, 2026Fei Liu, Yang Ai, Xiao-Hang Jiang +1Neural Audio CodecsCalibration-Free Low-Bit Vector Quantization

  10. HBQ: Hierarchical Scaling Block Quantization with Hardware-Efficiency-Aware Design for Accurate LLM Inference

    Aug 31, 2026Chun-Ting Chen, Dongmin Han, Hangyeol Mun +6Large Language Model QuantizationLow-Bit Quantization

  11. QTEA: Ternary LLMs with Sparse Residual Salient Weight and By-Column Optimization

    Aug 31, 2026Yipin Guo, Arun M George, Jie Fu +3Post-Training QuantizationLow-Bit Quantization

  12. Faithfulness Is Not Free: Auditing Offline KV-Cache Quantization in Retrieval-Augmented Generation

    Aug 31, 2026Atta Ul Asad, Ahsan Bilal, Muhammad Ali +2Key-Value Cache QuantizationQuantization

  13. Beyond Dense Adam States: Adaptive Log-Space Quantization for Memory-Efficient Optimizers

    Aug 23, 2026Yan WangLow-Bit QuantizationAdam

  14. In-Cell Learning: Language Models That Update Their Own Weights in Sequence Without Changing the File They Ship

    Aug 21, 2026Zifeng Liu, Yaxin Lu, Xuanhan Wu +6Model WeightsLow-Bit Quantization

  15. FQTree: Fine-grained Quantization and Hardware Generation of Boosted Decision Trees

    Aug 12, 2026Zhiqiang Que, Chang Sun, Haiyang Wang +6Low-Bit QuantizationField-Programmable Gate Arrays

  16. SoftWater: Class-Aware Rate Allocation for Softmax Quantization

    Aug 12, 2026Joao V. Cavalcanti, Ashia C. WilsonLow-Bit QuantizationGumbel-Softmax Relaxation

  17. Language-Conditional Dequantization: Recovering What Quantization Steals from Non-English Languages

    Aug 12, 2026Nirmal ThomasLarge Language Model QuantizationQuantization Effects

  18. From Sweep to Seam: Interleaved Cross-Block Post-Training Quantization

    Aug 10, 2026Achille Jacquemond, Yuma Ichikawa, Akira SakaiPost-Training QuantizationLow-Bit Quantization

  19. Tied Trit-Planes: Constraining PTQTP to a Uniform Nine-Level Quantizer, with a Persistent Folded Format for Disk-Streamed Mixture-of-Experts Serving

    Aug 9, 2026Matteo GrellaLarge Language Model QuantizationLow-Bit Quantization

  20. Which Decisions Low-Bit Quantization Breaks, and How to Predict Them

    Aug 6, 2026Zekun Wu, Swati Dhiman, Adriano KoshiyamaQuantization EffectsQuantization

  21. BaKron: Efficient Quantization with Kronecker-Factored Hessians

    Aug 6, 2026Johann Birnick, Rayan SaabMixed-Precision QuantizationLow-Bit Quantization

  22. NANQ: Noise-Floor-Aware Mixed-Precision Non-Uniform Quantization for Analog Compute-in-Memory

    Aug 3, 2026Yizhe Chen, Wenshuai Yao, Saiya Wang +6In-Memory ComputingMixed-Precision Quantization

  23. CascadeLUT: Information-Ordered Streaming Inference for Bandwidth-Constrained FPGAs

    Aug 1, 2026Oliver Cassidy, Marta Andronic, George A. ConstantinidesField-Programmable Gate ArraysFaster Inference

  24. VQ-bench: A Composable Vector Quantization Framework

    Jul 31, 2026Ashwin Padaki, Amir Ingber, Edo LibertyCalibration-Free Low-Bit Vector QuantizationLow-Bit Quantization

  25. MixFrag: Fragility-Guided Mixed-Precision Post-Training Quantization for Vision Transformers

    Jul 30, 2026Md. Mehrab Hossain Opi, Robiul Islam Ryad, Md. Umar FarukMixed-Precision QuantizationSelf-Supervised Vision Transformers

  26. Interpretable Representation via LLM-Driven Generative Disentanglement for Local-Life Service Recommendation

    Jul 30, 2026Long Zhang, Hao Jiang, Sheng Yu +3Recommendation ArchitectureRecommendation

  27. GyRot: Leveraging Hidden Synergy between Rotation and Fine-grained Group Quantization for Low-bit LLM Inference

    Jul 30, 2026Sangjin Kim, Yuseon Choi, Byeongcheol Kim +2Large Language Model QuantizationLow-Bit Quantization

  28. MXAttention: Data-Free Optimal Scaling and Pre-Normalization Quantization for MXFP4 Attention

    Jul 27, 2026Jianlin Yu, Jing Lin, Linghui Kong +13Low-Bit QuantizationVideo Diffusion Models

  29. Research Report on Noise-Shaped One-Bit Coefficients in Discrete Polynomial Fourier Extension

    Jul 26, 2026Shengquan WangFourierLow-Bit Quantization

  30. VibeVoice-ASR-BitNet Technical Report

    Jul 23, 2026Songchen Xu, Ting Song, Shaohan Huang +10Faster InferenceAudio Tokens

  31. QuantiBias: Benchmarking Quantization-Induced Bias in LLMs

    Jul 23, 2026Emilio FerraraLarge Language Model BiasLarge Language Model Quantization

  32. GaugeQuant: Online Learning of Quantization-Optimal Bases from LLM Symmetries

    Jul 22, 2026Miguel P. Bento, João F. SeabraLow-Bit QuantizationSymmetry

  33. VQ-Transplant: Efficient VQ-Module Integration for Pre-trained Visual Tokenizers

    Jul 21, 2026Xianghong Fang, Yuan Yuan, Dehan Kong +1Calibration-Free Low-Bit Vector QuantizationDiscrete Image Tokenizers

  34. Efficient Audio-Visual Event Recognition via Knowledge Distillation and Dynamic INT8 Quantization of a Hybrid Cross-Attention Network

    Jul 18, 2026Parinaz Binandeh Dehaghani, Danilo Pena, A. Pedro AguiarConvolutional Neural Network CompressionAudio-Visual Reasoning

  35. Half the Experts, All the Code: One-Shot Domain Pruning of Mixture-of-Experts LLMs for Coding

    Jul 18, 2026Anik JhaMixture-Of-Expert Language ModelsCodebooks

  36. Cross-Layer Error Compensation and Finite-Sample Feature-Statistics Matching for Extreme Low-Bit Quantization of Large Language Models

    Jul 16, 2026Ryona NodaLarge Language Model QuantizationPost-Training Quantization

  37. Quantize with Confidence? An Empirical Study of Quantization for Code Generation

    Jul 15, 2026Saima Afrin, Md. Zahidul Haque, Antonio MastropaoloQuantization EffectsQuantization

  38. AVQ-Attention: Adaptive Vector-Quantized Attention

    Jul 14, 2026Winfried van den dool, Patrick Forré, Amir Habibian +2Calibration-Free Low-Bit Vector QuantizationSelf-Attention Mechanism

  39. Reliability Scaling Laws for Quantized Large Language Models

    Jul 12, 2026Sirine Ayadi, Sándor Daróczi, Stephan Günnemann +1Large Language Model QuantizationLarge Language Model Reliability

  40. Differentiable Proxy Learning for Adaptive Quantization Control in H.264 Video Coding

    Jul 11, 2026Qihan Xu, Ivan V. BajićLow-Bit QuantizationRate-Distortion Theory

  41. Fractal KV-Cache Archives: Lossless Symbolic Storage with In-Place Retrieval for Long-Context LLM Inference

    Jul 8, 2026Vladimir GusevKey-Value CacheKv-Cache Steering

  42. Open Problem: Is Interaction Necessary for Order-Optimal 1-bit Mean Estimation?

    Jul 3, 2026Ivan Lau, Jonathan ScarlettOptimal Sample ComplexityEstimators

  43. Variable Bit-width Quantization: Learning Per-Group Precision for "Bigger-but-Smaller" Language Models

    Jul 3, 2026Hamish OgilvyLarge Language Model QuantizationLow-Bit Quantization

  44. OrbitQuant: Data-Agnostic Quantization for Image and Video Diffusion Transformers

    Jul 2, 2026Donghyun Lee, Jitesh Chavan, Duy Nguyen +5Diffusion TransformersLow-Bit Quantization

  45. Boundary-Aware Quantization: Finite-Scale Decision Geometry of Neural Classifiers

    Jul 1, 2026O. M. KiselevLow-Bit QuantizationFlips

  46. GEAR: Guided End-to-End AutoRegression for Image Synthesis

    Jun 30, 2026Bin Lin, Zheyuan Liu, Chenguo Lin +8Autoregressive Image GenerationGenerative Models

  47. Zero-Shot Quantization for Object Detectors using Off-the-Shelf Generative Models

    Jun 30, 2026Hyunho Lee, Kyomin Hwang, Hyeonjin Kim +3Low-Bit QuantizationQuantization

  48. The Joint Effect of Quantization and Sampling Temperature on LLM Safety Alignment: A Factorial Analysis

    Jun 28, 2026Hari Prasad, Ritam PalLarge Language Model SafetyLarge Language Model Quantization

  49. Adaptive Joint Compression and Synchronisation in Federated Split Learning for IoT Rainfall Prediction

    Jun 23, 2026Wenjie Ding, Yi Sin Lin, Jiale Liu +8Wireless Resource AllocationLow-Latency Systems

  50. GRINQH: Graded Input-based Quantization Hierarchy for Efficient LLM Generation

    Jun 22, 2026Jette Oberländer, Jan Finkbeiner, Catherine M. Schöfmann +1Large Language Model QuantizationLLM Inference Efficiency

  51. Efficient Document Tampering Localization with Multi-Level Discrepancy Features and Unified DCT-Quantization Embedding

    Jun 21, 2026Mohamed Dhouib, Ye Zhu, Sonia Vanier +1Face Forgery DetectionEncoder-Decoder Framework

  52. π-RAG: Oblivious Retrieval via Semantic Quantization and Transcendental Addressing for Large Language Models

    Jun 20, 2026Aniket Wattamwar, Mrunal KakirwarPrivacy-Preserving FrameworkRetrieval-Augmented Generation

  53. ScalePredictor: Instance-aware Scale Learning for Accurate Quantization of Vision Transformers

    Jun 20, 2026Changjun Li, Runqing Jiang, Lian Xu +3Post-Training QuantizationVision Transformer

  54. An Empirical Study of OpenPangu Quantization on Ascend NPUs

    Jun 19, 2026Tong Shi, Jiacheng Wang, Hui Xie +4Post-Training QuantizationLow-Bit Quantization

  55. Techniques for Peak Memory Reduction for LoRA Fine-tuning of LLMs on Edge Devices

    Jun 17, 2026Hassan Dbouk, Matthias Reisser, Prathamesh Mandke +2Peak MemoryLow-Bit Quantization

  56. Shift-and-Sum Quantization for Visual Autoregressive Models

    Jun 15, 2026Jaehyeon Moon, Bumsub HamVisual Autoregressive ModelsLow-Bit Quantization

  57. Signed Symmetric Quantization for Few-Bit Integers

    Jun 12, 2026Ian Colbert, Eashan Dash, Pablo Monteagudo-Lago +5Low-Bit QuantizationAsymmetric

  58. Realizing Native INT8 Compute for Diffusion Transformers on Consumer GPUs: A Fused INT8 GEMM Kernel for Ideogram 4.0

    Jun 12, 2026Ali Asaria, Tony Salomone, Deep GandhiDiffusion TransformersSystematic Fp16 Divergence

  59. Efficiency-Performance Trade-offs in Neural Speaker Diarization via Structured Pruning and Low-Bit Quantization

    Jun 12, 2026Rishit Chatterjee, Tahiya ChowdhurySpeaker DiarizationNeural Audio Codecs

  60. TWLA: Achieving Ternary Weights and Low-Bit Activations for LLMs via Post-Training Quantization

    Jun 11, 2026Zhixiong Zhao, Zukang Xu, Zhixuan Chen +3Large Language Model QuantizationPost-Training Quantization