Mixed-Precision Quantization

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

15 new papers

A weekly snapshot of new work published in Mixed-Precision Quantization.

Period ending 2026-09-14

13 new papers

A weekly snapshot of new work published in Mixed-Precision Quantization.

Period ending 2026-09-07

12 new papers

A weekly snapshot of new work published in Mixed-Precision Quantization.

Inside this field

Focused directions

464 papers

Latest in Mixed-Precision Quantization

Browse all topics →
CardsList

  1. QuBLAST: A Framework for Quantizing Large Language Models with Block-Level Compression Approach and Activation Scaling Strategy

    Jun 3, 2026Pasindu Wickramasinghe, Achyuta Muthuvelan, Rachmad Vidya Wicaksana Putra +2Large Language Model QuantizationQuantizer

  2. Characterizing the Impact of NVFP4 Quantization for Low-Power Edge AI Deployment

    Jun 3, 2026Ovishake Sen, Venkata Nithin Kamineni, Daniel Lobo +3Fp8Edge

  3. DSIRM: Learning Query-Bridged Discrete Semantic Identifiers for E-commerce Relevance Modeling

    Jun 3, 2026Bokang Wang, Xing Fang, Mingmin Jin +4RelevanceQuantizer

  4. Selective Coupling of Decoupled Informative Regions: Masked Attention Alignment for Data-Free Quantization of Vision Transformers

    Jun 3, 2026Biao Qian, Yang Wang, Yong Wu +1Extreme Low-Bit QuantizationVision Transformer

  5. MorphoQuant: Modality-Aware Quantization for Omni-modal Large Language Models

    Jun 3, 2026Yue Wu, Changyuan Wang, Zixuan Wang +2Weight-Only QuantizationQuantization

  6. Recover-LoRA for Aggressive Quantization: Reclaiming Accuracy in 2-Bit Language Models via Low-Rank Adaptation with Knowledge Distillation on Synthetic Data

    Jun 2, 2026Devleena Das, Rajeev Patwari, Elliott Delaye +1Large Language Model QuantizationLLM Inference Efficiency

  7. dMX: Differentiable Mixed-Precision Assignment for Low-Precision Floating-Point Formats

    Jun 2, 2026Giuseppe Franco, Ian Colbert, Pablo Monteagudo-Lago +2Mixed-Precision QuantizationFull-Precision Performance

  8. P-Cast Precision in FP8 Attention: Sink-Induced Collapse and the Optimality of S=2^8

    Jun 2, 2026Reed LauFull-Precision PerformanceFp8

  9. LLM Compression with Jointly Optimizing Architectural and Quantization choices

    Jun 2, 2026Hoang-Loc La, Truong-Thanh Le, Amir Taherkordi +1Large Language Model CompressionLLM Inference Efficiency

  10. LiftQuant: Continuous Bit-Width LLM via Dimensional Lifting and Projection

    Jun 2, 2026Liulu He, XuanAng Liu, Juntao Liu +8Large Language Model QuantizationLow-Bit

  11. Exact equivariance, kept through training, buys zero-shot generalisation across the symmetry group

    Jun 2, 2026Hongbo WangExact EquivarianceEquivariance

  12. Perplexity Can Miss SAE Feature Damage Under Quantization

    Jun 2, 2026Evan DuanQuantizationQuantizer

  13. Qift: Shift-Friendly No-Zero W2 Post-Training Quantization for Rotated W2A4/KV4 LLM Inference

    Jun 1, 2026Chi-Wei Huang, Chia-Chi TsaiWeight-Only QuantizationQuantization

  14. Novel Aspects of IEEE SA P3109 Arithmetic Formats for Machine Learning

    Jun 1, 2026Andrew Fitzgibbon, Christoph M. Wintersteiger, Jeffrey SarnoffFloating-PointApproximation

  15. Massive Spikes in LLMs are Bias Vectors: Mechanistic Uncovering and Spike-Free Quantization

    Jun 1, 2026Yung-Chin Chen, Chung Peng Lee, Ze-Wei Liou +1Large Language Model QuantizationBinary Spikes

  16. Extreme Low-Bit Inference in Reasoning Models: Failure Modes and Targeted Recovery

    Jun 1, 2026Ekaterina Alimaskina, Darya Rudas, Denis Shveykin +3Large Language Model QuantizationLarge Reasoning Models

  17. Alignment Collapse Under KV Cache Quantization: Diagnosis and Mitigation

    Jun 1, 2026Bruce Changlong Xu, Adarsh Kumarappan, Mu ZhouKey-Value Cache QuantizationExtreme Low-Bit Quantization

  18. GPTQ-intrinsic LoRA: A Near-optimal Algorithm for Low-precision Quantization with Low-rank Adaptation

    May 31, 2026Shihao Zhang, Rayan SaabWeight-Only QuantizationQuantization

  19. When Is 0.1% Enough? Analyzing the Combined Effects of Dimensionality Reduction and Quantization on Text Embedding Compression

    May 31, 2026Riku Kisako, Hayato Tsukagoshi, Ryohei SasanoLarge Language Model CompressionDomain-Invariant Text Embeddings

  20. ScaleSweep: Accurate NVFP4 Post-Training Quantization of LLMs via Block Scale Initialization

    May 30, 2026Li Lin, Xiaojun WanFp8Quantization

  21. GNMR: Runtime Stability Control for Low-Precision Large Language Model Training

    May 30, 2026Boao Kong, Weichen Jia, Engao Zhang +6Full-Precision PerformanceRuntime Enforcement

  22. ProjQ: Project-and-Quantize for Adapter-Aware LLM Compression

    May 30, 2026Wenya Yu, Chao Zhang, Li Wang +2Large Language Model QuantizationLarge Language Model Compression

  23. Hallucination Is Linearly Decodable from Mid-Layer Hidden States in Quantized LLMs

    May 30, 2026Aizierjiang AiersilanHidden StatesLarge Language Model Quantization

  24. Stochastic Rounding Increases Small Singular Values

    May 29, 2026Linkai Ma, Tingzhou Yu, Petros DrineasSingular Value DecompositionFull-Precision Performance

  25. Inner Product Aware Quantization: Provably Fast, Accurate, and Adaptive Algorithms

    May 29, 2026Nathan White, Krish SingalQuantization

  26. Bit-Exact AI Inference Verification Without Performance Tradeoffs

    May 29, 2026Naci CankayaOnline InferenceVerifier

  27. Quantized Reasoning Models Think They Need to Think Longer, but They Do Not

    May 29, 2026Sanae Lotfi, Polina Kirichenko, Steven Li +1Large Reasoning ModelsLarge Language Model Quantization

  28. The Shape of Addition: Geometric Structures of Arithmetic in Large Language Models

    May 29, 2026Liuyuan Wen, Xun Zhu, Lihao Huang +2ArithmeticLarge Language Model Quantization

  29. QVGGT: Post-Training Quantized Visual Geometry Grounded Transformer

    May 29, 2026Zhizhen Pan, Hesong Wang, Huan Wang3D PerceptionSelf-Supervised Vision Transformers

  30. Enhancing Human-Likeness in Reinforcement Learning Agents via Hierarchical Macro Action Quantization

    May 29, 2026M. Shaheer Luqman, Usman Nizamani, Fawad Javed Fateh +4Hierarchical Reinforcement LearningDeep Reinforcement Learning

  31. HARP: Hadamard-Preconditioned Adaptive Rotation Processor for Extreme LLM Quantization

    May 28, 2026Artur Zagitov, Gleb Molodtsov, Aleksandr BeznosikovWeight-Only QuantizationLarge Language Model Quantization

  32. LFQ: Logit-aware Final-block Quantization for Boosting the Generation Quality of Low-Bit Quantized LLMs

    May 28, 2026Jung Hyun Lee, June Yong Yang, Jungwook Choi +1Large Language Model QuantizationWeight-Only Quantization

  33. BitTP: The Lightweight Trajectory Prediction Model with BitLLM for Edge-Devices

    May 28, 2026Mincheol Kang, Hyunjin Lim, Bomin Kang +1Large Language Model QuantizationTrajectory Prediction

  34. Apertus LLM Family Expansion via Distillation and Quantization

    May 27, 2026Andrei Panferov, Davit Melikidze, Martin Jaggi +1Large Language Model QuantizationLarge Language

  35. Ω-QVLA: Robust Quantization for Vision-Language-Action Models via Composite Rotation and Per-step Scaling

    May 27, 2026Xinyu Wang, Mingze Li, Sicheng Lyu +6Vision-Language-Action ModelsExtreme Low-Bit Quantization

  36. Expressive Power of Floating-Point Neural Networks with Arbitrary Reduction Orders and Inexact Activation Implementations

    May 27, 2026Yeachan Park, Geonho Hwang, Wonyeol Lee +1Floating-PointActivation Functions

  37. OSP-Next: Efficient High-Quality Video Generation with Sparse Sequence Parallelism, HiF8 Quantization, and Reinforcement Learning

    May 27, 2026Yunyang Ge, Xianyi He, Zezhong Zhang +4Text-To-Video ModelsLong Video Generation

  38. TARQ: Tail-Aware Reconstruction Quantization for Rare-Word Robust Automatic Speech Recognition

    May 27, 2026Xinyu Wang, Ziyu Zhao, Ke Bai +4Speech Large Language ModelsWeight-Only Quantization

  39. Hurwitz Quaternion Multiplicative Quantization for KV Cache Compression

    May 26, 2026Kabir Swain, Sijie Han, Daniel Karl I. Weidele +3Key-Value Cache QuantizationQuantization

  40. Timestep-Aware SVDQuant-GPTQ for W4A4 Quantization of Wan2.2-I2V

    May 26, 2026Junhao Wu, Dezhong Yao, Hai JinW4A4 QuantizationSingular Value Decomposition

  41. WINDQuant: Weight-Informed Neural Decision-Making for Global Mixed-Precision LLM Quantization

    May 26, 2026Phong Nam Huu Nguyen, Khoi M. Le, Cong-Duy T Nguyen +3Large Language Model QuantizationQuantization

  42. Tail-Aware HiFloat4: W4A4 Post-Training Quantization for Wan2.2

    May 26, 2026Zhanfeng Feng, Shuai Guo, Xin Di +3Weight-Only QuantizationFp8

  43. Dense2MoE: Pushing the Pareto Frontier of On-Device LLMs via Unified Pruning and Upcycling

    May 26, 2026Fengfa Li, Hongjin Ji, Yifeng Ding +2Mixture-Of-Expert InferenceMixture-of-Experts Models

  44. QAM-W: Joint 2D Codebook Quantization for LLM Weights via Hadamard Rotation and Activation-Aware Scaling

    May 25, 2026Preetam Sharma, Kacper DobekWeight-Only QuantizationModel Weights

  45. Reparametrizing Shampoo and SOAP for Subspace Basis Updates and BFloat16 Storage

    May 25, 2026Alan Milligan, Zikun Xu, Simon Lacoste-Julien +2Systematic Fp16 DivergenceComputational Cost

  46. GoQuant: Geometric Orthogonal Residual Projection for Multiplier-Free Power-of-Two Transformer Quantization

    May 25, 2026Maoyang Xiang, Tao Luo, Bo WangQuantizationFlexible Register Transfer Level Design Automation

  47. Channel-wise Vector Quantization

    May 25, 2026Wei Song, Tianhang Wang, Yitong Chen +5Autoregressive Image GenerationVisual Tokens

  48. Mapping the Schedule x Bit-Width Boundary in Sub-100M Quantisation-Aware Training

    May 25, 2026Christian Brandt ThomassenLow-BitLearning Rates

  49. The Quantization Benefits of Residual-Free Transformers

    May 25, 2026Yiping Ji, Mahalakshmi Sabanayagam, Peyman Moghadam +2Transformer Residual StreamsWeight-Only Quantization

  50. Max-Window Scale Estimation for Near-Lossless HiF8 W8A8 Quantization-Aware Training

    May 25, 2026Yingying Cheng, Jinquan Shi, Li Zhou +4Large ModelsQuadratic Attention

  51. JacQuant: STE-Free Quantization-Aware Training via Learned Jacobian Surrogates

    May 25, 2026Kai Yi, Vignesh Vivekraja, Harshit Khaitan +1Extreme Low-Bit QuantizationTime-Step-Wise Learnable Surrogate Gradient Function

  52. InfoQuant: Shaping Activation Distributions for Low-Bit LLM Quantization

    May 25, 2026Ke Li, Dong An, Xiaoling Zang +6Large Language Model QuantizationQuantization

  53. Influence-Inspired Spectral Rotations for Extreme Low-Bit LLM Quantization

    May 24, 2026Gorgi PavlovLarge Language Model QuantizationLLM Inference Efficiency

  54. Scale When Needed: Adaptive Neuron-level Mixed Precision Quantization Aware Training

    May 24, 2026Ayush K. Varshney, Konstantinos Vandikas, Šarūnas Girdzijauskas +2Mixed-Precision QuantizationSparse Deep Neural Network Accelerators

  55. Fermi-Dirac machines as quantizations of neurons

    May 23, 2026Alexander He, Nana Liu, Mark M. WildeQuantum ComputingHamiltonian

  56. EVA: Accelerating LLM Decoding via an Efficient Vector Quantization Architecture

    May 22, 2026Bowen Duan, Cong Guo, Chiyue Wei +8Calibration-Free Low-Bit Vector QuantizationExtreme Low-Bit Quantization

  57. BitsMoE: Efficient Spectral Energy-Guided Bit Allocation for MoE LLM Quantization

    May 22, 2026Jiayu Zhao, Zihan Teng, Minhao Fan +4Large Language Model QuantizationMixture-Of-Expert Language Models

  58. Signs Beat Floats: Low-Rank Double-Binary Adaptation for On-Device Fine-Tuning

    May 22, 2026Yoshihiko Fujisawa, Yuma Ichikawa, Yudai Fujimoto +2Low-Rank Adaptation AdaptersLarge Language Model Quantization

  59. ThriftAttention: Selective Mixed Precision for Long-Context FP4 Attention

    May 21, 2026Joe SharrattEfficient Long-Context InferenceQuantizer

  60. GEMQ: Global Expert-Level Mixed-Precision Quantization for MoE LLMs

    May 21, 2026Jianing Deng, Song Wang, Dongwei Wang +4Mixed-Precision QuantizationMixture-Of-Expert Language Models