Mixed-Precision Quantization

Ask about this field

Recent momentum

emerging

0 papers in the last 28 days · 0.0% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this field, kept on the site without email delivery.

Period ending 2026-09-21

15 new papers

A weekly snapshot of new work published in Mixed-Precision Quantization.

Period ending 2026-09-14

13 new papers

A weekly snapshot of new work published in Mixed-Precision Quantization.

Period ending 2026-09-07

12 new papers

A weekly snapshot of new work published in Mixed-Precision Quantization.

Inside this field

Focused directions

464 papers

Latest in Mixed-Precision Quantization

Browse all topics →
CardsList

  1. HyperQuant: A Rate-Distortion-Optimal Quantization Pipeline for Large Language and Diffusion Models

    Jun 22, 2026Yuval Domb, Hadar Sackstein, Tomer SolbergWeight-Only QuantizationQuantization

  2. Efficient Network Inference via Hardware-Aware Architecture Search, Model Pruning & Quantization

    Jun 22, 2026Lucas Heublein, Mark Deutel, Axel Plinge +1Graph Neural Network InferenceReal-Time Inference

  3. Hybrid Compression: Integrating Pruning and Quantization for Optimized Neural Networks

    Jun 22, 2026Minh-Loi Nguyen, Long-Bao Nguyen, Van-Hieu Huynh +2Graph Neural Network InferenceMixed-Precision Quantization

  4. On the Expressive Power of Weight Quantization in Large Language Models

    Jun 20, 2026Shao-Qun ZhangLarge Language Model QuantizationQuantization

  5. ππ-RAG: Oblivious Retrieval via Semantic Quantization and Transcendental Addressing for Large Language Models

    Jun 20, 2026Aniket Wattamwar, Mrunal KakirwarPrivacy-Preserving FrameworkExtreme Low-Bit Quantization

  6. Fine-Tuning Large Language Models for Quantum Reasoning

    Jun 20, 2026Katherine Ip, Casey R. Myers, Udaya Parampalli +2Large Language Model QuantizationLarge Language Model Reasoning

  7. ScalePredictor: Instance-aware Scale Learning for Accurate Quantization of Vision Transformers

    Jun 20, 2026Changjun Li, Runqing Jiang, Lian Xu +3Vision TransformerQuantizer

  8. HERALD: High-Throughput Block Diffusion LLM Serving via CPU-GPU Cooperative KV Cache Retrieval

    Jun 19, 2026Omin Kwon, Doyeon Kim, Jongseok Park +3LLM Inference EfficiencyGraphics Processing Unit Memory

  9. Fast-TurboQuant: A Multiplier-Free Online Vector Quantization Approach

    Jun 19, 2026Pedro M. R. Pereira, Felipe A. P. de Figueiredo, Rausley A. A. de SouzaCalibration-Free Low-Bit Vector QuantizationQuantization

  10. Compiling Differentiable Audio Graphs to Real-Time DSP

    Jun 19, 2026Facundo Franchino, Sebastian J. SchlechtMusic EditingAudio

  11. An Empirical Study of OpenPangu Quantization on Ascend NPUs

    Jun 19, 2026Tong Shi, Jiacheng Wang, Hui Xie +4Weight-Only QuantizationNeural Processing Units

  12. Demystifying Numerical Instability in LLM Inference: Achieving Reproducible Inference for Mission-Critical Tasks with HEAL

    Jun 19, 2026Zhenting Zhu, Lucas Thai, Shan Yu +5Full-Precision PerformanceLLM Inference Efficiency

  13. Rethinking Shrinkage Bias in LLM FP4 Pretraining: Geometric Origin, Systemic Impact, and UFP4 Recipe

    Jun 18, 2026Qian Zhao, Kunlong Chen, Changxin Tian +9Fp8Large Language Model Pretraining

  14. Mix-QVLA: Task-Evidence-Aware Mixed-Precision Quantization of Vision-Language-Action Models

    Jun 17, 2026Navin Ranjan, Andreas SavakisMixed-Precision QuantizationWeight-Only Quantization

  15. Displacement Is Not Direction: Evaluating Fidelity Metrics for Quantized LLM Deployment

    Jun 17, 2026Miloš Nikolić, Ali Hadi Zadeh, Enrique Torres Sanchez +1Large Language Model QuantizationKullback-Leibler Divergence

  16. Techniques for Peak Memory Reduction for LoRA Fine-tuning of LLMs on Edge Devices

    Jun 17, 2026Hassan Dbouk, Matthias Reisser, Prathamesh Mandke +2Low-Rank AdaptationQuantizer

  17. SwitchBraidNet: Quantisation-Aware Lightweight Architecture for Hybrid Brain-Computer Interface

    Jun 17, 2026Gourav Siddhad, Yogesh Kumar MeenaBrain-Computer InterfaceNeuromorphic Hardware

  18. Attribution-Guided and Coverage-Maximized Pruning for Structural MoE Compression

    Jun 16, 2026Yifu Ding, Jiacheng Wang, Ge Yang +4Mixture-Of-Expert InferenceMixture-of-Experts Models

  19. MODE: Modality-Decomposed Expert-Level Mixed-Precision Quantization for MoE Multimodal LLMs

    Jun 15, 2026Yuanteng Chen, Peisong Wang, Zhilei Liu +9Mixture-Of-Expert Language ModelsMixed-Precision Quantization

  20. Shift-and-Sum Quantization for Visual Autoregressive Models

    Jun 15, 2026Jaehyeon Moon, Bumsub HamVisual Autoregressive ModelsQuantizer

  21. Do Activation Monitors Survive Model Updates? Benchmarking, Predicting, and Repairing Activation-Monitor Staleness

    Jun 14, 2026Evan DuanModel ActivationsHarmful Fine-Tuning

  22. ReQAT: Achieving Full-Precision Reasoning Accuracy with 4-bit Floating-Point Quantization-Aware Training

    Jun 14, 2026Janghwan Lee, Sihwa Lee, Jinseok Kim +4Fp8Floating-Point

  23. MosaicQuant: Inlier-Outlier Disaggregation for Unified 4-Bit LLM Quantization

    Jun 14, 2026Yangjia Hu, Haodong Wang, Zicong Hong +8Large Language Model QuantizationLow-Bit

  24. AQ4SViT: An Automated Quantization Framework with Search Gating Policy for Compressing Spiking Vision Transformers

    Jun 14, 2026Rachmad Vidya Wicaksana Putra, Saad Iftikhar, Muhammad ShafiqueExtreme Low-Bit QuantizationSelf-Supervised Vision Transformers

  25. Signed Symmetric Quantization for Few-Bit Integers

    Jun 12, 2026Ian Colbert, Eashan Dash, Pablo Monteagudo-Lago +5Low-BitAsymmetric

  26. Realizing Native INT8 Compute for Diffusion Transformers on Consumer GPUs: A Fused INT8 GEMM Kernel for Ideogram 4.0

    Jun 12, 2026Ali Asaria, Tony Salomone, Deep GandhiMultimodal Diffusion TransformersSystematic Fp16 Divergence

  27. Optimality-Preserving Decomposition for Scalable QAOA in Natural-Language-Guided Multi-Drone Assignment

    Jun 12, 2026Junyeop Bang, Byongho Lee, Dohyun An +1Quantum Approximate Optimization AlgorithmMulti-Drone Coordination

  28. Aligning Quantum Operators with Large Language Models

    Jun 11, 2026Rogerio Feris, Yunchao Liu, Pengyuan Li +2Quantum Machine LearningQubit

  29. Quantizing Time-Series Models As Dynamical Systems: Trajectory-Based Quantization Sensitivity Score

    Jun 11, 2026Mariya Pavlova, Harrison Bo Hua Zhu, Lidia Vitanova +2QuantizationQuantile Regression

  30. ReSET: Accurate Latency-Critical NVFP4 Reasoning via Step-Aware Temperature Scaling

    Jun 11, 2026Sihwa Lee, Janghwan Lee, Donghoon Yoo +4Fp8Autoregressive Decoding

  31. TWLA: Achieving Ternary Weights and Low-Bit Activations for LLMs via Post-Training Quantization

    Jun 11, 2026Zhixiong Zhao, Zukang Xu, Zhixuan Chen +3Large Language Model QuantizationLLM Inference Efficiency

  32. Multi-Bitwidth Quantization for LLMs Using Additive Codebooks

    Jun 11, 2026Liza Babaoglu, Shuangyi Chen, Ashish KhistiLarge Language Model QuantizationWeight-Only Quantization

  33. Graph Reinforcement Learning for Calibration-Aware Quantum Circuit Routing

    Jun 11, 2026Yash Vardhan Tomar, Dheeraj PeddireddyQuantum Circuit SimulationQuantization

  34. Holding the FP8 Quality Ceiling at 8-Bit Weights and Activations: INT8 and GGUF Post-Training Quantization of Ideogram 4.0 for Consumer GPUs

    Jun 10, 2026Deep Gandhi, Ali Asaria, Tony SalomoneWeight-Only QuantizationW4A4 Quantization

  35. DynamicPTQ: Mitigating Activation Quantization Collapse via Residual-Stream Dynamics

    Jun 10, 2026Zimo Zhao, Maolin Wang, Bowen Yu +3Weight-Only QuantizationExtreme Low-Bit Quantization

  36. What Limits Does Quantization Place on Dense Top-kk Retrieval? A Theoretical Study

    Jun 10, 2026Koki Okajima, Tsukasa YoshidaVector DatabaseTop-K

  37. NSVQ: Mitigating Codebook Collapse by Stabilizing Encoder Drift in Vector Quantization

    Jun 9, 2026Hao Lu, Yongxin Guo, Onur Koyun +3Calibration-Free Low-Bit Vector QuantizationCodebooks

  38. Limitations of Learning Tanh Neural Networks with Finite Precision

    Jun 9, 2026Philipp Grohs, Matěj TrödlerNeural NetworkFull-Precision Performance

  39. Optimal Post-Training Quantization Scales and Where to Find Them

    Jun 9, 2026Juan Amboage, Pablo Monteagudo-Lago, Ian Colbert +2Weight-Only QuantizationQuantizer

  40. UniSVQ: 2-bit Unified Scalar-Vector Quantization

    Jun 9, 2026Haoyu Wang, Haiyan Zhao, Xingyu Yu +4QuantizationLow-Bit

  41. Minimum Distortion Quantization with Specified Output Distribution

    Jun 9, 2026Aolin XuRate-Distortion TheoryQuantizer

  42. Quality Is Not a Safety Proxy Under Quantization

    Jun 8, 2026Sahil KadadekarQuantizationSafety Evaluation

  43. FuseFSS: Efficient Secure LLM Inference with Function Secret Sharing

    Jun 8, 2026Yuhan Ma, Yong Li, Stefan SchmidLLM Inference EfficiencySystematic Fp16 Divergence

  44. Beyond FLOPs: Benchmarking Real Inference Acceleration of LLM Pruning under a GEMM-Centric Taxonomy

    Jun 8, 2026Haozhe Hu, Hao Wu, Anhao Zhao +4Heterogeneous Pruning ScoresLLM Inference Efficiency

  45. Understanding Quantization-Aware Training: Gradients at Quantized Weights Bias to the Low-Loss Basin

    Jun 8, 2026Hanyang Li, Jianhao Ma, Ying CuiWeight-Only Quantization

  46. sGPO: Trading Inference FLOPs for Training Efficiency in RLVR

    Jun 7, 2026Shivchander Sudalairaj, Kai Xu, Akash Srivastava +1Reinforcement Learning With Verifiable RewardGroup Relative Policy Optimization

  47. APEX4: Efficient Pure W4A4 LLM Inference via Intra-SM Compute Rebalancing

    Jun 7, 2026Hong Guo, Nianhui Guo, Weixing Wang +3W4A4 QuantizationTensor Programs

  48. Trainable Smooth-Rotation Transforms with Learned Channel Scales for LLM Quantization

    Jun 7, 2026Patrik Czakó, Gábor Kertész, Sándor SzénásiLarge Language Model QuantizationQuantization

  49. Hiding in Plain Floats: Steganographic Carriers for Indirect Prompt and Content Injection

    Jun 7, 2026Mudit Sinha, Sanika ChavanIndirect Prompt InjectionLanguage Model Evasion Attacks

  50. STAR-KV: Low-Rank KV Cache Compression via Soft Thresholding for Adaptive Rank Control

    Jun 7, 2026Priyansh Bhatnagar, Ashkan Moradifirouzabadi, Se-Hyun Yang +3Key-Value Cache CompressionKey-Value Cache

  51. Joint Structural Pruning and Mixed-Precision Quantization for LLM Compression

    Jun 5, 2026Hoang-Loc La, Truong-Thanh Le, Amir Taherkordi +1Mixed-Precision QuantizationWeight-Only Quantization

  52. OffQ: Taming Structured Outliers in LLM Quantization by Offsetting

    Jun 5, 2026Haoqi Wang, Lorenz K. Mueller, Jiawei Zhuang +2Large Language Model QuantizationLow-Bit

  53. SPEAR: A System for Post-Quantization Error-Adaptive Recovery Enabling Efficient Low-Bit LLM Serving

    Jun 4, 2026Hongyuan Liu, Yawei Li, Zhiqiang Que +3Large Language Model QuantizationLarge Language Model Serving

  54. FAIR-Calib: Frontier-Aware Instability-Reweighted Calibration for Post-Training Quantization of Diffusion Large Language Models

    Jun 4, 2026Haoyu Huang, Linlin Yang, Sheng Xu +5Weight-Only QuantizationLarge Language Model Post-Training

  55. Value-and-Structure Alignment for Routing-Consistent Quantization of Mixture-of-Experts Models

    Jun 4, 2026Hancheol Park, Geonho Lee, Tairen Piao +1QuantizerQuantization

  56. Beyond Output Matching: Preserving Internal Geometry in NVFP4 LLM Distillation

    Jun 4, 2026Fangbo Tu, Junhua Zhao, Chi Liu +4Large Language Model QuantizationChain-Of-Thought Distillation

  57. Minimizing the Hidden Cost of Scales: Graph-Guided Ultra-Low-Bit Quantization for Large Language Models

    Jun 3, 2026Rayyan Abdalla, Amir Hussein, Min Wu +1Large Language Model QuantizationQuantization

  58. AlphaQ: Calibration-Free Bit Allocation for Mixture-of-Experts Quantization

    Jun 3, 2026Wanqi Yang, Yuexiao Ma, Alexander Conzelmann +4Mixed-Precision Quantization

  59. STaR-Quant: State-Time Consistent Post-Training Quantization for Diffusion Large Language Models

    Jun 3, 2026Xin Yan, Aqiang Wang, Zhenglin Wan +2Large Language Model QuantizationWeight-Only Quantization

  60. Curvature-aware dynamic precision approach for physics-informed neural networks

    Jun 3, 2026Yingjie Shao, Ioannis N. Athanasiadis, George van Voorn +1Conventional Physics-Informed Neural NetworksCurvature-Aware Quadratic Banks