Mixed-Precision Quantization

Ask about this topic

Momentum

11 papers in the last four weeks, up 38% on the four weeks before. 0.1% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 97

All topics
CardsList

  1. AlignQuant: Tile-Aligned Mixed-Precision Quantization for Efficient LLM Generation

    Oct 5, 2026Hanzhi Zhang, Qiao Zhang, Qinglei Cao +4Mixed-Precision QuantizationLLM Quantization

    LLaVi Lab, Computer Science & Engineering, University of North Texas

  2. StagQ: Constraint-Driven Multi-Precision Weight Quantization for LLMs

    Oct 5, 2026Zhe Wei, Mengqi Guo, Yuan Yuan +3Mixed-Precision QuantizationLLM Quantization

    Huawei Technologies Ltd.

  3. Backward-State Policy Is Part of the Learning Algorithm

    Sep 30, 2026Shuxiao Xie, Shuyang Xie, Dezhi Ran +2Mixed-Precision QuantizationBackpropagation

    Beijing Tongming Lake Information Technology Application Innovation Center (TLAIC), China

  4. Fiona: Accelerating FHE Inference with Packing-Aware Ternary Weights

    Sep 28, 2026Yiteng Peng, Zhibo Liu, Dongwei Xiao +1Mixed-Precision QuantizationEfficient Neural Network Inference

    The Hong Kong University of Science and Technology · State Key Laboratory of Novel Software Technology, Nanjing University

  5. From Attention Sensitivity to Layer Role: Revisiting Mixed-Precision Quantization of Transformers

    Sep 28, 2026Nafiseh HosseinpourFardi, Negar Alihadi, Mahmoudreza Babaei +2Mixed-Precision QuantizationLLM Quantization

    Sharif University of Technology, Tehran, Iran · GISMA University of Applied Sciences, Potsdam, Germany · BRAINS, Brandenburg Research Center for Applied Intelligent Systems, Potsdam, Germany +3

  6. Quantization Error Is Spectrally Flat: A Single Random Probe Is a Calibrated, Data-Free Sensitivity Estimator, with Application to Budget-Targeted Mixed-Precision Quantization

    Sep 27, 2026I Kennedy, T KennedyMixed-Precision QuantizationLLM Quantization

    baa.ai Auckland, New Zealand

  7. Q-WAM: 4-Bit Quantization of World Action Models with Action-Subspace Protection

    Sep 27, 2026Arash Akbari, Arman Akbari, Jingwu Luo +7Mixed-Precision Quantization4-Bit Quantization

    Northeastern University · EmbodyX · University of Minnesota - Twin Cities +1

  8. RAMP: Robust Adaptive Mixed-Precision Quantization for Edge CPU Vision Models

    Sep 23, 2026David Población-Criado, Dario Garcia-Gasulla, Eduardo QuinonesMixed-Precision QuantizationEdge Inference

    Barcelona Supercomputing Center (BSC) · Universitat Politècnica de Catalunya - BarcelonaTech (UPC)

  9. Beyond Scalar Sensitivity: Activation-Aware Mixed-Precision LLM Quantization with Cross-Layer Refinement

    Sep 22, 2026Akihiro Yoshida, Yuma IchikawaMixed-Precision QuantizationLLM Quantization

    Fujitsu Limited, Institute of Science Tokyo · Fujitsu Limited, RIKEN Center for AIP

  10. VLAQuantBench: Closed-Loop Evaluation of Post-Training Quantization for Vision-Language-Action Models

    Sep 21, 2026Jiuyi Xu, Qing Jin, Meida Chen +3Mixed-Precision QuantizationEfficient VLA Model Inference

    Colorado School of Mines · Independent Researcher · University of Central Florida +2

  11. The Undetected Damage of Quantization on Retrieval and How to Fix It

    Sep 21, 2026Luca Zhou, Alessandro Zirilli, Daniele Solombrino +2Mixed-Precision QuantizationInformation Retrieval

    Sapienza University of Rome · Not Diamond · Paradigma

  12. Text Scores Do Not Establish Performance on Lexically Non-Diagnostic Speech Tasks: A Qwen2-Audio Quantization Case Study

    Sep 20, 2026Mengzhe Geng, Jinxi Ji, Junhao XuAudio-Language Model EvaluationMixed-Precision Quantization

    National Research Council Canada · The Hong Kong Polytechnic University · The Chinese University of Hong Kong

  13. Colla-Q: Toward Collaborative Experts in MoE Quantization via Minimax Precision Balancing

    Sep 16, 2026Eunju Shin, Jongbin RyuMixed-Precision QuantizationMixture-of-Experts Quantization

    Ajou University, South Korea

  14. Task-Aware QUBO Allocation for Mixed-Precision Quantization

    Sep 4, 2026Osama Orabi, Artur Zagitov, Hadi Salloum +2Mixed-Precision QuantizationCost-Aware Inference

    Laboratory of Quantum Computing, Innopolis University, 420500 Innopolis, Russia · Q Deep, Laboratory of Quantum Computing, 420502 Innopolis, Russia · Moscow Independent Research Institute of Artificial Intelligence (MIRAI), 117218 Moscow, Russia +2

  15. Hardware-Aware FP4 FlashAttention-4

    Sep 3, 2026Robert HuMixed-Precision QuantizationGPU Kernel Optimization

    GRAPHCORE RESEARCH

  16. The Structure of Quantization Damage in LLMs: Why the Next Bit Should Be Spent Globally

    Sep 1, 2026Jundong Hu, Shekar RamachandranMixed-Precision QuantizationLLM Quantization

    PayPal AI

  17. Q-Strata: Hierarchical Bit Allocation for Mixed-Precision Quantization of Mixture-of-Experts LLMs

    Aug 31, 2026Deokjae Lee, Sihun Chu, Hyun Oh SongMixed-Precision QuantizationLLM Quantization

    Department of Computer Science and Engineering, Seoul National University · Neural Processing Research Center · 3Neural Processing Research Center +2

  18. HyQuant: Hybrid-Precision Quantization for LLM Attention

    Aug 28, 2026Jiatong Ding, Bingxin Xing, Yu Zhang +9Mixed-Precision QuantizationLLM Quantization

    Shanghai Jiao Tong University · Xi’an Jiaotong University · Xiamen University +1

  19. DAMP: Decay-Aware Mixed-Precision Recurrent-State Quantization

    Aug 27, 2026Tao Zhang, Jianchao Tan, Pingwei Sun +6Mixed-Precision QuantizationLLM Quantization

    South China University of Technology · Meituan · East China Normal University

  20. FAMPWQ: Fisher Information-based Adaptive Mixed Precision Weight Quantization for Effective LLM Inference

    Aug 24, 2026Gongwei Lee, Ji Liu, Juncheng Jia +1Mixed-Precision QuantizationLLM Quantization

    School of Computer Science and Technology, Soochow University, Suzhou, China · Hithink Research, Hangzhou, China · Electronic Engineering, Tsinghua University, Beijing, China

  21. HAMP-LIC: Hessian-Aware Mixed-Precision Post-Training Quantization for Learned Image Compression

    Aug 12, 2026Yuefeng ZhangMixed-Precision QuantizationLearned Image Compression

    Beijing Institute of Computer Technology and Application, Beijing, China · School of Elite Engineering, Northwestern Polytechnical University, Shaanxi, China

  22. SPECTRA: Pushing the KV Cache Beyond the 2-Bit Cliff via Spectral Transform Coding

    Aug 8, 2026Jiamu Zhang, Liang Wu, Kelly Wan +2Mixed-Precision QuantizationKV Caching

    Nokia · Rice University

  23. PTQ4SNN: Membrane-Aware Post-Training Quantization for Spiking Neural Networks

    Aug 7, 2026Hui Xie, Tong Shi, Haotong Qin +3Mixed-Precision Quantization4-Bit Quantization

    State Key Laboratory of Complex & Critical Software Environment, Beihang University · School of Artificial Intelligence, Beihang University · Center for Project-Based Learning, D-ITET, ETH Zurich +2

  24. MiCoPro: End-to-End Mixed Precision HW/SW Co-design with HW-aware Proxy Model

    Aug 7, 2026Zijun Jiang, Yangdi LyuMixed-Precision QuantizationEfficient Neural Network Inference

    Microelectronics Thrust, the Hong Kong University of Science and Technology (Guangzhou), Guangzhou 511453, China

  25. APQF: Agentic Profiling-Guided Structured Pruning and Mixed-Precision Quantization with Adaptive Fine-Tuning

    Aug 6, 2026Sadegh Jafari, Mohiuddin Bilwal, Fan Zhou +2Model CompressionMixed-Precision Quantization

    Department of Computer Science Iowa State University Ames, IA, USA · Department of Agricultural and Biosystems Engineering Iowa State University Ames, IA, USA

  26. Recurrent Residual Quantization: A Progressive Multi-Precision Representation for LLMs

    Aug 4, 2026Yu Luo, Bo Dong, Wenhua Cheng +1Mixed-Precision QuantizationLLM Quantization

    Intel

  27. TASQ: Temporal-Adaptive Bit Sparsification Quantization for Diffusion Models

    Aug 4, 2026Seokho Han, Dongwei Wang, Jinhee Kim +4Mixed-Precision QuantizationDiffusion Model Quantization

    Department of Electrical and Computer Engineering, Sungkyunkwan University, Korea · Department of Electrical and Computer Engineering, University of Arizona, USA · Department of Electrical and Computer Engineering, Duke University, USA +1

  28. NANQ: Noise-Floor-Aware Mixed-Precision Non-Uniform Quantization for Analog Compute-in-Memory

    Aug 3, 2026Yizhe Chen, Wenshuai Yao, Saiya Wang +6Mixed-Precision QuantizationCompute-in-Memory

    School of Integrated Circuit Science and Engineering, Beihang University, Beijing, China · School of Integrated Circuits, Peking University, Beijing, China · Department of Electrical and Computer Engineering, The University of Hong Kong, Hong Kong SAR, China

  29. GQ-FSL: Green Quantized Federated Split Learning

    Jul 31, 2026Idan Roth, Lutz LampeMixed-Precision QuantizationEnergy-Efficient ML

    The University of British Columbia, Vancouver, BC, Canada

  30. MixFrag: Fragility-Guided Mixed-Precision Post-Training Quantization for Vision Transformers

    Jul 30, 2026Md. Mehrab Hossain Opi, Robiul Islam Ryad, Md. Umar FarukMixed-Precision QuantizationVision Transformer

    Department of Computer Science and Engineering Khulna University of Engineering & Technology (KUET) Khulna 9203, Bangladesh

  31. Stable FP4 Training via Transposition-Invariant Block Quantization

    Jul 27, 2026Mehdi Rahimifar, Amin Darabi, Mehran Taghian Jazi +6Mixed-Precision Quantization4-Bit Quantization

  32. MixQuant: Adaptive Mixed-Precision Quantization for Large Language Models

    Jul 25, 2026Ashitabh Misra, Madhav Agrawal, Arham Jain +1Mixed-Precision QuantizationLLM Quantization

    University of Illinois at Urbana-Champaign

  33. MXSens: Sensitivity-Aware Mixed-Precision Quantization for Efficient LLM Inference

    Jul 20, 2026Simla Burcu Harma, Danila Mishin, Zhengyuan Su +7Mixed-Precision QuantizationLLM Quantization

    EcoCloud, EPFL · Tsinghua University · MangoBoost Inc. +2

  34. PolyQ: Codesigning End-to-End Quantization Framework for Scalable Edge CPU LLM Inference

    Jul 16, 2026Hyunwoo Oh, Suyeon Jang, Hanning Chen +4Mixed-Precision QuantizationLLM Quantization

    University of California, Irvine

  35. Saturation Makes Quantization Error Additive: A Coverage Model with a Certificate

    Jul 14, 2026Joshua HillMixed-Precision QuantizationLLM Quantization

    Baseten Labs, Inc. · David R. Cheriton School of Computer Science, University of Waterloo

  36. Closing the Null Space: Guidance-Aware Quantization for Classifier-Free Diffusion

    Jul 9, 2026Abdullah Al Shafi, Sumaiya Rahim SumaMixed-Precision QuantizationClassifier-Free Guidance

    Department of Computer Science and Engineering Khulna University of Engineering & Technology Khulna-9203, Bangladesh

  37. Rethinking Small VLM Quantization: From Component-Wise Analysis to Hardware-Aware Edge Deployment

    Jul 9, 2026Hyeju Shin, Chorwon Kim, Ryangsoo Kim +2Mixed-Precision QuantizationVision-Language Models

    1ETRI, Republic of Korea.

  38. KronQ: LLM Quantization via Kronecker-Factored Hessian

    Jul 8, 2026Donghyun Lee, Yuhang Li, Ruokai Yin +1Mixed-Precision QuantizationLLM Quantization

    University of Southern California · Yale University

  39. Full-Stack FP4: Stable LLM Pretraining with Quantized Projections, Optimizers, and Attention

    Jul 5, 2026Siyu Ding, Mingchuan Ma, Jiabo Tong +3Language Model PretrainingMixed-Precision Quantization

    Institute of Automation, Chinese Academy of Sciences · Sichuan University · Beijing Zhongguancun Academy +3

  40. Variable Bit-width Quantization: Learning Per-Group Precision for "Bigger-but-Smaller" Language Models

    Jul 3, 2026Hamish OgilvyMixed-Precision QuantizationLLM Quantization

    Algolia Research

  41. Beyond Activation Alignment:The Alignment-Diversity Tradeoff in Task-Aware LLM Quantization

    Jul 1, 2026Fei Wang, Chao Xue, Taoran Liu +3Mixed-Precision QuantizationLLM Quantization

    South China University of Technology · Ocean University of China · Shenzhen Campus of Sun Yat-sen University +1

  42. RotateAttention: RoPE-Aware Rotation and Range Rectification for INT4 Quantized Attention in Video Generation

    Jul 1, 2026Yaofu Liu, Wanli Lan, Jinxi Li +2Mixed-Precision QuantizationRotary Positional Embeddings

    The Hong Kong University of Science and Technology, Hong Kong SAR, China · Independent Researcher, China

  43. Minimizing Quantized Semantic Age of Information (QSAoI) in Foundation Model-Based Semantic Communications

    Jun 30, 2026Huanyu Zhang, Yulin Hu, Xiaopeng Yuan +2Mixed-Precision QuantizationSemantic Communication

    INDA Chair, RWTH Aachen University, Germany · School of Electronic Information, Wuhan University, China · Department of Digital Communication Systems, Ruhr University Bochum, Germany

  44. SEADA: An efficient methodology for optimizing mixed-precision DNNs on multi-precision spatial architectures

    Jun 26, 2026Leandro Fiorin, Marco Ronzani, Cristina SilvanoMixed-Precision QuantizationEfficient Neural Network Inference

    Indipendent Researcher Groningen, The Netherlands · Dipartimento di Elettronica e Informazione, Politecnico di Milano. Milano, Italy

  45. GRINQH: Graded Input-based Quantization Hierarchy for Efficient LLM Generation

    Jun 22, 2026Jette Oberländer, Jan Finkbeiner, Catherine M. Schöfmann +1Mixed-Precision QuantizationLLM Quantization

    Fakultät für Informatik, RWTH Aachen, Aachen, 52074, Germany · Peter Grünberg Institut, Forschungszentrum Jülich GmbH, Jülich, 52425, Germany · Fakultät für Elektrotechnik und Informationstechnik, RWTH Aachen, Aachen, 52062, Germany

  46. Demystifying Numerical Instability in LLM Inference: Achieving Reproducible Inference for Mission-Critical Tasks with HEAL

    Jun 19, 2026Zhenting Zhu, Lucas Thai, Shan Yu +5Mixed-Precision QuantizationLLM Inference

    1UCLA · 2UC Berkeley · University of Chinese Academy of Sciences

  47. Mix-QVLA: Task-Evidence-Aware Mixed-Precision Quantization of Vision-Language-Action Models

    Jun 17, 2026Navin Ranjan, Andreas SavakisMixed-Precision QuantizationVLM Quantization

    Rochester Institute of Technology Rochester, New York 14623, USA

  48. MODE: Modality-Decomposed Expert-Level Mixed-Precision Quantization for MoE Multimodal LLMs

    Jun 15, 2026Yuanteng Chen, Peisong Wang, Zhilei Liu +9Mixed-Precision QuantizationLLM Quantization

    Institute of Automation, Chinese Academy of Sciences · School of Artificial Intelligence, University of Chinese Academy of Sciences · 3Zhongguancun Academy

  49. Quantizing Time-Series Models As Dynamical Systems: Trajectory-Based Quantization Sensitivity Score

    Jun 11, 2026Mariya Pavlova, Harrison Bo Hua Zhu, Lidia Vitanova +2Mixed-Precision QuantizationPost-Training Quantization

    Department of Computing, Imperial College London, London, United Kingdom · Department of Public Health, University of Copenhagen, Copenhagen, Denmark · GATE Institute, Sofia University St. Kliment Ohridski, Sofia, Bulgaria +1

  50. TWLA: Achieving Ternary Weights and Low-Bit Activations for LLMs via Post-Training Quantization

    Jun 11, 2026Zhixiong Zhao, Zukang Xu, Zhixuan Chen +3Mixed-Precision QuantizationLLM Quantization

    Houmo AI, China · 2Southeast University, Nanjing, China

  51. Holding the FP8 Quality Ceiling at 8-Bit Weights and Activations: INT8 and GGUF Post-Training Quantization of Ideogram 4.0 for Consumer GPUs

    Jun 10, 2026Deep Gandhi, Ali Asaria, Tony SalomoneMixed-Precision QuantizationDiffusion Transformer

    Transformer Lab

  52. DynamicPTQ: Mitigating Activation Quantization Collapse via Residual-Stream Dynamics

    Jun 10, 2026Zimo Zhao, Maolin Wang, Bowen Yu +3Mixed-Precision QuantizationLLM Quantization

    City University of Hong Kong · Hong Kong, China · Zhejiang University of Technology +1

  53. TileFuse: A Fused Mixed-Precision Kernel Library for Efficient Quantized LLM Inference on AMD NPUs

    Jun 9, 2026Wesley Pang, Gregory Hyegang Jun, Feiyang Liu +1Mixed-Precision QuantizationLLM Quantization

    University of Illinois Urbana-Champaign Department of Electrical and Computer Engineering USA

  54. SpectrumKV: Per-Token Mixed-Precision KV Cache Transfer for Prefill-Decode Disaggregated LLM Serving

    Jun 7, 2026Yang PengjuMixed-Precision QuantizationKV Caching

  55. STAR-KV: Low-Rank KV Cache Compression via Soft Thresholding for Adaptive Rank Control

    Jun 7, 2026Priyansh Bhatnagar, Ashkan Moradifirouzabadi, Se-Hyun Yang +3Mixed-Precision QuantizationKV Caching

    University of California San Diego, San Diego, CA, USA · Dnotitia Inc., Seoul, Republic of Korea · Hanyang University, Seoul, Republic of Korea

  56. On Low-Bit Quantization Errors in Speaker Verification: Diagnostic and Mitigation

    Jun 6, 2026Hugo Leguillier, Driss Matrouf, Guillaume Lechien +1Mixed-Precision QuantizationAdaptive Inference

    Avignon University, LIA, UPR 4128, France · Aday, France

  57. Joint Structural Pruning and Mixed-Precision Quantization for LLM Compression

    Jun 5, 2026Hoang-Loc La, Truong-Thanh Le, Amir Taherkordi +1Mixed-Precision QuantizationLLM Quantization

    UiT The Arctic University of Norway · University of Oslo, Norway

  58. AlphaQ: Calibration-Free Bit Allocation for Mixture-of-Experts Quantization

    Jun 3, 2026Wanqi Yang, Yuexiao Ma, Alexander Conzelmann +4Mixed-Precision QuantizationMixture-of-Experts Language Models

    Max Planck Institute for Intelligent Systems · ELLIS Institute Tübingen · Tübingen AI Center +5

  59. QuBLAST: A Framework for Quantizing Large Language Models with Block-Level Compression Approach and Activation Scaling Strategy

    Jun 3, 2026Pasindu Wickramasinghe, Achyuta Muthuvelan, Rachmad Vidya Wicaksana Putra +2Mixed-Precision QuantizationLLM Quantization

    eBRAIN Lab, Division of Engineering, New York University (NYU) Abu Dhabi, United Arab Emirates

  60. Recover-LoRA for Aggressive Quantization: Reclaiming Accuracy in 2-Bit Language Models via Low-Rank Adaptation with Knowledge Distillation on Synthetic Data

    Jun 2, 2026Devleena Das, Rajeev Patwari, Elliott Delaye +1Mixed-Precision QuantizationLLM Quantization

    Advanced Micro Devices, Inc. (AMD)