VLM Quantization

VLM: Vision-Language Model

Overview

Vision-language model quantization studies how to represent model weights, activations, and key-value caches with fewer bits so models can run with less memory and compute. Post-training quantization typically uses calibration data and sensitivity measures, while quantization-aware training and distillation adapt models during training; common techniques include mixed precision, modality-aware scaling, rotations, and token or cache selection. Work evaluates these methods on visual question answering, image understanding, and increasingly embodied tasks, with deployment studies measuring latency, memory, and energy on target hardware. A central tension is that strong average accuracy or memory savings do not guarantee reliable grounding, uncertainty estimates, or faster real-world inference, especially at very low bit widths.

Latest papers

CardsList

58 papers6 papers in the last four weeks, down 54% on the four weeks before. 0.0% of all new papers.

  1. MoMoVL: Modality-Aware Adaptive Compression for On-Device Sparsely-Activated Vision-Language Models

    Nov 18, 2026Dongkeun Lee, Wonjun LeeEfficient VLM InferenceVLM Compression

  2. UniCompress: From Multi-LoRA Experts to One Compact Model for Edge Intelligence

    Nov 4, 2026Mingkang Liu, Peipei Jiao, Weiming Meng +3VLM CompressionVLM Quantization

  3. PlantVLM-Edge: Quantized Vision-Language Models for On-Device Crop Health Diagnosis

    Nov 2, 2026Gaurab Wagle, Bishal Adhikari, Jiajia Li +2Efficient VLM InferenceVLM Quantization

  4. Density-Aware Calibration for Resource-Efficient Medical Vision-Language Models

    Oct 31, 2026Tien-Dat Dam, Huu-Thuan Huynh, Minh-Triet Tran +1VLM CalibrationMedical VLMs

  5. Quantize by Doing: Task-Guided Mixed-Precision Quantization of Vision-Language-Action Models

    Oct 28, 2026Jiuyi Xu, Xiao Hu, Meida Chen +3Mixed-Precision QuantizationVLM Quantization

  6. AGQ: Action-Guided Ultra-Low-Bit Quantization for Vision-Language-Action Models

    Oct 21, 2026Xuhong Qiu, Zhuoyu Wu, Qiawei Zheng +3VLM QuantizationEfficient VLA Inference

  7. Recovering Low-Bit Failures in Vision-Language-Action Policies via Quantization-Conditioned Reinforcement Learning

    Oct 11, 2026Seongmin Park, Jaewon Lee, Yujun Heo +4VLM QuantizationEfficient VLA Inference

  8. ActTune: Action-Aware Precision and GPU Operating-Point Adaptation for Energy-Efficient Vision-Language-Action Inference

    Oct 6, 2026Zou Qingyun, Bin Gao, Wenju Zhao +3Energy-Efficient MLVLM Quantization

  9. Think Before You Distill: Generalization Recovery in Quantized VLAs via Selective Policy Distillation

    Oct 5, 2026Shen Ruan, Wenchang Gao, Jin Wang +4Vision-Language-Action ModelsOOD Generalization

  10. CHASE-VLA: Post-Training Quantization Framework for Vision-Language-Action Models with Chunk-Aware Scale Estimation

    Oct 2, 2026Jin Hyun, Jung Gyu Min, Gyuhyun Jung +1Post-Training QuantizationVLM Quantization

  11. Calibrate the Decisions That Change the Future: On-Policy Post-Training Quantization for Multimodal Large Language Models

    Sep 29, 2026Wenxiao Fan, Jingling Fu, Lichen Ma +6LLM QuantizationVLM Quantization

  12. EdgeVLN: Runtime-Aware Deployment Ready Quantized Vision Language Navigation Model

    Sep 28, 2026Rithvik Jonna, Man Namgung, Aakash Gurram +1Visual NavigationVLM Quantization

  13. SubRot: Signed Gradient Subspace Calibration for VLM Rotation Quantization

    Sep 28, 2026Zhenhao Shang, Haizhao Jing, Haokui Zhang +4VLM QuantizationRotation-Based Quantization

  14. P4Q: Co-designing Token Pruning and Quantization for Vision-Language Model Acceleration

    Sep 28, 2026Haizhao Jing, Zhenhao Shang, Haokui Zhang +2VLM QuantizationEfficient VLM Inference

  15. Beyond Reconstruction Loss in Post-Training Quantization: Balanced Fitting for Large Vision-Language Models

    Sep 28, 2026Minchan Kang, Kyeonghye Park, Seungyeon Sa +3VLM QuantizationLarge Vision-Language Models

  16. GHOST-Q: Towards Studying Grounding Hallucinations Overlooked Under Same-score TradeOffs in Quantized VLMS

    Sep 24, 2026Saim Rehman, Muhammad ShafiqueVLM EvaluationVLM Quantization

  17. RGSQ: Riemannian Geometry-Sensitive Quantization for Large Vision-Language Models

    Sep 21, 2026Zhiping Wu, Dongdong Ren, Yangchengyu Zhou +4VLM QuantizationLarge Vision-Language Models

  18. SPHQuant: Efficient extreme low bit weight quantization for Vision-Language Models

    Sep 21, 2026Kewei Zhang, Zheng Chen, Haotong Qin +1VLM QuantizationEfficient VLM Inference

  19. FoldQuantVLA: Native Low-Bit Quantization of Vision-Language-Action Models via Consistent Folding

    Sep 21, 2026Hung T. Ho, Khanh D. Nguyen, Quang D. Nguyen +5VLM QuantizationEfficient VLA Inference

  20. MiX: Micro-Inverted-Scaling for End-to-End Low-Bit Vision-Language Model Acceleration

    Sep 17, 2026Yuan Liao, Jae-sun SeoAI Accelerator InferenceVLM Quantization

  21. Efficient Quantization-Aware Distillation with Cross-Modal Alignment for Edge Vision-Language Models

    Sep 15, 2026Jinwoo Jeon, GyuYeop Do, Yubin Lim +4VLM QuantizationEfficient VLM Inference

  22. Llama-Mobile: Efficient 2.7-Bit Quantization of VLMs

    Aug 21, 2026Luka Ribar, Jeevan Bhoot, Douglas OrrVLM QuantizationEfficient VLM Inference

  23. C-PTQ: Fisher-weighted Channel-wise Sensitivity for Post-training Quantization of MLLMs

    Jul 23, 2026Jiameng Li, Han Zhou, Matthew B. BlaschkoVLM QuantizationPost-Training Quantization

  24. Beyond Independent Optimization: Compression, MoE Routing, and Quantization Interactions in Multimodal Edge Intelligence

    Jul 23, 2026Jay Gor, Karm Dave, Akshita Abrol +3Efficient Multimodal InferenceVLM Quantization