cs.CVNov 8, 2026

Beyond Similarity Entropy: A Rank-Guided Data-Free Quantization Framework for Vision Transformers

Authors: Runqing Jiang, Ye Zhang, Pengpeng Yu, Zhuo Song, Changjun Li, Longguang Wang, Yulan Guo

Organizations: School of Electronics and Communication Engineering, Shenzhen Campus, Sun Yat-sen University, Shenzhen, China · College of Electronic Science and Technology, Aviation University of Air Force, Changchun, China, 130012.

Abstract

Vision Transformers (ViTs) have demonstrated remarkable performance, yet their computational and memory demands pose significant challenges for deployment on mobile devices. Data-free quantization (DFQ) enables the compression of ViTs without access to their original training data. Existing DFQ methods often synthesize calibration samples by maximizing the entropy of patch similarity. However, similarity entropy describes the dispersion of similarity values without ensuring that the generated samples cover diverse feature directions, potentially limiting their effectiveness for quantization calibration. To address this limitation, we propose RankQ-ViT, a rank-guided DFQ framework for ViTs. We first observe that patch similarity matrices derived from Gaussian noise tend to have lower ranks than those derived from real images. Motivated by this observation, we introduce a block-aware self-contrastive objective that promotes feature diversity during synthetic data generation without explicitly computing matrix rank at each optimization step. We then select calibration samples based on their rank and semantic consistency and use them for block-wise reconstruction of the quantized model. Experiments on ImageNet, COCO, ModelNet40, and ShapeNet demonstrate the effectiveness of RankQ-ViT across multiple architectures and tasks, particularly under low-bit quantization. The code is available at https://github.com/Runqing-forMost/rankq-vit.git

Figures & tables

Explore similar work

CardsList
  1. Joint Post-Training Quantization of Vision Transformers with Learned Prompt-Guided Data Generation

    Feb 21, 2026Shile Li, Markus Karmann, Onay UrfaliogluPost-Training QuantizationNeural Network Quantization

  2. Selective Coupling of Decoupled Informative Regions: Masked Attention Alignment for Data-Free Quantization of Vision Transformers

    Jun 3, 2026Biao Qian, Yang Wang, Yong Wu +1Vision TransformerSynthetic Data Generation