cs.CVNov 5, 2026

Rotation Is Token-Blind: A Structural Criterion for Post-Training Quantization of Feed-Forward Geometry Transformers

Authors: Huanfei He, Bohao Zhang, Jiaxin Zhang, Wei Sui, John See, Zeyd Boukhers, Cong Yang

Organizations: School of Future Science and Engineering, Soochow University, Suzhou, China · D-Robotics, Beijing, China · School of Mathematical and Computing Sciences, Heriot-Watt University Malaysia, Putrajaya, Malaysia · Fraunhofer Institute for Applied Information Technology, Sankt Augustin, Germany

Abstract

Feed-forward 3D models use Transformers to predict camera poses, depth, and structure in one pass, avoiding iterative multi-view optimization. Long sequences and deep attention incur high compute and memory costs, motivating Post-Training Quantization (PTQ) for deployment. Existing PTQ methods mainly suppress channel-wise outliers by smoothing or orthogonal rotation. Geometry Transformers introduce a different challenge: heterogeneous token types share one activation quantization grid. A few special tokens may exert high leverage over global outputs and be updated by only a subset of blocks. Token-blind transforms, which apply the same transformation to every token, reduce overall quantization error but cannot remove differentiated degradation across token types. We propose QMapAnything, a structure-aware PTQ framework. We cast floating-point-preserving rotation and smoothing as a token-blind reparameterization group, and prove that they yield common-mode gains while leaving relative token SNR unchanged. We introduce a statistic ΓΓ that combines a special token's quantization disadvantage and output leverage to predict whether differentiated bias correction is needed beyond rotation. Experiments on geometric benchmarks show that W4A8 closely matches full-precision performance. Under W8A8, peak memory falls by 2.22.2--3.1×3.1\times versus FP32, with up to 3.1×3.1\times speedup on real hardware. These results provide a principled and efficient approach to deploying feed-forward 3D reconstruction models in resource-constrained edges.

Figures & tables

Appendix figures & tables3 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Not All Tasks Quantize Equally: Fisher-Guided Quantization for Visual Geometry Transformer

    May 15, 2026Yipu Zhang, Jintao Cheng, Weilun Feng +5Feed-Forward 3D ReconstructionPost-Training Quantization

  2. QVGGT: Post-Training Quantized Visual Geometry Grounded Transformer

    May 29, 2026Zhizhen Pan, Hesong Wang, Huan WangMixed-Precision Quantization3D ViTs

  3. Lite3R: A Model-Agnostic Framework for Efficient Feed-Forward 3D Reconstruction

    May 12, 2026Haoyu Zhang, Zeyu Zhang, Zedong Zhou +2Quantization-Aware Training3D Reconstruction