cs.CVOct 2, 2026

Beyond Token Accuracy: Prioritizing What Matters for Visual Reconstruction

Authors: Zhicheng Liu, Zhouxiang Zhao, Chenliang Wu, Zhaohui Yang, Zhaoyang Zhang

Organizations: Zhejiang University

Abstract

Tokens have become a unified interface for multimodal foundation models, making visual-token communication a natural paradigm for efficient image delivery. However, existing methods typically rely on static policies that cannot jointly adapt to image content and channel conditions. Moreover, their token-level utility objectives do not necessarily translate into improved image reconstruction quality. In this paper, we propose AdapToC, an adaptive, reconstruction-oriented visual-token communication framework. At the transmitter, an adaptive selector jointly models image content, channel state, and communication budget to perform instance-wise resource allocation. Rather than using a fixed token rate and protection policy, it dynamically determines how many tokens should be transmitted and assigns different protection levels according to token importance and current channel conditions. At the receiver, an adaptive MaskGIT receiver incorporates channel reliability into contextual token modeling. It distinguishes tokens with different reliability levels, preserves high-confidence observations, corrects potentially corrupted tokens, and iteratively reconstructs missing content from the received evidence and global visual context. By co-designing token quantity, unequal protection, and reliability-aware recovery for image-level reconstruction quality, AdapToC achieves a peak mean PSNR gain of 4.20 dB over the strongest static baseline under matched communication costs and state-of-the-art performance among the evaluated visual-token communication methods.

Figures & tables

Explore similar work

CardsList
  1. Baseline-Relative Counterfactual Refinement for Bit-Aware Visual Token Communication

    Aug 17, 2026Jia Guo, Xiaohan Zhao, Changwang Liu +4Visual Token CompressionVisual Token Pruning

  2. MixTok: Adaptive Visual Tokenization with Global 1D Tokens and Sparse 2D Refinement

    Oct 9, 2026Chenge Li, Yefei He, Xinyu Liu +3Visual TokenizationVisual Token Compression

  3. Mutual Enhancement Between Global Tokens and Patch Tokens: From Theory to Practice

    May 11, 2026Xiusheng Huang, Xin Jiang, Jun Zhao +2Learned Image CompressionImage Tokenization