Overview

Visual tokenization studies how to represent images and video as sequences or sets of units that models can process efficiently. Approaches range from fixed patch grids and discrete or continuous autoencoder codes to semantic, object-centric, hierarchical, and variable-length tokens; video methods also encode motion and reuse information across frames. These representations support image generation, video understanding, multimodal language models, and robotic control, where they can reduce computation while retaining useful visual detail. The main challenge is balancing compactness and reconstruction fidelity with semantic and spatial information that remains useful across tasks and downstream models.

Latest papers

CardsList

72 papers4 papers in the last four weeks, down 43% on the four weeks before. 0.0% of all new papers.

  1. Learning Hierarchical Patch Splitting Policies for Faster Vision Transformers

    Nov 3, 2026Aditya Gupta, Jean Sebastien Dandurand, Kai Qiu +2Vision TransformerEfficient ViTs

  2. MoETok: Sparse Expert Routing for 1D Visual Tokenizers

    Oct 30, 2026Jiahao Guo, Bao Tang, Haoxiang Cao +6Visual TokenizationDiscrete Visual Tokenization

  3. MedVTok: A General-Purpose Medical Visual Tokenizer

    Oct 26, 2026Chenglong Ma, Yuanfeng Ji, Junzhi Ning +18Image TokenizationVisual Tokenization

  4. TrackTok: Semantically Persistent Tokens for Latent Video Generation

    Oct 24, 2026Nhi Pham, Christopher Wewer, Bernt Schiele +2Visual TokenizationVideo Object-Centric Learning

  5. Query-adaptive Recurrent Tokenization

    Oct 16, 2026Bavesh Balaji, Pranav Gopinath, Pouya Sadeghi +1Visual TokenizationEfficient VLM Inference

  6. Thinking from Above: Efficient Spatial Reasoning with Bird's-Eye-View Visual Tokens

    Oct 15, 2026Faizan Siddiqui, Nirav Savaliya, Sahith Reddy Chada +1Visual Spatial ReasoningBird's-Eye-View Representation

  7. VITAL: From Visual Motion to Precise Action

    Oct 14, 2026Ao Liang, Youquan Liu, Mingxiao Li +7Visuomotor Policy LearningVisual Tokenization

  8. Just Respect the Semantics: Image-Token Compression via Pre-LLM Semantic Variable-Resolution Tokenization and In-LLM Relevance Pruning

    Oct 13, 2026Tianhao Fu, Austin Wang, Charles Chen +5Visual Token CompressionEfficient VLM Inference

  9. MixTok: Adaptive Visual Tokenization with Global 1D Tokens and Sparse 2D Refinement

    Oct 9, 2026Chenge Li, Yefei He, Xinyu Liu +3Visual TokenizationVisual Token Compression

  10. QuadTok: Quadtree Visual Tokenizer for Autoregressive Image Generation

    Oct 7, 2026Yucheng Mao, Zeyuan Chen, Xiaojun Shan +4Visual TokenizationDiscrete Visual Tokenization

  11. SemanTok: Predictable Semantic Tokens for Efficient Autoregressive Video Generation

    Sep 30, 2026Mikhail Dereviannykh, Vikram Voleti, Simon Donne +3Visual TokenizationAutoregressive Video Generation

  12. Can't Find Waldo: Evaluating VLMs' Sensitivity to Image Resolution and Detail Level

    Sep 20, 2026Alexandra Schild, Gerard de MeloVLM RobustnessVLM Evaluation

  13. LoopVAE: Recurrent Depth Across Scales for Visual Tokenization

    Sep 10, 2026Zhiying LuVariational AutoencodersAutoencoders

  14. Variable-Granularity Tokenization for High-Resolution Object Detection

    Aug 27, 2026Khayrul IslamVisual TokenizationEfficient Object Detection

  15. VIVAS: Vitalizing Visual Perception in VLM Pre-training via Vision-language Unified Autoregressive Supervision

    Aug 25, 2026Zhehan Kan, Yubo Zhu, Xinghua Jiang +10Vision-Language PretrainingFine-Grained Visual Perception

  16. UVU: Improving Multimodal Understanding via Vision-Language Unified Autoregressive Paradigm

    Aug 25, 2026Zhehan Kan, Xinghua Jiang, Yubo Zhu +10Discrete Visual TokenizationUnified Multimodal Models

  17. AffineTok: Semantic Affine Consistency for Diffusion-Friendly Visual Tokenizer

    Aug 24, 2026Junqiu Yu, Pandeng Li, Yikai Wang +11Visual TokenizationDiffusion-Based Image Generation

  18. HeatTok: Enhancing Remote Sensing Image Understanding via Thermodiffusion-based Tokenization

    Aug 23, 2026Yingying Yan, Jiaqi Tang, Wei Wei +6Visual TokenizationRemote Sensing Image Understanding

  19. FLEET: Token-Based Feature Extraction for Event Camera-based Reinforcement Learning

    Aug 17, 2026Tristan Gottwald, Maximilian Schier, Melanie Schaller +1Representation Learning for RLEvent-Based Vision

  20. Slot2Text: Object-Centric Visual Tokenization for Efficient and Spatially Traceable Surgical MLLMs

    Aug 2, 2026Guiqiu Liao, Matjaz Jogan, Daniel A. HashimotoImage TokenizationHealthcare

  21. One Patch Is Enough: Reinforcement-Optimized Visual Token Grounding for MLLM-Based Scene Text Spotting

    Jul 30, 2026Rui Tang, Wentao Yang, Peirong Zhang +4Visual TokenizationScene Text Recognition

  22. Mage-VL: An Efficient Codec-Native Streaming Multimodal Foundation Model

    Jul 27, 2026Senqiao Yang, Kaichen Zhang, Zhaoyang Jia +20Vision-Language ModelsEfficient VLM Inference

  23. ReFace: Reorganizing Facial Spatiotemporal Representations for Improved Pain Assessment

    Jul 22, 2026Stefanos Gkikas, Yu Fang, Christian Arzate Cruz +2Visual Tokenization

  24. VQ-Transplant: Efficient VQ-Module Integration for Pre-trained Visual Tokenizers

    Jul 21, 2026Xianghong Fang, Yuan Yuan, Dehan Kong +1Visual TokenizationImage Reconstruction

  25. Subtoken Vision Transformer for Fine-grained Recognition

    Jul 10, 2026Jie Zhu, Ivy Zhang, Minchul Kim +1Vision TransformerVisual Tokenization

  26. TivTok: Broadcasting Time-Invariant Tokens for Scalable Video Tokenization

    Jun 16, 2026Weiliang Chen, Yuanhui Huang, Xuebo Wang +1Visual TokenizationVideo Token Compression