Visual Tokenization

Follow this topic Ask about this topic

Momentum

2 papers in the last four weeks, with none the four weeks before. 0.0% of all new papers.

Jul 13Week of Sep 28

Latest papers 43

All topics

QuadTok: Quadtree Visual Tokenizer for Autoregressive Image Generation
Oct 7, 2026Yucheng Mao, Zeyuan Chen, Xiaojun Shan +4Visual Tokenization Autoregressive Image Generation
University of California, San Diego
SemanTok: Predictable Semantic Tokens for Efficient Autoregressive Video Generation
Sep 30, 2026Mikhail Dereviannykh, Vikram Voleti, Simon Donne +3Visual Tokenization Autoregressive Video Generation
Stability AI · Karlsruhe Institut für Technologie
LoopVAE: Recurrent Depth Across Scales for Visual Tokenization
Sep 11, 2026Zhiying LuVariational Autoencoders Autoencoders
University of Science and Technology of China
Persistent Object Narratives for Token-Efficient Video Language Models
Aug 5, 2026Junzhe Chen, Siyuan Meng, Xiaojie GuoVisual Tokenization Video-Language Models
Tianjin University
One Patch Is Enough: Reinforcement-Optimized Visual Token Grounding for MLLM-Based Scene Text Spotting
Jul 30, 2026Rui Tang, Wentao Yang, Peirong Zhang +4Visual Tokenization Scene Text Recognition
South China University of Technology · Guangzhou, China · HiThink Research +1
Argus-Unified: Towards A Compact and Economical Unified Model for Image Understanding and Generation
Jul 28, 2026Weiming Zhuang, Jiabo Huang, Jingtao Li +4Unified Multimodal Models Visual Tokenization
Sony AI
Mage-VL: An Efficient Codec-Native Streaming Multimodal Foundation Model
Jul 27, 2026Senqiao Yang, Kaichen Zhang, Zhaoyang Jia +20Vision-Language Models Efficient VLM Inference
Microsoft Mage Team
ReFace: Reorganizing Facial Spatiotemporal Representations for Improved Pain Assessment
Jul 22, 2026Stefanos Gkikas, Yu Fang, Christian Arzate Cruz +2Visual Tokenization
Honda Research Institute Japan Wako City, Japan · BioSIS (Biosensing & Intelligent Systems) Lab Centre for Intelligent Computing and Systems University of Canberra Canberra, Australia
VQ-Transplant: Efficient VQ-Module Integration for Pre-trained Visual Tokenizers
Jul 21, 2026Xianghong Fang, Yuan Yuan, Dehan Kong +1Visual Tokenization Image Reconstruction
University of Toronto · 2Boston College · 3Vijil
Subtoken Vision Transformer for Fine-grained Recognition
Jul 10, 2026Jie Zhu, Ivy Zhang, Minchul Kim +1Vision Transformer Visual Tokenization
Michigan State University · Cranbrook Kingswood School · University of North Carolina at Chapel Hill
Native Video-Action Pretraining for Generalizable Robot Control
Jul 9, 2026Qihang Zhang, Lin Li, Luyao Zhang +26Robotic Control Language-Conditioned Robot Manipulation
VocaDet: Sample-Driven Open-Vocabulary Object Detection and Segmentation via Visual Tokenization and Vector Database Retrieval
Jul 9, 2026ZhiXin SunOpen-Vocabulary Object Detection Visual Tokenization
PowerChina Zhongnan Engineering Corporation Limited
TivTok: Broadcasting Time-Invariant Tokens for Scalable Video Tokenization
Jun 16, 2026Weiliang Chen, Yuanhui Huang, Xuebo Wang +1Visual Tokenization Video Token Compression
Department of Electronic Engineering, Tsinghua University, Beijing, 100084, China · Department of Automation, Tsinghua University, Beijing, 100084, China · Kuaishou Technology, Beijing, China
Explainable Task-Oriented Token Communication for AI-Native 6G Networks
Jun 12, 2026Feibo Jiang, Lei Mao, Li Dong +36G Networks Visual Tokenization
RepWAM: World Action Modeling with Representation Visual-Action Tokenizers
Jun 11, 2026Junke Wang, Qihang Zhang, Shuai Yang +5Latent Action Learning World Models for Robotics
Institute of Trustworthy Embodied AI, Fudan University · 2Robbyant, Ant Group · 3Hongkong University of Science and Technology
HYDRA-X: Native Unified Multimodal Models with Holistic Visual Tokenizers
Jun 11, 2026Guozhen Zhang, Xuerui Qiu, Yutao Cui +11Unified Multimodal Models Vision Transformer
Nanjing University · Work done during internship at Tencent Hunyuan. · CASIA +3
ARM: An AutoRegressive Large Multimodal Model with Unified Discrete Representations
Jun 9, 2026Junke Wang, Xiao Wang, Jiacheng Pan +16Text-Guided Image Editing Unified Multimodal Models
Institute of Trustworthy Embodied AI, Fudan University
AdaTok: Self-Budgeting Image Tokenization with Quality-Preserving Dynamic Tokens
Jun 5, 2026Xiaocheng Lu, Yuxi Chen, Jie Zhang +5Image Tokenization Visual Tokenization
The Hong Kong University of Science and Technology · The Hong Kong Polytechnic University
Adaptive Tokenisation Via Temporal Redundancy Masking And Latent Inpainting
Jun 4, 2026Kevin Dave, Sai Aditya Patkuri, Chhaya Kumar Das +3Visual Tokenization Video Token Compression
Phronetic AI · IISc Bangalore · IIT Bombay
Balancing Image Compression and Generation with Bootstrapped Tokenization
Jun 4, 2026Haozhe Chi, Jinghan Li, Hao Jiang +4Learned Image Compression Image Tokenization
1Peking University · 2Central Media Technology Institute, Huawei
ChannelTok: Efficient Flexible-Length Vision Tokenization
Jun 3, 2026Sukriti Paul, Arpit Bansal, Tom GoldsteinImage Tokenization Visual Tokenization
University of Maryland, College Park
AdaCodec: A Predictive Visual Code for Video MLLMs
Jun 1, 2026Haowen Hou, Zhen Huang, Zheming Liang +8Predictive Coding Efficient VLM Inference
Shanghai Jiao Tong University · Shanghai Innovation Institute
Residual Decoder Adapter: ID-Preserving Tokenizer Adaption for Autoregressive Text Rendering
Jun 1, 2026Dongxing Mao, Jinpeng Wang, Jiahao Tang +6Image Tokenization Visual Tokenization
Central South University · University of Oxford · Microsoft Research
MergeTok: Unified Continuous and Discrete Visual Tokenization via Token Merging
May 29, 2026Luyuan Zhang, Siyuan Li, Zedong Wang +7Variational Autoencoders Token Merging
1Tsinghua University · 2Westlake University · 3Zhejiang University +3
PARCEL: Pool-Anchored Resampling with Conditioned Elastic Queries for Efficient Vision-Language Understanding
May 28, 2026Selim Kuzucu, Alessio Tonioni, Vasile Lup +3Image Tokenization Efficient VLM Inference
Max Planck Institute for Informatics, SIC · Google · Technical University of Munich
Structure over Pixels: Learning Variable-Length Visual Programs
May 26, 2026Piotr Wyrwiński, Kacper Dobek, Krzysztof KrawiecVisual Representation Learning Image Tokenization
Institute of Computing Science Poznan University of Technology, Poznan, Poland
Channel-wise Vector Quantization
May 25, 2026Wei Song, Tianhang Wang, Yitong Chen +5Image Tokenization Visual Tokenization
Shanghai Innovation Institute · Westlake University · Zhejiang University +2
LLaVA-OneVision-2: Towards Next-Generation Perceptual Intelligence
May 25, 2026Xiang An, Yin Xie, Feilong Tang +27VLM Evaluation Temporal Video Grounding
Glint Lab · AIM for Health Lab · MVP Lab
Vision Foundation Models as Generalist Tokenizers for Image Generation
May 18, 2026Anlin Zheng, Qi Han, Xin Wen +5Vision Foundation Models Image Tokenization
University of Hong Kong, Pokfulam, Hong Kong · StepFun
WinTok: A Win-Win Hybrid Tokenizer via Decomposing Visual Understanding and Generation with Transferable Tokens
May 18, 2026Yiwei Guo, Shaobin Zhuang, Zhipeng Huang +4Image Tokenization Unified Multimodal Models
Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences · WeChat Vision, Tencent Inc. · Shanghai Jiao Tong University
A More Word-like Image Tokenization for MLLMs
May 18, 2026Hyun Lee, Hyemin Jeong, Yejin Kim +4Image Tokenization Efficient VLM Inference
Seoul National University · Ewha Womans University
Unified Pix Token And Word Token Generative Language Model
May 13, 2026Haun Leung, ZiNan WangImage Tokenization Self-Supervised Pre-Training
Spectral Vision Transformer for Efficient Tokenization with Limited Data
May 12, 2026Alexandra G. Roberts, Maneesh John, Jinwei Zhang +10Medical Imaging Image Tokenization
Beyond the Last Layer: Multi-Layer Representation Fusion for Visual Tokenization
May 11, 2026Xuanyu Zhu, Yan Bai, Yang Shi +4Autoencoders Visual Tokenization
Peking University · Meituan Inc · Tsinghua University +1
Fre-Res: Frequency-Residual Video Token Compression for Efficient Video MLLMs
May 10, 2026Yigui Feng, Qinglin Wang, Yang Liu +1Efficient VLM Inference Visual Tokenization
The College of Computer Science, National University of Defense Technology, Changsha, Hunan, China · College of Computer Science, National University of Defense Technology, Deya Road 109, Changsha, Hunan 410073, China · The Shien-Ming Wu School of Intelligent Engineering, South China University of Technology, Guangzhou, Guangdong, China +1
Learning Discrete Autoregressive Priors with Wasserstein Gradient Flow
May 7, 2026Bowen Zheng, Yihong Luo, Tianyang HuImage Tokenization Visual Tokenization
The Chinese University of Hong Kong, Shenzhen · Hong Kong University of Science and Technology
MUSE: Resolving Manifold Misalignment in Visual Tokenization via Topological Orthogonality
May 7, 2026Panqi Yang, Haodong Jing, Jiahao Chao +5Visual Representation Learning Image Tokenization
State Key Laboratory of Human-Machine Hybrid Augmented Intelligence,National Engineering Research Center of Visual Information and Applications,and Institute of Artificial Intelligence and Robotics, Xi’an Jiao Tong University · Xiaohongshu Inc.
Visual Text Compression as Measure Transport
May 6, 2026Lv Tang, Tianyi Zheng, Yang Liu +2Efficient VLM Inference Visual Tokenization
University of Alberta1 · vivo Mobile Communication Co., Ltd2 · Tsinghua University3
ViTok-v2: Scaling Native Resolution Auto-Encoders to 5 Billion Parameters
May 6, 2026Philippe Hansen-Estruch, Jiahui Chen, Vivek Ramanujan +9Image Tokenization Autoencoders
University of Texas, Austin · University of Washington · 3Stanford University +3
End-to-End Autoregressive Image Generation with 1D Semantic Tokenizer
May 1, 2026Wenda Chu, Bingliang Zhang, Jiaqi Han +4Image Tokenization Visual Tokenization
ByteDance Seed · California Institute of Technology · Stanford University
VibeToken: Scaling 1D Image Tokenizers and Autoregressive Models for Dynamic Resolution Generations
Apr 27, 2026Maitreya Patel, Jingtao Li, Weiming Zhuang +2Image Tokenization Visual Tokenization
Arizona State University · SonyAI · 3Work partially done while at SonyAI. Maitreya is now at Adobe.
COMiT: Learning Structured Visual Tokens through Sequential Communication
Feb 24, 2026Aram Davtyan, Yusuf Sahin, Yasaman Haghighi +4Image Tokenization Visual Tokenization
Computer Vision Group, University of Bern, Switzerland · VITA Lab, EPFL, Switzerland
Spiking Patches: Asynchronous, Sparse, and Efficient Tokens for Event Cameras
Oct 30, 2025Christoffer Koo Øhrstrøm, Ronja Güldenring, Lazaros NalpantidisEvent-Based Vision Visual Tokenization
Technical University of Denmark
Slot2Text: Object-Centric Visual Tokenization for Efficient and Spatially Traceable Surgical MLLMs
Date pendingGuiqiu Liao, Matjaz Jogan, Daniel A. HashimotoImage Tokenization Healthcare
GRASP Laboratory, University of Pennsylvania · PCASO Laboratory, Department of Surgery, University of Pennsylvania · Department of Computer and Information Science, University of Pennsylvania

Oct 7, 2026, cs.CVJ/K move · Enter open · S save

QuadTok: Quadtree Visual Tokenizer for Autoregressive Image Generation

Yucheng Mao, Zeyuan Chen, Xiaojun Shan, Xiang Zhang+3

University of California, San Diego

Visual Tokenization Autoregressive Image Generation Visual Token Compression Controllable Image Generation

Open paper AskPDF arXiv

We introduce QuadTok, a novel framework for visual tokenization and autoregressive image generation. Compared to traditional approaches using 2D grids or 1D token sequences, we propose a hierarchical quadtree structure, bridging the gap between 2D spatial binding and 1D sequence-level flexibility. The QuadTok tokenizer dynamically allocates representational capacity to visually intricate areas while leaving homogeneous regions at a coarse resolution. Compared with a fixed 256-token grid, our ImageNet-trained tokenizer saves approximately 10% of tokens on ImageNet and 9% when transferred zero-shot to the COCO dataset, while maintaining comparable reconstruction fidelity. Furthermore, the natural causality introduced by the tree structure seamlessly enables autoregressive image generation. Conditioned on a quadtree topology supplied before generation, our 947M GPT-style generative model achieves a 2.08 gFID on the ImageNet

256 \times 256

benchmark. Additionally, leveraging the strong spatial correlation preserved by the quadtree structure, the QuadTok generator enables zero-shot spatially controlled image generation capabilities. Code: https://github.com/myc634/QuadTok.

Momentum

Related topics

Latest papers 43