Visual Token Compression

Follow this topic Ask about this topic

Momentum

20 papers in the last four weeks, up 67% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 184

All topics

QuadTok: Quadtree Visual Tokenizer for Autoregressive Image Generation
Oct 7, 2026Yucheng Mao, Zeyuan Chen, Xiaojun Shan +4Visual Tokenization Autoregressive Image Generation
University of California, San Diego
Understanding and Mitigating Token-Pruning-Induced Vulnerabilities in VLMs
Oct 7, 2026Shuailong Wang, Xinyu Lyu, Shengming Yuan +3Visual Token Pruning VLM Robustness
University of Electronic Science and Technology of China, Chengdu, China · Southwestern University of Finance and Economics, Chengdu, China · Tongji University, Shanghai, China +1
Adaptive Visual Token Reduction for Accelerated Image Understanding
Oct 7, 2026Seyoung Jeong, Jong Pil Yun, Sang Jun LeeEfficient VLM Inference Visual Token Pruning
Jeonbuk National University, Jeonju, Republic of Korea · Korea Institute of Industrial Technology (KITECH), Incheon, Republic of Korea · Chung-Ang University, Seoul, Republic of Korea
VisionWeave: Weaving Elastic Visual Representations as a Native Capability of MLLMs
Oct 6, 2026Yuan Feng, Qize Yang, Ruizhe Chen +9Efficient Multimodal Inference Multimodal Large Language Models
University of Science and Technology of China · Alibaba Token Hub, Alibaba Group · The Chinese University of Hong Kong +1
Foveated Compression: Selective High-Resolution Preservation for Token-Efficient VLMs
Oct 6, 2026Donghyun Han, Jangho Park, Yuseok BaeEfficient VLM Inference Visual Token Pruning
ETRI, South Korea · Kyung Hee University, South Korea
Level-of-Token Diffusion
Oct 5, 2026Kiyohiro Nakayama, Brian Chao, Jan Ackermann +5Video Diffusion Models Diffusion Transformer
Stanford University · Google
VETO: Video Efficient Token Optimization for Vision Language Models
Oct 1, 2026Gueter Josmy Faure, Hao Ping Wang, Min-Hung Chen +1Efficient VLM Inference Large Vision-Language Models
National Taiwan University · NVIDIA
CoVisco: Codec-Native Vision Encoder with Native Token Compression for Unified Image-Video Understanding
Sep 30, 2026Yulong Liu, Xiaotian Han, Junyuan Shang +6Video Understanding Efficient VLM Inference
ERNIE Team, Baidu Inc. · The Hong Kong University of Science and Technology · Institute of Automation, Chinese Academy of Sciences (CASIA)
DC-SAE: Deep Compression Semantic Autoencoder for Faster Diffusion Convergence
Sep 30, 2026Xu Huang, Ye Huang, Zijun Liao +6Autoencoders Diffusion-Based Image Generation
Peking University · Singapore University of Technology and Design
Feature-Aware Token Attack for Compression-Triggered Stealthy Failures in Large Vision-Language Models
Sep 30, 2026Shilinlu Yan, Bowen Chen, Yuechen Zhang +3VLM Robustness Adversarial Attacks on VLMs
Beijing University of Posts and Telecommunications · Jiangnan University · Nanyang Technological University +1
Task-Oriented Visual Feature Compression via Residual Vector Quantization for Device-Edge Multimodal Inference
Sep 29, 2026Luning Pang, Cheng Yuan, Jiawei Shao +2Efficient Multimodal Inference Visual Token Compression
Department of Electronic Engineering, and Beijing National Research Center for Information Science and Technology, Tsinghua University, Beijing 100084, China · Institute of Artificial Intelligence (TeleAI), China Telecom, Beijing 100033, China
Representation Dynamics Reveal Semantic Saliency and Similarity for Visual Token Pruning in MLLMs
Sep 29, 2026Weixuan Li, Zikun Zhou, Xinyi Zhuang +4Efficient VLM Inference Visual Token Pruning
Harbin Institute of Technology, Shenzhen · Shenzhen Loop Area Institute
Aperture: Merge-Consistent Rotary States for Compressed Tokens
Sep 29, 2026Yuhao Du, Shunian ChenRotary Positional Embeddings Visual Token Merging
The Chinese University of Hong Kong, Shenzhen · Shenzhen Loop Area Institute
NesTok: Nested Self-Aligned 1D Tokenizer for Autoregressive Image Generation
Sep 29, 2026Jiawei Zhang, Shuhao Liu, Rong Huang +4Autoregressive Image Generation Visual Token Compression
North China Electric Power University · University of Science and Technology of China · Stanford University
FocusVTC: Efficient and High-Performance Visual Text Compression with Adaptive Resolution
Sep 29, 2026FangZhi Zhong, Xuerui Qiu, Yuqi Pan +4Efficient VLM Inference VLM Reasoning
Institute of Automation, Chinese Academy of Sciences · School of Artificial Intelligence, University of Chinese Academy of Sciences · Zhongguancun Academy +1
Rethinking Visual Token Compression for Video Large Language Models: A Simple Yet Strong Baseline
Sep 28, 2026Xiao Zhang, Wang Zeng, Sheng Jin +3Video Understanding Video-Language Models
School of Computer Science and Engineering, Central South University · SenseTime Research and Tetras.AI
Beyond Selection: Token Parameterization for Extreme Visual Token Compression
Sep 28, 2026Rui Zhong, Yu Li, Zheyu Yan +1Efficient VLM Inference Large Vision-Language Models
Zhejiang University
Still There, No Longer Seen: Exposing Compression-Induced Risk in Large Vision-Language Models
Sep 28, 2026Qiankun Li, Yuechen Zhang, Bowen Chen +4VLM Robustness Adversarial Attacks on VLMs
Nanyang Technological University · Beijing University of Posts and Telecommunications
Resolution as a First-Class Decision: Task-Conditioned Routing for Efficient Multimodal Large Language Models
Sep 28, 2026Zhiqiang Xia, Yang Li, Xinyuan Zhang +5Efficient Multimodal Inference Efficient VLM Inference
Xiaomi Corporation, Beijing, China
When Text Matters: Design Principles for Visual Token Pruning in Vision-Language Model
Sep 28, 2026Minchan Kang, Kyeonghye Park, Seoyoung Cho +2Efficient VLM Inference Visual Token Pruning
Korea Advanced Institute of Science and Technology (KAIST) · Hanbat National University
CoViST: Visual Token Compression via Composable States
Sep 27, 2026Qi Zhang, Xiandong Meng, Ronggang Wang +1Vision-Language Models Efficient VLM Inference
Peng Cheng Laboratory Shenzhen, China · Peking University Shenzhen Graduate School Peking University Beijing, China
Fewer Tokens, More Self-Teaching: On-Policy Self-Distillation for Extreme Visual Token Reduction
Sep 26, 2026Junxian Li, Ruixuan Yang, Tianao Zhang +3Efficient VLM Inference VLM Distillation
Shanghai Jiao Tong University · Xi’an Jiaotong University · University of Cambridge +1
VPRune: Efficient Training-free Pre-LLM Visual Token Pruning
Sep 21, 2026Guangchuan Lv, Dianxing Shi, Dingjie FuEfficient VLM Inference Large Vision-Language Models
Northeastern University · Beihang University · Huazhong University of Science and Technology
VideoMM: Adaptive Macro-Micro Inference for Efficient Video MLLMs
Sep 15, 2026Haoyu Guo, Yuan Feng, Junlin Lv +3Efficient VLM Inference Long-Video Understanding
School of Biomedical Engineering, University of Science and Technology of China · Data Darkness Lab, MIRACLE Center, Suzhou Institute for Advanced Research · China +1
SparseTalk - Sparsifying 3D Gaussian Language Fields for Efficient 3D Visual Question Answering
Sep 14, 2026Davit Soselia, Joseph JaJa, Amitabh Varshney3DGS Compression Language-Embedded 3DGS
University of Maryland, College Park, MD, USA
TRACE: Trajectory-robust Admission with Evidence Ordering for Efficient GUI Agents
Sep 9, 2026Yuhao Wang, Mu Qiao, Xindong Zhang +3KV-Cache Compression Visual Token Pruning
Dalian University of Technology · OPPO Research Institute · The Hong Kong Polytechnic University
Who Speaks for the Pruned? Visual Token Pruning as Coverage Optimization
Sep 2, 2026Qingchan Zhu, Weihang You, Hanqi Jiang +3Efficient VLM Inference Visual Token Pruning
School of Computing, University of Georgia · College of Engineering, Northeastern University
ZipTok3D: High-Fidelity 3D Tokenization with Compact Token Prefixes
Sep 1, 2026Mingda Lin, Weijie Wang, Zeyu Zhang +73D Reconstruction 3D Representation Learning
1Zhejiang University · 2Monash University · University of Adelaide
Compressing AI Traffic: Standardized Neural Network Coding of Visual-Token Representations in Split Vision-Language Inference
Sep 1, 2026Reza Heidari, Hamed R. Tavakoli, Juho KannalaVisual Token Compression VLM Inference
Aalto University, Nokia Technologies · Nokia Technologies · Espoo, Finland +1
Doc-REFRAG: Rethinking Multimodal Document Retrieval-Augmented Generation
Aug 31, 2026Ruofan Hu, Shengyang Xu, Minjie Hong +5Multimodal RAG Efficient Multimodal Inference
Zhejiang University
Spatial Matryoshka Training for Multi-Granularity Visual Document Retrieval
Aug 30, 2026Trishan Singha Roy, Arkadeep Acharya, Vishwajeet Kumar +2Hierarchical Representation Learning Matryoshka Representation Learning
IIT Delhi · IBM
PACE: A Unified Condense-and-Extract Paradigm for Fast VLM Inference
Aug 27, 2026Junjie Liu, Shengyuan Ye, Xu ChenEfficient VLM Inference Visual Token Pruning
Sun Yat-sen University · Power Dispatch Control Center, Guangdong Power Grid Co., Ltd. Guangzhou, China · Shenzhen Loop Area Institute, Shenzhen, China
Token-Oriented Semantic Communication with Pretrained Vision Transformers
Aug 26, 2026Jiwoong Im, Minwoo Kim, Jaeho Lee +2Learned Image Compression Semantic Communication
Department of Electrical Engineering, Pohang University of Science and Technology (POSTECH), Pohang 37673, South Korea
Just Noticeable Difference Modeling for Token Compression in Vision-Language-Action Models
Aug 21, 2026Zhuoyuan Li, Rui Zhao, Jin Wang +5Vision-Language-Action Models Visual Token Pruning
Department of Electrical and Electronic Engineering, The Hong Kong Polytechnic University, Hong Kong · School of Computer Science and Engineering, Nanyang Technological University, Singapore 639798 · Bytedance Inc. +2
MergeOver: Post-Training Token Merging for Recursive Vision Transformers
Aug 13, 2026Junseo Kim, Uraz Odyurt, Amirreza YousefzadehVision Transformer Efficient ViTs
Computer Architecture for Embedded Systems, University of Twente Enschede, The Netherlands
When Vision Becomes Text: Visual Token Pruning via Cross-Modal Residual Guidance in VLMs
Aug 11, 2026Congyang Ou, Ruike Song, Yang Zhou +3Efficient VLM Inference Large Vision-Language Models
Northwestern Polytechnical University · Chongqing University · MiLM Plus, Xiaomi Inc.
Can Coding Agents Solve Repository-Level Issues with Rendered Code? An Exploratory Study of Visual Representations
Aug 10, 2026Weijie Liang, Yuanfeng Song, Xing Chen +3Automated Program Repair AI Coding Agents
The Hong Kong University of Science and Technology, Hong Kong, China · ByteDance, China
Not All Visual Tokens Are Equally Safe to Remove:Consequence-Sensitive Visual Token Compression
Aug 10, 2026Jingbo Wen, Liang He, Mingyu Cao +4Efficient VLM Inference Visual Token Compression
1The University of Sydney · 2Tongji University · University of Surrey +3
Visual Token Codec: Unleashing Spatial Redundancy for ViT Feature Coding
Aug 9, 2026Donghui Feng, Fengxi Zhang, Changsheng Gao +6Visual Token Compression
AnchorFold: A Focus-Then-Fold Framework via Recursive Attention Propagation for Efficient Multi-Vector Visual Document Retrieval
Aug 9, 2026Haoyu Zuo, Yibo Yan, Xin Zou +4Multi-Vector Retrieval Visual Document Retrieval
Hong Kong University of Science and Technology (Guangzhou) · Alibaba Cloud Computing · Hong Kong University of Science and Technology
Resolution Meets Reduction: Efficient Visual Context for 3D Radiology Report Generation
Aug 9, 2026Jonathan Suprijadi, Raphael Stock, Moritz Langenberg +10Radiology Report Generation Radiology VLMs
Division of Medical Image Computing, German Cancer Research Center (DKFZ), Heidelberg, Germany
KVAE: Family of Tokenizers for Multimodal Generative Models
Aug 6, 2026Andrey Shutkin, Denis Parkhomenko, Ivan Kirillov +11Variational Autoencoders Audio Token Compression
Kandinsky Lab
Persistent Object Narratives for Token-Efficient Video Language Models
Aug 5, 2026Junzhe Chen, Siyuan Meng, Xiaojie GuoVisual Tokenization Video-Language Models
Tianjin University
HiSC: Hierarchical Spatial Clustering Token Compression for Efficient 3D Scene Understanding
Aug 5, 2026Jiuhe Qu, Yingping Liang, Ying Fu3D Spatial Reasoning Visual Token Pruning
Beijing Institute of Technology Beijing, China
CARVE: Cross-Slice Anisotropic Reallocation of Visual Evidence for Efficient 3D Medical Volume Understanding
Aug 5, 2026Zhenyu Yi, Qiang Hu, Zhenhao Li +33D Medical Imaging Medical VQA
School of Biomedical Engineering, Shanghai Jiao Tong University · 2Wuhan National Laboratory for Optoelectronics, Huazhong University of Science and Technology
RUTA: Principled Visual Token Allocation via Rate-Utility Optimization
Aug 4, 2026Jian Zou, Xiaoyu Xu, Zhihua Wang +3Efficient VLM Inference Visual Token Pruning
City University of Hong Kong · Google Inc.
OmniPack: Unified Token Compression for Efficient Omni-modal Large Language Models
Aug 4, 2026Wanshun Su, Yang Shi, Feihu Liu +10Efficient Multimodal Inference Audio Token Compression
Northwestern Polytechnical University · Peking University · Alibaba Group +1
When Do Fewer Visual Tokens Accelerate Multimodal Inference? A Break-Even Study Across Decision Locations and Hardware
Aug 4, 2026Hao Dou, Ruiwen TianEfficient VLM Inference Visual Token Pruning
Harbin Institute of Technology, Harbin, China
Messages, Not Tokens: Grounded Coresets for Faithful VLM Compression
Aug 3, 2026Long Qian, Jiaqi Wei, Bingke Zhu +2Efficient VLM Inference Coreset Selection
Foundation Model Research Center, Institute of Automation, Chinese Academy of Sciences, Beijing, China · School of Engineering, Cardiff University, Cardiff, United Kingdom · School of Future Technology, University of Chinese Academy of Sciences, Beijing, China +1
Same Semantics, Different Paths: Self-Improving Alignment for Vision-Text Compression
Aug 3, 2026Tianyu Liang, Xiangxi Zheng, Yilin Wang +1VLM Adaptation Multimodal Token Compression
Southeast University Nanjing, China · Nanjing University Nanjing, China · Zhejiang University Hangzhou, China +1
Decoupling semantics from vision: A framework for faithful visual-text compression evaluation
Aug 3, 2026Yonghan Gao, Zehong Chen, Lijian Xu +3Multimodal Model Evaluation Visual Token Compression
Shenzhen University of Advanced Technology · Shenzhen Technology University
CRAFT: Compression via Recursive Adaptive Fusion of Video Tokens for Vision-Language Models
Aug 3, 2026Yu Chen, Xiaohong Li, Xiaole Wang +3Efficient VLM Inference Large Vision-Language Models
1Evermind · 2Shanda Group · 3Peking University
Rethinking Video Token Compression with a Global Codebook: Learning Once, Compressing Everywhere
Aug 2, 2026Jiayang He, Tianling Xu, Diancheng Kang +4Efficient VLM Inference Video-Language Models
Southern University of Science and Technology · Imperial College London · Jilin University
RAGOCR: Optical Compression of Retrieval-Augmented Text via Visual Representation
Aug 1, 2026Jiayang Yu, Jialun Zhong, Lei ZouMultimodal RAG Retrieval-Augmented Generation
Wangxuan Institute of Computer Technology, Peking University Beijing, China
ORCA: ORgan-Centroid Aggregation for Training-Free 3D CT Visual Token Compression
Jul 31, 2026Renjie Liang, Zijian Xu, Jinqian Pan +6Medical VLMs Visual Token Merging
University of Florida, Gainesville, FL, USA · University of Southern California, Los Angeles, CA, USA · National University of Singapore, Singapore
ObjectStream: Latent Objects as Memory Anchors for Streaming Video Understanding
Jul 30, 2026Mingkang Dong, Muxin Pu, Jie Li +8Memory-Augmented VLMs Streaming Video Understanding
Universiti Malaya · Monash University · SJTU +5
Calibrate Before Reason: Robust Visual Token Reduction against Semantic Drift in VLMs
Jul 30, 2026Jiasheng Li, Zhong Ji, Yan Zhang +1VLM Robustness Efficient VLM Inference
Tianjin University, Tianjin, China · Tsinghua University, Beijing, China
MedARC: Training-Free Adaptive Redundancy Compression of Visual Tokens for 3D Medical Vision-Language Models
Jul 29, 2026Yitao Zhu, Mengjun Liu, Yingji Fu +2Efficient VLM Inference Medical VLMs
Department of Health Technology and Informatics, The Hong Kong Polytechnic University, Hong Kong · School of Integrated Circuits and Electronics, Beijing Institute of Technology, China · 3Mental Health Research Center, The Hong Kong Polytechnic University, Hong Kong +1
MAViE: A Multi-scale Adaptive Vision Encoder for Fine-grained Visual Perception and Efficient Multimodal Reasoning
Jul 27, 2026Shaofei LeiEfficient VLM Inference Multi-Scale Feature Fusion
GOTS: Greedy Orthogonal Token Selection for High-Resolution Vision-Language Models
Jul 27, 2026Jun Ling, Tao Huang, Junzhuo Liu +2Efficient VLM Inference Large Vision-Language Models
School of Computer Science and Engineering, University of Electronic Science and Technology of China

Oct 7, 2026, cs.CVJ/K move · Enter open · S save

QuadTok: Quadtree Visual Tokenizer for Autoregressive Image Generation

Yucheng Mao, Zeyuan Chen, Xiaojun Shan, Xiang Zhang+3

University of California, San Diego

Visual Tokenization Autoregressive Image Generation Visual Token Compression Controllable Image Generation

Open paper AskPDF arXiv

We introduce QuadTok, a novel framework for visual tokenization and autoregressive image generation. Compared to traditional approaches using 2D grids or 1D token sequences, we propose a hierarchical quadtree structure, bridging the gap between 2D spatial binding and 1D sequence-level flexibility. The QuadTok tokenizer dynamically allocates representational capacity to visually intricate areas while leaving homogeneous regions at a coarse resolution. Compared with a fixed 256-token grid, our ImageNet-trained tokenizer saves approximately 10% of tokens on ImageNet and 9% when transferred zero-shot to the COCO dataset, while maintaining comparable reconstruction fidelity. Furthermore, the natural causality introduced by the tree structure seamlessly enables autoregressive image generation. Conditioned on a quadtree topology supplied before generation, our 947M GPT-style generative model achieves a 2.08 gFID on the ImageNet

256 \times 256

benchmark. Additionally, leveraging the strong spatial correlation preserved by the quadtree structure, the QuadTok generator enables zero-shot spatially controlled image generation capabilities. Code: https://github.com/myc634/QuadTok.

Momentum

Related topics

Latest papers 184