Overview

Vision encoders represent images and video as patch or frame tokens, and long token sequences can make multimodal models costly to run, especially during prefill and memory-intensive video reasoning. Methods include training-free pruning and merging, learned resamplers, quantization and codecs, and adaptive token budgets guided by text queries, spatial structure, or temporal redundancy. They are evaluated on tasks such as visual question answering, video understanding, OCR, segmentation, retrieval, generation, and robot control. The central tension is that fewer tokens do not always mean faster end-to-end inference, and aggressive compression can discard details needed for a particular question or task.

Latest papers

CardsList

287 papers22 papers in the last four weeks, down 51% on the four weeks before. 0.2% of all new papers.

  1. NullTok: empirical-null token selection for training-free long video understanding

    Nov 18, 2026Zhang Ziyue, Juwei Jian, Baiyang Song +4Long-Video UnderstandingVisual Token Pruning

  2. LoopZip: Visual Token Compression for Efficient Looped Vision-Language Models

    Nov 17, 2026Weizhong Huang, Zhicheng Liu, Yan Zhang +3Efficient VLM InferenceVisual Token Compression

  3. Out of Sight, Into Memory: Compact Visual Latents Retain Local Evidence in Ultra-High-Resolution Remote Sensing

    Nov 16, 2026Meng Tang, Siyuan Du, Yuxin Liu +3Memory-Augmented VLMsRemote Sensing Visual Question Answering

  4. TIVS: Mapping the Sensitivity Landscape of Visual Token Transformations in MLLMs

    Nov 15, 2026Yikang Qiao, Jianye Zeng, Duan Huang +1Multimodal Large Language ModelsVisual Evidence Sensitivity in VLMs

  5. StreamEmbed: Real-Time Indexing from Pixels for Screenshot Retrieval

    Nov 13, 2026Dayoon Ko, Yichuan Wang, Soyeong Jeong +3Streaming InferenceVisual Representation Learning

  6. SWAM: Saliency-Weighted Asymmetric Merging for Efficient Vision Transformers

    Nov 13, 2026Utkarsh Kumar Singh, Manish Das, Shiv Ram Dubey +1Token MergingEfficient ViTs

  7. OpticalRAG: Pixel-Space Compression for Token-Efficient Retrieval-Augmented Generation

    Nov 10, 2026Senhao Liu, Yuheng Zhang, Chunyu Wei +2RAG Context CompressionMultimodal RAG

  8. Differentiable Virtual-Slot Partitioning for Adaptive Tokenization in Vision Transformers

    Nov 8, 2026Gaoxiang He, Bin Zhu, Bo Xie +3Adaptive TokenizationEfficient ViTs

  9. VoluCompose: Constructing Compact Volumetric Visual Representations for Medical Image Understanding

    Nov 5, 2026Zanting Ye, Yunrui Lin, Shengyuan Liu +4Visual Token CompressionMultimodal Token Compression

  10. Visual Token Routing: Learning to keep tokens that matter

    Nov 4, 2026Pranjal Aggarwal, Sean WelleckVisual Token PruningVisual Token Compression

  11. Learning Hierarchical Patch Splitting Policies for Faster Vision Transformers

    Nov 3, 2026Aditya Gupta, Jean Sebastien Dandurand, Kai Qiu +2Vision TransformerEfficient ViTs

  12. Compression Forcing: Hierarchical History Tokenization Enables Flexible World Models

    Nov 2, 2026Siqiao Huang, Partha Kaushik, Michael Chen +5World Model LearningWorld Models

  13. SVD-Prune: Spectral Vision Token Pruning under Extreme Compression

    Nov 1, 2026Yvon Apedo, Martyna Poreba, Michal Szczepanski +1Visual Token PruningLVLM Pruning

  14. SIEVE: Preserving Cross-Image Evidence via Depth-Aware Token Compression

    Oct 30, 2026Nitish Shukla, Surgan Jandial, Nhat-Tan Bui +1Efficient VLM InferenceVisual Token Compression

  15. ConvRoute-ViT: Convolutional Token Routing for Efficient Vision Transformers

    Oct 28, 2026Manish Das, Shiv Ram Dubey, Satish Kumar SinghVision TransformerEfficient ViTs

  16. WithinVAE: Compact Visual Autoencoding with Self-Distilled Semantics

    Oct 27, 2026Yuzhou Ji, Jiepeng Wang, Tianyu Jin +4Variational AutoencodersVisual Token Compression

  17. TP-JSCC: Efficient Token Pruning and Joint Source-Channel Coding for LVLMs-based 3D-VQA in Cloud-Edge Collaboration

    Oct 26, 2026Zhengxin Li, Chongzhen Tian, Hui Yuan +2Visual Token Compression3D Visual Question Answering

  18. Rescuing Your Pruning: Rethinking Visual Token Pruning and Post-Training Recovery in MLLMs

    Oct 24, 2026Peiran Yin, Hao Wu, Zihao Yang +3Visual Token PruningEfficient VLM Inference

  19. Patch-Derived or Register Tokens? Comparing Variable-Length Image Tokenizers

    Oct 24, 2026Philipp Schenkel, Tobias Schürmann, Omer Sahin TasImage TokenizationVisual Token Compression

  20. Consommé: Conditioned Token Merging for Split Inference

    Oct 23, 2026Man Ngo, Jan S. RellermeyerSplit InferenceEfficient ViTs

  21. Rethinking Sequence Compression with Test-time Regression

    Oct 22, 2026Sihan Yang, Jie Huang, Hanxuan Li +4LLM Context CompressionMultimodal Token Compression

  22. ReTrace: Visual Backtracking for Efficient Multimodal Large Language Models

    Oct 18, 2026Guangzong Si, Dong Wang, Yifan Yu +3Efficient VLM InferenceVisual Token Compression

  23. Query-adaptive Recurrent Tokenization

    Oct 16, 2026Bavesh Balaji, Pranav Gopinath, Pouya Sadeghi +1Visual TokenizationEfficient VLM Inference

  24. Thinking from Above: Efficient Spatial Reasoning with Bird's-Eye-View Visual Tokens

    Oct 15, 2026Faizan Siddiqui, Nirav Savaliya, Sahith Reddy Chada +1Visual Spatial ReasoningBird's-Eye-View Representation

  25. PACE: Pareto-Adaptive Compression for Efficient Native MLLMs

    Oct 15, 2026Lei Tian, Chunzheng Zhu, Kai Wu +2Multimodal Token CompressionVisual Token Compression

  26. FastVLA: Task-Conditioned and Temporally Adaptive Visual Token Compression for Efficient Vision-Language-Action Models

    Oct 15, 2026Jiuyi Xu, Chengyuan Qian, Zhengzhong Tu +2Efficient VLA InferenceVisual Token Compression