Overview

Visual token pruning studies how to remove or merge image and video patches before or inside vision transformers and vision-language models, reducing computation and memory for tasks such as visual question answering, video understanding, document reading, and robot control. Methods use attention or text-query relevance, feature diversity and spatial coverage, and signals such as entropy, spectral structure, or geometry; learned selectors and adaptive budgets choose different tokens or compression rates for different inputs. Pruning can happen before visual encoding, across language-model layers, or during video processing, and is evaluated on both task benchmarks and practical measures such as prefill latency, FLOPs, and memory. The central tension is that a token that seems redundant early may become important for later reasoning, while selection overhead and hardware execution can prevent fewer tokens from yielding faster end-to-end inference.

Latest papers

CardsList

298 papers23 papers in the last four weeks, down 48% on the four weeks before. 0.2% of all new papers.

  1. Hierarchical and Query-Aware Visual Token Pruning for High-Resolution LVLMs

    Oct 16, 2026Luther Wei, Ling Zou, Kang-Yang Huang +2Visual Token PruningEfficient VLM Inference

  2. CatchUp: Depth-Aware Re-Admission of Visual Tokens for Efficient Large Vision-Language Models

    Oct 16, 2026Eunju Park, Uiwon HwangEfficient VLM InferenceLarge Vision-Language Models

  3. MedSTP: Preserving Subspace and Transition Evidence for Medical VQA Token Pruning

    Oct 15, 2026Mengchen Fan, Qizhen Lan, Xi Xiao +6Visual Token PruningMedical Visual Question Answering

  4. STP-GUI: Spatially-Aware Token Pruning for Efficient Web-GUI Agents

    Oct 14, 2026Shuo Wang, Sifan Zhou, Xiaobo Wang +6Visual Token PruningEfficient VLM Inference

  5. Complementary Future Token Pruning for World Action Models

    Oct 14, 2026Baekseung Kim, Junhoo Lee, Sohyeon Hong +5Efficient Inference for World Action ModelsVisual Token Pruning

  6. Just Respect the Semantics: Image-Token Compression via Pre-LLM Semantic Variable-Resolution Tokenization and In-LLM Relevance Pruning

    Oct 13, 2026Tianhao Fu, Austin Wang, Charles Chen +5Visual Token CompressionEfficient VLM Inference

  7. Bifocal: Training-Free Mixed Granularity Visual Token Pruning for Multimodal LLMs

    Oct 13, 2026Peiran Yin, Hao Wu, Zihao Yang +6Visual Token PruningEfficient VLM Inference

  8. Prune-and-Merge: Training-Free Scaling of Vision Transformers

    Oct 13, 2026Vatsal, Soumil Malhotra, Priyanshu Chahal +1Vision TransformerEfficient ViTs

  9. How Much Can We Prune? Exploring the Performance Limits of Visual Token Pruning

    Oct 13, 2026Janghoon Cho, Shubhankar Borse, Reza Pourreza +4Visual Token PruningLVLM Pruning

  10. TwinPrune: Density-Aware Two-Phase Token Pruning for Vision-Language Models

    Oct 13, 2026Kai Liu, Anqi Li, Junxian Li +4Efficient VLM InferenceVisual Token Pruning

  11. FoveaTree: Information-Density Trees for Query-Guided Visual Token Pruning in Video Large Language Models

    Oct 12, 2026Zihan Meng, Weidong Chen, Dexiang Hong +2Efficient VLM InferenceVisual Token Pruning

  12. When 1+1 Backfires: Rethinking Relevance-Diversity Balancing for Sample-Aware Visual Token Reduction

    Oct 12, 2026Yihang Huang, Peisong Wen, Chenhao Zhou +2Efficient VLM InferenceVisual Token Pruning

  13. SheafPrune: Sheaf-Guided Graph Propagation for Visual Token Pruning

    Oct 9, 2026Xiaoyang Ma, Chi Wang, Hong SunVisual Token PruningEfficient VLM Inference

  14. Look Back, Think Ahead: Visual Memory on Demand for Efficient Multimodal Reasoning

    Oct 8, 2026Yicheng Xue, Han Wu, Jufeng Yang +4VLM ReasoningEfficient Multimodal Inference

  15. Understanding and Mitigating Token-Pruning-Induced Vulnerabilities in VLMs

    Oct 7, 2026Shuailong Wang, Xinyu Lyu, Shengming Yuan +3Visual Token PruningVLM Robustness

  16. Adaptive Visual Token Reduction for Accelerated Image Understanding

    Oct 7, 2026Seyoung Jeong, Jong Pil Yun, Sang Jun LeeEfficient VLM InferenceVisual Token Pruning

  17. DIPrune: Task-Aware Token Pruning with Dual Importance for Efficient Multimodal Language Models

    Oct 6, 2026Shuo Yang, Changbai Li, Linlin Yang +6Multimodal Large Language ModelsToken Pruning

  18. Foveated Compression: Selective High-Resolution Preservation for Token-Efficient VLMs

    Oct 6, 2026Donghyun Han, Jangho Park, Yuseok BaeEfficient VLM InferenceVisual Token Pruning

  19. FlashGaze: Training-Free Multi-Scale Patch Pruning For Efficient Video Understanding

    Oct 3, 2026Ziye Zhu, Yanghao Zhou, Lixing Tan +3Efficient VLM InferenceVisual Token Pruning

  20. From Patching to Pruning Visual Computation in Vision Language Models

    Oct 2, 2026Rahul Chowdhury, Timothy A Rupprecht, Xuan Shen +3Efficient VLM InferenceVisual Token Pruning

  21. When Masking Helps or Hurts Robustness in Compressed CLIP: A Pre-Deployment Diagnostic

    Sep 30, 2026Muhammad Zawish, Steven DavyVLM RobustnessEfficient VLM Inference

  22. TReVS: Integrating Textual Relevance and Visual Saliency for Efficient Vision-Language Model Token Pruning

    Sep 29, 2026Jing Wang, Zhiping Wu, Dongdong Ren +3Efficient VLM InferenceLarge Vision-Language Models

  23. Beyond Token Importance: Preserving Spatial Scaffolds for Efficient Vision-Language-Action Inference

    Sep 29, 2026Jiayu Chen, Shuyong Gao, Jingkai Jia +6Efficient VLA Model InferenceVLMs for Robotics

  24. Representation Dynamics Reveal Semantic Saliency and Similarity for Visual Token Pruning in MLLMs

    Sep 29, 2026Weixuan Li, Zikun Zhou, Xinyi Zhuang +4Efficient VLM InferenceVisual Token Pruning

  25. Decoding Affective Nuances: Enhancing MLLMs via Hierarchical Emotion Reasoning and Contrastive Discriminative Pruning

    Sep 29, 2026Cheng Ye, Weidong Chen, Zhaobo Qi +2Multimodal Large Language ModelsMultimodal Emotion Recognition

  26. SPIDER: Multi-Layer Semantic Token Pruning and Adaptive Sub-Layer Skipping in Multimodal Large Language Models

    Sep 28, 2026Tianxiang Chen, Zhentao Tan, Zi Ye +9Efficient Multimodal InferenceTransformer