Overview

Visual token pruning studies how to remove or merge image and video patches before or inside vision transformers and vision-language models, reducing computation and memory for tasks such as visual question answering, video understanding, document reading, and robot control. Methods use attention or text-query relevance, feature diversity and spatial coverage, and signals such as entropy, spectral structure, or geometry; learned selectors and adaptive budgets choose different tokens or compression rates for different inputs. Pruning can happen before visual encoding, across language-model layers, or during video processing, and is evaluated on both task benchmarks and practical measures such as prefill latency, FLOPs, and memory. The central tension is that a token that seems redundant early may become important for later reasoning, while selection overhead and hardware execution can prevent fewer tokens from yielding faster end-to-end inference.

Latest papers

CardsList

298 papers23 papers in the last four weeks, down 48% on the four weeks before. 0.2% of all new papers.

  1. Fusion: A Framework for Unified Sequential Token AdaptatIon in VisiOn TraNsformers

    Jul 1, 2026Aravind Pradeep, Samira Nazari, Mahdi Taheri +1Token MergingEfficient ViTs

  2. ERA: Entropy-Guided Visual Token Pruning with Rectified Attention for Efficient MLLMs

    Jun 30, 2026Yuhao Wang, Mu Qiao, Haiwen Diao +5Efficient VLM InferenceMultimodal Large Language Models

  3. Attend, Transform, or Silence: Operator-Level Visual Skipping for Efficient Multimodal LLM Inference

    Jun 30, 2026Zhaoyang Luo, Runmin Dong, Miao Yang +4Efficient VLM InferenceMultimodal Large Language Models

  4. REDI: Corpus Aware Patch Ranking for DINOv3 Token Reduction

    Jun 30, 2026Chanjong Im, Sebastian Diem, Thomas MandlEfficient ViTsVisual Token Pruning

  5. Token-Sparse Medical Multimodal Reasoning via Dual-Stream Reinforcement Learning

    Jun 30, 2026Kaitao Chen, Weiqian Zhao, Jiamin Wu +6Efficient Multimodal InferenceMedical Visual Question Answering

  6. MVPruner: Dynamic Token Pruning for Accelerating Multi-view Vision-Language Models in Autonomous Driving

    Jun 26, 2026Nan Yang, Zhanwen Liu, Linfeng Zhang +4Vision-Language ModelsVLMs for Autonomous Driving

  7. TOPS: First-Principles Visual Token Pruning via Constructing Token Optimal Preservation Sets for Efficient MLLM Inference

    Jun 25, 2026Tinghao Wang, Yichen Guo, Rui Huang +9Efficient VLM InferenceMultimodal Large Language Models

  8. TaskTok: Delving into Task Tokens for Task-driven Image Restoration

    Jun 25, 2026Hongjae Lee, Sojung Kang, Jaeseong Yu +1Image RestorationVisual Token Pruning

  9. Spectral Evolution-Guided Token Pruning in Multimodal Large Language Models

    Jun 23, 2026Bin Chen, Yuxiang Cai, Yadan Luo +3Efficient Multimodal InferenceMultimodal Large Language Models

  10. Accelerating Multimodal Large Language Models with Prior-Corrected Token Reduction

    Jun 23, 2026Zengjie Chen, Yuxiang Cai, Jingcai Guo +3Efficient VLM InferenceMultimodal Large Language Models

  11. Spatial-Aware Reduction Framework: Towards Efficient and Faithful Visual State Space Models

    Jun 18, 2026Jindi Lv, Aoyu Li, Yuhao Zhou +6Visual SSMsVisual Token Pruning

  12. DCP-Prune: Ultra-Low Token Pruning with Distribution Consistency Preservation

    Jun 15, 2026Xifeng Xue, Xiaokang Wang, Zirui Li +2Efficient VLM InferenceVisual Token Pruning

  13. One Layer's Trash is Another Layer's Treasure: Adaptive Layer-wise Visual Token Selection in LVLMs

    Jun 12, 2026Yongru Chen, Kai Zhang, Zeliang Zong +4Efficient VLM InferenceLarge Vision-Language Models

  14. Reroute, Don't Remove: Recoverable Visual Token Routing for Vision-Language Models

    Jun 10, 2026Cheng-Yu Yang, Shao-Yuan Lo, Yu-Lun LiuEfficient VLM InferenceVisual Token Pruning

  15. AVIS: Adaptive Test-Time Scaling for Vision-Language Models

    Jun 10, 2026Ahmadreza Jeddi, Minh Ngoc Le, Amirhossein Kazerouni +8Visual Token PruningTest-Time Adaptation of VLMs

  16. Learnable Token Sparsification for Efficient Gigapixel Whole Slide Image Reasoning

    Jun 7, 2026Jingzhi Chen, Landi He, Zhuo Chen +2Efficient VLM InferenceMedical VLMs

  17. RAPID: Layer-Wise Redundancy-Aware Pruning and Importance-Driven Token Merging for Efficient ViT

    Jun 6, 2026Kyumin Choi, Ikbeom JangVision TransformerEfficient ViTs

  18. Adaptive Tokenisation Via Temporal Redundancy Masking And Latent Inpainting

    Jun 4, 2026Kevin Dave, Sai Aditya Patkuri, Chhaya Kumar Das +3Visual TokenizationVideo Token Compression

  19. When Attention Collapses: Stage-Aware Visual Token Pruning from Structure to Semantics

    Jun 2, 2026Jiahui Wang, Kai Zhang, Mai Han +1Vision-Language ModelsEfficient VLM Inference

  20. On the Limits of Token Reduction for Efficient Unified Vision Language Training

    May 31, 2026Siyi Chen, Weiming Zhuang, Jingtao Li +1Vision-Language ModelsUnified Multimodal Models

  21. Where to Refine, When to Stop: Rethinking Redundancy via Latent Discrepancy for Efficient Visual Autoregressive Generation

    May 29, 2026Changwang Mei, Peisong Wang, Zekun Li +7Efficient Neural Network InferenceVisual Autoregressive Models

  22. VisionPulse: Dynamic Visual Sparsity for Efficient Multimodal Reasoning

    May 29, 2026Hengbo Xu, Shengjie Jin, Yanbiao Ma +1Efficient Multimodal InferenceVisual Attention

  23. SAFE-Pruner: Semantic Attention-Guided Future-Aware Token Pruning for Efficient Vision-Language-Action Manipulation

    May 28, 2026Shilin Ma, Chubin Zhang, Changyuan Wang +6Efficient VLM InferenceRobotic Manipulation

  24. AsymVLM: Asymmetric Token Pruning for Efficient Vision-Language Model Inference

    May 28, 2026Yilin Feng, Ahmed Burak Gulhan, Mahmut Taylan KandemirLLM PruningVision-Language Models

  25. CIVIC: End-to-End Sequence Compactness for Efficient Vision-Language Models

    May 27, 2026Fengze Yang, Bo Yu, Xuewen Luo +2Efficient VLM InferenceKV-Cache Compression

  26. Beyond Surrogate Gradients: Fully Differentiable Token Pruning for Vision-Language Models

    May 27, 2026Landi He, Mingde Yao, Shawn Young +1Vision-Language ModelsEfficient VLM Inference

  27. Good Token Hunting: A Hitchhiker's Guide to Token Selection for Visual Geometry Transformers

    May 22, 2026Shuhong Zheng, Michael Oechsle, Erik Sandström +33D ViTsMulti-View 3D Reconstruction