Overview

Visual token pruning studies how to remove or merge image and video patches before or inside vision transformers and vision-language models, reducing computation and memory for tasks such as visual question answering, video understanding, document reading, and robot control. Methods use attention or text-query relevance, feature diversity and spatial coverage, and signals such as entropy, spectral structure, or geometry; learned selectors and adaptive budgets choose different tokens or compression rates for different inputs. Pruning can happen before visual encoding, across language-model layers, or during video processing, and is evaluated on both task benchmarks and practical measures such as prefill latency, FLOPs, and memory. The central tension is that a token that seems redundant early may become important for later reasoning, while selection overhead and hardware execution can prevent fewer tokens from yielding faster end-to-end inference.

Latest papers

CardsList

298 papers23 papers in the last four weeks, down 48% on the four weeks before. 0.2% of all new papers.

  1. LoopZip: Visual Token Compression for Efficient Looped Vision-Language Models

    Nov 17, 2026Weizhong Huang, Zhicheng Liu, Yan Zhang +3Efficient VLM InferenceVisual Token Compression

  2. Disagree to Prune: Reallocating Visual Tokens Where a Small VLM Dissents

    Nov 17, 2026Yanchao Li, Jiaqing Xie, Ben Gao +7Visual Token PruningLVLM Pruning

  3. POKE: Probe Offline, Keep Efficiently for Vision-Language-Action Models

    Nov 16, 2026Jaehyuk Lee, Yeajin Lee, Suhyun Bae +1Efficient VLA Model InferenceVisual Token Pruning

  4. How Reliable Is Visual Token Selection? Rethinking Pruning in Multimodal LLMs

    Nov 16, 2026Chaehee Song, Seokil Ham, KiHyun Seol +3Visual Token PruningLVLM Pruning

  5. TIVS: Mapping the Sensitivity Landscape of Visual Token Transformations in MLLMs

    Nov 15, 2026Yikang Qiao, Jianye Zeng, Duan Huang +1Multimodal Large Language ModelsVisual Evidence Sensitivity in VLMs

  6. DiFiT: Distribution-Fidelity-guided Visual Token Pruning for Multimodal Large Language Models

    Nov 11, 2026Jingyuan Zhang, Nihao Niu, Xinyang Lv +4Visual Token PruningLVLM Pruning

  7. APS-VLA: Action-Guided and Future-Aware Token Pruning for Efficient Vision-Language-Action Models

    Nov 9, 2026Xiaoyang Xing, Chun-Mei Feng, Anthony Cohn +2Efficient VLA Model InferenceVisual Token Pruning

  8. ActPrune: Action-Grounded Visual Token Pruning for Efficient Vision-Language-Action Models

    Nov 6, 2026Sungwon Moon, Minji Kim, Hyemin Boo +2Efficient VLA Model InferenceVisual Token Pruning

  9. T3R: Training-Free Two-Stage Token Refinement Towards Efficient and Robust VLA Models

    Nov 5, 2026Mohammed Hassan, Zhenyang Chen, Zheng Wang +5Efficient VLA Model InferenceVisual Token Pruning

  10. Visual Token Routing: Learning to keep tokens that matter

    Nov 4, 2026Pranjal Aggarwal, Sean WelleckVisual Token PruningVisual Token Compression

  11. RI-Prune: Relation and Information Aware Visual Token Pruning for Multi-Image Vision-Language Models

    Nov 4, 2026Dongjin Lee, Eunju Lee, Jinhee Jang +2Visual Token PruningLVLM Pruning

  12. BtsPruner: Role-Aware Visual Token Pruning for Large Vision-Language Models

    Nov 3, 2026Zihao Qi, Zhibo Zhang, Miaoxin Zhang +2Visual Token PruningLVLM Pruning

  13. SVD-Prune: Spectral Vision Token Pruning under Extreme Compression

    Nov 1, 2026Yvon Apedo, Martyna Poreba, Michal Szczepanski +1Visual Token PruningLVLM Pruning

  14. SIEVE: Preserving Cross-Image Evidence via Depth-Aware Token Compression

    Oct 30, 2026Nitish Shukla, Surgan Jandial, Nhat-Tan Bui +1Efficient VLM InferenceVisual Token Compression

  15. Don't Ask the LLM: Visual Token Pruning with Spectral Structure and Semantic Relevance

    Oct 28, 2026Intaek Shin, Geuntaek Lim, Sungjune Park +1Visual Token PruningEfficient VLM Inference

  16. ConvRoute-ViT: Convolutional Token Routing for Efficient Vision Transformers

    Oct 28, 2026Manish Das, Shiv Ram Dubey, Satish Kumar SinghVision TransformerEfficient ViTs

  17. LearnPrunerV2: Learnable Progressive Token Pruning for Vision-Language Models

    Oct 27, 2026Rinyoichi Takezoe, Yaqian Li, Weiren Wang +6Visual Token PruningLVLM Pruning

  18. TP-JSCC: Efficient Token Pruning and Joint Source-Channel Coding for LVLMs-based 3D-VQA in Cloud-Edge Collaboration

    Oct 26, 2026Zhengxin Li, Chongzhen Tian, Hui Yuan +2Visual Token Compression3D Visual Question Answering

  19. TRIAGE: Efficient Vision-Language-Action Inference Needs Both Reuse and Pruning

    Oct 25, 2026Sooyoung Kwon, Carlee Joe-Wong, Kyunghan LeeEfficient VLA Model InferenceVisual Token Pruning

  20. Rescuing Your Pruning: Rethinking Visual Token Pruning and Post-Training Recovery in MLLMs

    Oct 24, 2026Peiran Yin, Hao Wu, Zihao Yang +3Visual Token PruningEfficient VLM Inference

  21. Vision Token Pruning via Query-Vision Interaction Decomposition

    Oct 23, 2026Harshithanjani Athi, Sravan Kumar Ankireddy, Jianzhong Charlie Zhang +1Efficient VLM InferenceVisual Token Pruning

  22. Visual Sufficiency Landscapes: Understanding Query-Conditioned Reliability in Visual Token Pruning

    Oct 18, 2026Zhenghan Li, Kexin Sun, Wei Zheng +3Visual Token PruningLVLM Pruning

  23. Are We Evaluating VLM Token Pruning Right? Looking Beyond Accuracy and Token Count

    Oct 17, 2026Geng Li, Guohao Chen, Shilin Shan +1Visual Token PruningVLM Evaluation