Visual Token Merging
Overview
Visual token merging studies how to combine redundant image patches or video-frame tokens so vision and multimodal models use less computation, memory, and context. Common approaches pair similar tokens, rank them by attention or salience, and use spatial or temporal structure to guide merging; many methods work without retraining, while others learn adaptive budgets or combine pruning with merging. Applications include image classification, segmentation, document retrieval, video understanding, image generation, and robotic control. The central challenge is preserving small objects, boundaries, positions, and query-relevant evidence while achieving real speedups, which can vary across tasks, model architectures, and hardware.
Latest papers
37 papers3 papers in the last four weeks, down 62% on the four weeks before. 0.0% of all new papers.