Efficient ViTs

ViT: Vision Transformer

Ask about this topic

Momentum

20 papers in the last four weeks, up 300% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 152

All topics
CardsList

  1. One Block, Multiple Depths: Recurrent Vision Transformers with Depth-Programmed Experts

    Oct 8, 2026Adrian Bulat, Yassine Ouali, Georgios TzimiropoulosEfficient ViTsMixture of Experts

    Samsung AI Cambridge · Technical University of Iasi · Queen Mary University of London

  2. SV-TAD: Native Sparse Convs for Efficient Temporal Action Detection

    Oct 8, 2026Ricardo Pizarro, Roberto Valle, José M. Buenaposada +2Temporal Action DetectionEfficient ViTs

    Universidad de Alcal´a, Alcal´a de Henares, Spain · Universidad Polit´ecnica de Madrid, Madrid, Spain · Universidad Rey Juan Carlos, M´ostoles, Spain

  3. Dissecting Representation Structure in Vision Transformers: A Rigorous Architectural Study

    Oct 8, 2026Kim-Cuc Nguyen, Ngai-Man CheungVision TransformerNeural Network Generalization

    Temasek Laboratories Singapore University of Technology and Design Singapore

  4. Hardware-aware Calibrated Clustered Attention for Efficient Visual Geometric Transformers

    Oct 7, 2026Weitian Wang, Shubham Rai, Cecilia De La Parra +1Efficient ViTsAttention Mechanisms

    Robert Bosch GmbH, Germany · Ruhr University Bochum, Germany

  5. Later Is Better: Token Reduction for ViTs Under Distribution Shift

    Oct 6, 2026Hyeongheon Cha, Hyungjun Yoon, Sung-Ju LeeDistribution Shift RobustnessToken Pruning

    KAIST

  6. VASC: Value-Aware Sparse Attention with Cross-Layer Memory for Efficient 3D Reconstruction

    Oct 1, 2026Junyi Wu, Fanqing Kong, Leyang Chen +23D ViTs3D Reconstruction

    Shanghai Jiao Tong University

  7. Pixel-Level Transformers in Remote Sensing: A Canopy Height Case Study

    Sep 29, 2026Sven Ligensa, Jan Pauls, Karsten Schrödter +2Remote Sensing Image UnderstandingRemote Sensing

    University of Münster Münster, Germany · Laboratoire des Sciences du Climat et de l’Environnement Paris, France

  8. EviViT: Evidence-Adaptive Vision Transformers for Fine-Grained Perception

    Sep 29, 2026Yaoxin Niu, Zhangquan Chen, Yang Zhang +5VLM AdaptationEfficient ViTs

    Tsinghua University · Peng Cheng Laboratory · The Hong Kong University of Science and Technology +3

  9. Copy the Same, Distill the Difference: Initializing Linear Vision Transformers

    Sep 28, 2026Huaiyuan Qin, Muli Yang, Gabriel James Goenawan +9Neural Network InitializationVision Transformer

    Institute of Advanced Intelligence and Computing (IAIC), A*STAR, Singapore · Nanyang Technological University · ST Engineering Geo-Insights, Singapore +3

  10. ReSS: Residual-Restoring Sparse Attention for 3D Vision Transformers

    Sep 28, 2026Yongsung Kim, Jaehoon Lee, Minjun Park +33D ViTsEfficient ViTs

    IPAI, 2ECE, 3AIIS, ASRI, INMC, ISRC Seoul National University · ECE Seoul National University · AIIS Seoul National University

  11. DORA: Dynamic Online Reinforcement Agent for Token Pruning in Vision Transformers

    Sep 28, 2026Kaixuan He, Song Chen, Yi KangVision TransformerEfficient ViTs

    University of Science and Technology of China, Hefei, China · Institute of Artificial Intelligence, Hefei Comprehensive National Science Center, Hefei, China

  12. TT-VidT: Decoupling the Temporal Axis for Efficient Motion-Centric Video Pretraining

    Sep 27, 2026Shih-Ying Yeh, Daniel Z. Kaplan, Xuehai Wang +3Efficient ViTsVideo Representation Learning

    National Tsing Hua University · Comfy Org Research · Karolinska Institutet +2

  13. LoopTrack: A Simple Baseline for Parameter-Efficient Transformer Tracking

    Sep 27, 2026Liang Peng, Chenxiao Li, Libo Zhang +2Visual Object TrackingRecurrent Transformers

    School of Computer Science, National Engineering Research Center for Multimedia Software, Institute of Artificial Intelligence, Hubei Key Laboratory of Multimedia and Network Communication Engineering, Wuhan University · University of North Texas · Institute of Software, Chinese Academy of Sciences

  14. IronViT: Toward Efficient Generalist Visual Representation Learning

    Sep 24, 2026Jiaxi Huang, Yueqi Hu, Xin Zhu +13Visual Representation LearningEfficient ViTs

    Robotics Foundation Model Team, Xpeng Inc.

  15. Less is More: Encoder-only Audio-Visual Segmentation

    Sep 24, 2026Ilpo Viertola, Vladimir Iashin, Sophie Tötterström +1Audio-Visual UnderstandingEfficient ViTs

    Tampere University

  16. Task-Induced Riemannian Metrics for Vision Transformer Feature Spaces

    Sep 23, 2026Andrew Bond, Ege Erdem Özlü, Tuna Çimen +4Vision TransformerGeometric Representation Learning

    Imperial College London London, UK · Hacettepe University Ankara, Türkiye

  17. GTR: Gated Token Recurrence for Efficient Dense Prediction

    Sep 22, 2026Zhe Feng, Longfei Liu, Wei Liu +7Efficient Neural Network InferenceGated Attention

    Didi International Business Group · Intellindust AI Lab · Institute of Automation, Chinese Academy of Sciences +2

  18. LiAuto-MindViT: A Hybrid Vision Backbone with Adaptive Bidirectional Mamba

    Sep 21, 2026Lifu Mu, Shuai Chen, Wen Zheng +7Hybrid CNN-Transformer ArchitecturesVisual SSMs

    Li Auto Inc. · University of Science and Technology of China

  19. VGGT-Prime: Compute-Adaptive Mixture-of-Heads for Efficient Visual Geometry Transformers

    Sep 20, 2026Abteen Arab, Guile Wu, Chengjie Huang +13D ViTsMulti-View 3D Reconstruction

    Huawei Noah’s Ark Lab · University of British Columbia

  20. Rethinking Vision Architectures with Gated Linear Attention and KAN

    Sep 18, 2026Ali Mehizel, Oussama KhaldiVisual Representation LearningVision Transformer

    Department of Applied Statistics, ENSSEA, Kolea, Tipaza, Algeria

  21. A Smaller Transformer in Your Transformer

    Sep 17, 2026Dhananjay Tomar, Marius Aasan, Andreas Kleppe +1Transformer InferenceVision Transformer

    Institute for Cancer Genetics and Informatics Oslo University Hospital Oslo, Norway · Department of Informatics University of Oslo Oslo, Norway · SFI Visual Intelligence UiT The Arctic University of Norway Tromsø, Norway

  22. Vision Transformer-Based Multi-Level Feature Fusion for Multi-Label Sewer Defect Classification

    Sep 11, 2026Xu Fang, Zhuoran Wang, Qing Li +4Vision TransformerMulti-Scale Feature Fusion

    Shenzhen Polytechnic University, Shenzhen, China. · City University of Hong Kong, Hong Kong, China. · Pengcheng Laboratory, Shenzhen, China. +1

  23. FreeFlow: A Bias-free Hierarchical Transformer for Optical Flow Estimation

    Sep 11, 2026Vladislav Bargatin, Alexander Yakovenko, Khaled Abud +1Optical FlowVision Transformer

    AI Center, Lomonosov MSU, Moscow, Russia · Lomonosov Moscow State University, Moscow, Russia · MSU Institute for Artificial Intelligence, Moscow, Russia

  24. CLFTv2: Efficient Camera-LiDAR Fusion for Semantic Segmentation via Hierarchical Feature Pyramids

    Sep 9, 2026Toomas Tahves, Mauro Bellone, Raivo SellCamera-LiDAR FusionAutonomous Driving Perception

    Department of Mechanical and Industrial Engineering, Tallinn University of Technology, Tallinn, Estonia · FinEst Centre for Smart Cities, Tallinn University of Technology, Tallinn, Estonia · Universitas Mercatorum, Rome, Italy

  25. Mind the Approximation: Fisher-Weighted SVD Compression for ViTs

    Sep 7, 2026Moritz Thoma, Maximilian Groezinger, Maximilian Forstenhäusler +7Efficient ViTsLow-Rank Compression

    Technical University of Munich, DE · BMW Group, DE · University of Glasgow, GB +1

  26. ProgResViT: Progressive Resolution and Width for Adaptive Vision Transformers

    Sep 2, 2026Ali Hojjat, Janek Haberer, Olaf LandsiedelVision TransformerEfficient ViTs

    1Kiel University, Germany · 2Hamburg University of Technology (TUHH), Germany · 3UNU-INWEH, Germany

  27. Swin Meets EfficientNet: Lightweight Architectures for GAN-Based Face Forensics

    Sep 1, 2026Sejuti Basu, Ashima Sood, Vijay Kumar +1Hybrid CNN-Transformer ArchitecturesEfficient ViTs

    International Institute of Information Technology, Bangalore, India · School of Computing, Engineering, and Intelligent Systems, Ulster University, Londonderry, United Kingdom · Department of Information Technology, Dr B R Ambedkar National Institute of Technology Jalandhar, Punjab, India

  28. UniCon-Former: Unified Convolution Transformer is All You Need for Hand Gesture Recognition

    Aug 13, 2026Mallika Garg, Debashis Ghosh, Pyari Mohan PradhanHybrid CNN-Transformer ArchitecturesEfficient ViTs

    Indian Institute of Technology Kharagpur, INDIA · Indian Institute of Technology Roorkee, INDIA

  29. MergeOver: Post-Training Token Merging for Recursive Vision Transformers

    Aug 13, 2026Junseo Kim, Uraz Odyurt, Amirreza YousefzadehVision TransformerEfficient ViTs

    Computer Architecture for Embedded Systems, University of Twente Enschede, The Netherlands

  30. Putting Registers to Work: Task Registers for Token Pruning in Vision Transformers

    Aug 11, 2026Hongsen Cao, Mona Jaber, Shanxin Yuan +1Token PruningEfficient ViTs

    School of Electronic Engineering and Computer Science Queen Mary University of London London, United Kingdom