Efficient ViTs

ViT: Vision Transformer

Ask about this topic

Momentum

20 papers in the last four weeks, up 300% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 152

All topics
CardsList

  1. Sparse Attention to Emotion: Efficient Facial Emotion Recognition via Token Reduction

    Aug 9, 2026Aya Manel Zitouni, Aicha Zenakhri, Karim Haroun +1Efficient ViTsFacial Expression Recognition

    LIASD Laboratory, University of Paris 8, France

  2. Circuit Fine-Tuning for Compute-Efficient Transformer Adaptation

    Aug 8, 2026Uri Z. Kialy, Gil Ben-ArtziFine-TuningVision Foundation Model Adaptation

    School of Computer Science, Ariel University, Israel

  3. AdaDINO: Pair-Aware In-Backbone Adaptation of Frozen DINO for Efficient Remote Sensing Change Detection

    Aug 8, 2026Xu Zhang, Xinqing Li, Jianpeng Xie +3Vision Foundation Model AdaptationRemote Sensing Change Detection

    VCIP, College of Computer Science, Nankai University · School of Computer Science and Engineering, Tianjin University of Technology · Academy for Advanced Interdisciplinary Studies, Nankai University +1

  4. HSMLA: Hierarchical Softmax Multi-scale Linear Attention for Efficient Vision Transformers

    Aug 7, 2026Dong Liu, Yanxuan Yu, Renata Borovica-Gajic +2Efficient ViTsLinear Attention

    University of California, Los Angeles, USA · Columbia University, USA · The University of Melbourne, Australia +1

  5. CoDAT: Collaborative Dual-Attention Transformer with Low-Cost Temporal Modeling for Efficient Edge Action Recognition

    Aug 7, 2026Novendra Setyawan, Chi-Chia Sun, Mao-Hsiu Hsu +3Edge InferenceEfficient ViTs

    Department of Electro-Optics, National Formosa University, Huwei 632301, Taiwan · Department of Electrical Engineering, University of Muhammadiyah Malang, Malang 65144, Indonesia · Department of Electronic and Computer Engineering, National Taiwan University of Science and Technology, Taipei 106335, Taiwan +1

  6. A Survey of Adversarial Efficiency Degradation for Vision Transformer by Exploiting Input-adaptive Optimization

    Aug 5, 2026Anadi Goyal, Nandish Chattopadhyay, Anupam Chattopadhyay +1Adversarial Patch AttacksAdversarial Attacks

    Indian Institute of Technology Guwahati, Guwahati 781039, Assam, India · Nanyang Technological University, 50 Nanyang Ave, Singapore 639798

  7. Attention-Only White-Box Transformer via LeJEPA-Based Self-Supervised Pretraining

    Aug 4, 2026Yang Bai, Linyuan Wang, Haoyang Jiang +3Vision TransformerEfficient ViTs

    Information Engineering University, ZhengZhou,China

  8. DeVIT: Low-Power Vision Transformer Acceleration Using Delta Computation

    Aug 2, 2026Reyhaneh Hosseinzadeh, Parham Zilouchian Moghaddam, Mehdi ModarressiEfficient ViTs

    School of Electrical and Computer Engineering, University College of Engineering, University of Tehran, Tehran, Iran

  9. Interpretability-Guided Soft Pruning of Attention Heads in Vision Transformers

    Jul 31, 2026Kamil Książek, Piotr Suszyński, Michał Jan Włodarczyk +2Transformer InterpretabilityAttention Head Analysis

    Centre for Credible Artificial Intelligence Warsaw University of Technology Warsaw, Poland · Faculty of Mathematics and Computer Science Jagiellonian University Krakow, Poland · University of Warsaw Warsaw, Poland

  10. MixFrag: Fragility-Guided Mixed-Precision Post-Training Quantization for Vision Transformers

    Jul 30, 2026Md. Mehrab Hossain Opi, Robiul Islam Ryad, Md. Umar FarukMixed-Precision QuantizationVision Transformer

    Department of Computer Science and Engineering Khulna University of Engineering & Technology (KUET) Khulna 9203, Bangladesh

  11. WHTMix: Efficient Stereo Depth Estimation via Walsh-Hadamard Token Mixing

    Jul 28, 2026Prathyush Sajith, Emadeldeen Hamdan, Ahmet Enis CetinDepth EstimationStereo Matching

    Dept. of Electrical and Computer Engineering, University of Illinois at Chicago Chicago, IL, USA

  12. UltraViT: Latency-Optimized On-device Vision Encoder for Large Vision-Language Models

    Jul 25, 2026Ioannis Maniadis Metaxas, Adrian Bulat, Alberto Baldrati +4Vision-Language ModelsEfficient VLM Inference

    Samsung AI Cambridge · Technical University of Iasi · Queen Mary University of London

  13. BMFA: Boundary-Minority Free-Energy Adaptive Screening

    Jul 20, 2026Wenyan Xu, Alizer WongSoftmax AttentionVision Transformer

    1Guangdong University of Technology · School of Computer Science, Peking University · 3ManXis

  14. Brain-Aligned Multi-Stream Video Transformers with Sparse Self-Selection

    Jul 20, 2026Amir Hosein Fadaei, Mahyar Maleki, Mohammad-Reza A. DehaqaniTransformerEfficient ViTs

    University of Tehran, Faculty of Electrical and Computer Engineering, North Kargar st., Tehran, 1439957131, Tehran, Iran

  15. Visible-Light Imaging Diagnosis of Neutral Particle Emission Tomography in the Tokamak Divertor: An Efficient Transformer-based Surrogate Model

    Jul 19, 2026Xiao Wang, Hao Si, Qiang Chen +8Neural Surrogate ModelingTransformer

    School of Computer Science and Technology, Anhui University, Hefei 230601, China. · Institute of Plasma Physics, Hefei Institutes of Physical Science, Chinese Academy of Sciences, Hefei 230031, China. · School of Artificial Intelligence, Anhui University, Hefei 230601, China.

  16. DPNeXt: A Lightweight Multi-Scale Feature Fusion Framework for Efficient ViT-Based Multi-Task Dense Prediction

    Jul 17, 2026Jehun Kang, Jungha Wang, Youngjun Hwang +1Multi-Task LearningMulti-Scale Feature Fusion

    School of Electrical Engineering, Korea Advanced Institute of Science and Technology (KAIST), Daejeon, South Korea

  17. Are All Tokens Necessary for Visual Place Recognition? An Empirical Study of Token Reduction for Efficient Inference

    Jul 17, 2026Tong Jin, Yunpeng Liu, Shuyu Hu +4Visual Place RecognitionEfficient ViTs

    Shenyang Institute of Automation, Chinese Academy of Sciences. · University of Chinese Academy of Sciences. · Shenzhen University of Advanced Technology.

  18. VideoSEMA: a scalable and efficient Mamba-like attention for video understanding

    Jul 16, 2026Nhat Thanh Tran, Fanghui Xue andShuai Zhang, Jiancheng Lyu +3Efficient ViTsEfficient Attention

    Department of Mathematics University of California, Irvine Irvine, USA · Qualcomm AI Research San Diego, USA

  19. CUST: Clustered Unit-level Similarity Transformer for Lightweight Image Super-Resolution

    Jul 13, 2026Jeongsoo KimVision TransformerEfficient ViTs

    Independent Researcher

  20. Edge Physical AI Deployment of Vision Transformers on Heterogeneous Edge GPU Targeting Autonomous Vehicles

    Jul 12, 2026Ashiyana Abdul Majeed, Mahmoud Meribout, Neethu Joseph +2Efficient Transformer InferenceEdge Inference

    Department of Computer and Information Engineering, Khalifa University, Abu Dhabi, UAE · Department of Electrical Engineering and Computer Science at the University of California, Irvine, CA 92697, USA

  21. Foveation-Guided Dynamic Token Selection for Robust and Efficient Vision Transformers

    Jul 10, 2026Ibrahim Batuhan Akkaya, Kishaan Jeeveswaran, Bahram Zonooz +1Image Corruption RobustnessEfficient ViTs

    Advanced Research Lab, NavInfo Europe, Eindhoven, 5657 DB, Netherlands · Department of Mathematics and Computer Science, Eindhoven University of Technology, Eindhoven, 5612 AZ, Netherlands

  22. Subtoken Vision Transformer for Fine-grained Recognition

    Jul 10, 2026Jie Zhu, Ivy Zhang, Minchul Kim +1Vision TransformerVisual Tokenization

    Michigan State University · Cranbrook Kingswood School · University of North Carolina at Chapel Hill

  23. Rethinking Depth Pruning for Vision Transformers: A Heterogeneity-Aware Perspective

    Jul 4, 2026Zhenfeng Su, Kang Zhao, Han Bao +4Vision TransformerEfficient ViTs

    School of Data Science, The Chinese University of Hong Kong, Shenzhen, China · Huawei Technologies Co., Ltd., Shenzhen, China · Tsinghua University, Beijing, China +1

  24. LBTCap: A Lightweight Bilateral Transformer for Real-Time Remote Sensing Image Change Captioning

    Jul 3, 2026Licheng Zhang, Siew-Kei Lam, Naveed AkhtarRemote Sensing Image UnderstandingImage Captioning

    School of Computing and Information Systems, The University of Melbourne, Melbourne, 3010, Victoria, Australia · Nanyang Technological University, Singapore · The University of Melbourne, Melbourne, 3010, Victoria, Australia

  25. Less Tokens, Better Forecasts: Sparse Residual Routing for Efficient Weather Prediction

    Jul 2, 2026Janet Wang, Yunbei Zhang, Lin Zhao +3Efficient ViTsDense Prediction

    Tulane University · Northeastern University · University of Alabama at Birmingham +1

  26. When Token Compression Breaks: Structural Pruning vs. Token Reduction for Robust ViT Segmentation under High Compression

    Jul 2, 2026Tien-Phat Nguyen, Ngai-Man CheungDistribution Shift RobustnessVision Transformer

    Temasek Laboratories, Singapore University of Technology and Design, Singapore

  27. Diversity-aware View Partitioning for Scalable VGGT

    Jul 2, 2026Jinsoo Park, Donggyu Choi, Ahyun Seo +23D ViTsMulti-View 3D Reconstruction

    POSTECH · GIST · KAIST +1

  28. Fusion: A Framework for Unified Sequential Token AdaptatIon in VisiOn TraNsformers

    Jul 1, 2026Aravind Pradeep, Samira Nazari, Mahdi Taheri +1Token MergingEfficient ViTs

    Brandenburg University of Technology Cottbus-Senftenberg, Germany · University of Zanjan, Iran · Humboldt University, Berlin, Germany +1

  29. SpiralFovea: Input-Adaptive Foveated Tokenization as a Third Lever of Resource-Adaptive Inference

    Jul 1, 2026Kyan Mahajan, Mohammad SaqlainImage TokenizationEfficient ViTs

    Indian Institute of Information Technology, Allahabad, Uttar Pradesh, India.

  30. Soft Mixture-of-Recursions: Going Deeper with Recursive Vision Transformers

    Jul 1, 2026Sang In Lee, Jihun ParkVision TransformerRecurrent Transformers

    Chungnam National University Daejeon, South Korea