Hybrid CNN-Transformer Architectures

Overview

These architectures pair CNNs, which capture local patterns efficiently, with Transformers that model long-range relationships. Common designs use parallel CNN and ViT or Swin branches, Transformer bottlenecks in U-Nets, and gated or cross-attention fusion; some apply lightweight or linear attention to reduce computation. They are used for tasks such as medical-image segmentation, remote-sensing classification, object detection, and physiological-signal analysis, with performance measured on task-specific benchmarks and sometimes across unseen domains. The central tension is whether global context improves accuracy enough to justify added cost: gains are not universal, and well-tuned CNNs can match or outperform hybrids, especially on limited or shifted data.

Latest papers

CardsList

123 papers5 papers in the last four weeks, down 17% on the four weeks before. 0.0% of all new papers.

  1. Fusing Multimodal CNN Features with Structurally-Masked Transformers for Hierarchical Sub-Pixel Tree Species Mapping

    Nov 19, 2026Mattia Ferrari, Lorenzo BruzzoneTree Species ClassificationForest Remote Sensing

  2. RespCCT and FreqCCT: Compact, Explainable and Cost-Aware Convolutional Transformers for Multi-Class Respiratory Disease Classification

    Nov 18, 2026Auntor Chakma, Mst. Farhana Akter, Abu Henaf Rashid Ahmad Mufti +1Respiratory Sound ClassificationHybrid CNN-Transformer Architectures

  3. LeViT-UNet++: Towards Balanced Fine-Grained Details and Context for Efficient Medical Image Segmentation

    Nov 17, 2026Guoping Xu, Jinling Zhu, Liuyue LiMedical Image Segmentation3D Medical Image Segmentation

  4. Improved CNN-Transformer Network for Neutron Image Super-Resolution

    Nov 12, 2026Yuheng Chu, Hongli Li, Tian ZhangImage Super-ResolutionHybrid CNN-Transformer Architectures

  5. ACSAN: All-Convolutional Self-Attention Network Integrating Convolutional Operations with Vision Transformer

    Oct 26, 2026Zimian Wei, Tianqi Zhang, Hengyue PanHybrid CNN-Transformer ArchitecturesEfficient ViTs

  6. Enhancing Cross-Grade Generalization in Banana Variety Classification via Hybrid CNN-Transformers and Knowledge Self-Distillation

    Oct 21, 2026Khush Kataruka, Mohammad Muzammila, Zahid Akhtar +2ClassificationCross-Domain Generalization

  7. HybridDualPathNet: Cross-Fusion Attention of EfficientNetV2 and Swin Transformer for Brain MRI Classification of Alzheimer's and Parkinson's Disease

    Oct 12, 2026Jarpula Nirjala, Rahul PatelParkinson's Disease ClassificationMedical Image Classification

  8. Why Convolution Still Matters: Evaluating Inductive Biases in Cryospheric Image Classification

    Oct 2, 2026Chhaya Kulkarni, Emam HossainConvolutional Neural NetworksRemote Sensing Image Understanding

  9. Cropland PAtteRNS: Parallel Dimensional Attention Networks and Attention to Dataset Disparity for Crop Segmentation in Satellite Imagery Time Series Data

    Sep 29, 2026Joseph Metcalfe, Sara Sharifzadeh, Fabio CaraffiniRemote Sensing Image SegmentationAgricultural Remote Sensing

  10. Lightweight Vision Transformer-Based U-Net for Brain Tumor Segmentation from MRI

    Sep 24, 2026Sheekar Banerjee, Md. Srabon Chowdhury, Md. Mahbub Hasan Akash +1Hybrid CNN-Transformer ArchitecturesVision Transformer

  11. LiAuto-MindViT: A Hybrid Vision Backbone with Adaptive Bidirectional Mamba

    Sep 21, 2026Lifu Mu, Shuai Chen, Wen Zheng +7Hybrid CNN-Transformer ArchitecturesVisual SSMs

  12. MECT: Mixture of Experts with CNN-Transformer Network for Speaker verification

    Sep 21, 2026Yu Zheng, Jinghan Peng, ChangHao Zhang +2Speaker VerificationHybrid CNN-Transformer Architectures

  13. CoAtNet-DeepMoE: A Convolution-Attention Hybrid with DeepSeek Mixture-of-Experts for Parameter-Efficient Tomato Disease Classification

    Sep 16, 2026Md Nadim Mahamood, Md Arif Shahriar, Md Shafi Ud Doula +1Plant Disease ClassificationHybrid CNN-Transformer Architectures

  14. WaVeFuse: Regime-Adaptive Equity Index Forecasting via Channel-Wise Wavelet Denoising and Vertical Attention Fusion

    Sep 13, 2026Aashish Bohra, Vivek VijayTime Series ForecastingFinancial Time Series

  15. Schizophrenia Detection from EEG Signals: A Transformer Framework with Spectrogram Representation

    Sep 12, 2026Abtin Shafiei, Mohsen Hooshmand, Majid RamezaniElectroencephalographyHybrid CNN-Transformer Architectures

  16. TriCCOT: Tri-part Convolutional Conformal Transformer for Onboard Space Object Detection

    Sep 8, 2026Adrien Dorise, Marjorie Bellizzi, Julia Cohen +1Hybrid CNN-Transformer ArchitecturesObject Detection

  17. FreeTransformSR: Efficient Lightweight Image Super-Resolution via Free Low-Rank Learnable Transform

    Sep 5, 2026Hongji Li, Yunhui Li, Jianing Wang +1Hybrid CNN-Transformer ArchitecturesImage Super-Resolution

  18. What Does the Encoder Actually Decide? A Controlled Comparison of Vision Backbones on Joint Tree Segmentation and Stereo Depth

    Sep 2, 2026Yida Lin, Bing Xue, Mengjie Zhang +2Stereo Depth EstimationImage Segmentation

  19. Swin Meets EfficientNet: Lightweight Architectures for GAN-Based Face Forensics

    Sep 1, 2026Sejuti Basu, Ashima Sood, Vijay Kumar +1Hybrid CNN-Transformer ArchitecturesEfficient ViTs

  20. U-PAST: A Phase-Aware Audio Spectrogram Transformer-U-Net for Single-Channel Speech Enhancement

    Aug 31, 2026Cao Duong Ly, Jörn AnemüllerHybrid CNN-Transformer ArchitecturesSpeech Enhancement

  21. Seasonality-Aware Hybrid Convolutional Transformer for Antarctic Sea Ice Concentration Forecasting

    Aug 31, 2026Danyang Li, John Taylor, Thang Bui +1Hybrid CNN-Transformer ArchitecturesTime Series Forecasting

  22. Federated Multi-Task Learning for Bladder Tumor Segmentation and MIBC Classification Using a Hybrid CNN-Transformer Architecture

    Aug 31, 2026Malhar Udmale, Divyanshu Dwivedi, Aarohi Dhand +3Hybrid CNN-Transformer ArchitecturesMulti-Task Learning

  23. MCSeg: Pre-training and Fine-tuning Volumetric Pyramid Transformer for Multi-modal Cardiac Image Segmentation

    Aug 31, 2026Zhiyu Ye, Hairong Zheng, Tong ZhangCross-Modality Medical Image SegmentationHybrid CNN-Transformer Architectures

  24. Robust Lightweight Deep Learning Models for Oral Cancer Screening

    Aug 21, 2026Siddhant Bharadwaj, Aakash Shedsale, Tejashree Subramanya +6Medical Image ClassificationLightweight CNNs

  25. When Simplicity Wins: Bottleneck-Aware Context Modeling for Lightweight Semantic Segmentation

    Aug 19, 2026Mian Muhammad Naeem Abid, Nancy Mehta, Zongwei Wu +1Semantic SegmentationHybrid CNN-Transformer Architectures

  26. OptiModNet: A UNet-Transformer Hybrid with Grouped-Query and Channel Attention for Optic Disc and Cup Segmentation

    Aug 19, 2026Soumili Ghosh, Debapriya Roy, Aryan Das +1Optic Disc SegmentationOphthalmic Image Analysis