Hybrid CNN-Transformer Architectures

Overview

These architectures pair CNNs, which capture local patterns efficiently, with Transformers that model long-range relationships. Common designs use parallel CNN and ViT or Swin branches, Transformer bottlenecks in U-Nets, and gated or cross-attention fusion; some apply lightweight or linear attention to reduce computation. They are used for tasks such as medical-image segmentation, remote-sensing classification, object detection, and physiological-signal analysis, with performance measured on task-specific benchmarks and sometimes across unseen domains. The central tension is whether global context improves accuracy enough to justify added cost: gains are not universal, and well-tuned CNNs can match or outperform hybrids, especially on limited or shifted data.

Latest papers

CardsList

123 papers5 papers in the last four weeks, down 17% on the four weeks before. 0.0% of all new papers.

  1. ENACT-Heart -- ENsemble-based Assessment Using CNN and Transformer on Heart Sounds

    Feb 24, 2025Jiho Han, Adnan ShaoutHeart Sound ClassificationAudio Classification

  2. Cascaded Multi-Scale Attention for Enhanced Multi-Scale Feature Extraction and Interaction with Low-Resolution Images

    Dec 3, 2024Xiangyong Lu, Masanori Suganuma, Takayuki OkataniHybrid CNN-Transformer ArchitecturesObject Pose Estimation

  3. Explainable Convolutional Neural Networks for Retinal Fundus Classification and Cutting-Edge Segmentation Models for Retinal Blood Vessels from Fundus Images

    May 12, 2024Fatema Tuj Johora Faria, Mukaffi Bin Moin, Pronay Debnath +2Explainable Medical Image AnalysisRetinal Vessel Segmentation