Hybrid Transformer

Latest papers 33

All topics
CardsList
  1. Learning Rate Transfer for Hybrid Transformer-SSM Architectures

    Oct 1, 2026Jimin Seo, Gyubok Lee, Yeonsik Jo +11Hybrid TransformerTransformer Architectures

  2. Cropland PAtteRNS: Parallel Dimensional Attention Networks and Attention to Dataset Disparity for Crop Segmentation in Satellite Imagery Time Series Data

    Sep 29, 2026Joseph Metcalfe, Sara Sharifzadeh, Fabio CaraffiniHybrid TransformerSatellite Imagery

  3. A Hybrid CNN--State-Space--Attention Backbone with Joint-Embedding Predictive Pretraining for 12-Lead ECG Classification

    Sep 24, 2026Yakoub Bazi, Sarah Aljuhani, Mohamad M. Al Rahhal +2Electrocardiogram ClassificationVideo Joint Embedding Predictive Architecture

  4. FreqCondNorm: Towards Cross-domain Predictive Maintenance through a Frequency-Conditioned Transformer Foundation Model

    Sep 17, 2026Zaynab Raounak, Camille LHermine, Zhiguo ZengPredictive MaintenanceHybrid Transformer

  5. Sub-6 GHz Over-the-Air AMC via Curriculum Fine-Tuned CNN-Transformers

    Sep 7, 2026Nurettin Safak, Muhammet Sefa Demirel, Alperen Marasli +3Reconfigurable Intelligent SurfacesHybrid Transformer

  6. Seasonality-Aware Hybrid Convolutional Transformer for Antarctic Sea Ice Concentration Forecasting

    Aug 31, 2026Danyang Li, John Taylor, Thang Bui +1Forecasting BackboneHybrid Transformer

  7. State of Health Estimation using Convolutional and Bidirectional LSTM Neural Networks tuned by Bayesian Optimization

    Aug 31, 2026Panagiotis Eleftheriadis, Foivos Georgios Kyrgios, Sonia LevaCnn-LstmBidirectional Long Short-Term Memory

  8. Federated Multi-Task Learning for Bladder Tumor Segmentation and MIBC Classification Using a Hybrid CNN-Transformer Architecture

    Aug 31, 2026Malhar Udmale, Divyanshu Dwivedi, Aarohi Dhand +3Tumor SegmentationHybrid Transformer

  9. A Multidimensional Data-Driven Hybrid Transformer Framework for Non-invasive Continuous Blood Pressure Prediction

    Aug 24, 2026Yuexin Ma, Jingqi Hou, Yuxuan Kang +1Cuffless Blood Pressure EstimationCardiovascular Risk Prediction

  10. CRHT: A Continuous Regression Hybrid Transformer for Vessel Trajectory Prediction with Online Cluster Sampling

    Aug 10, 2026Alexander Schiøtz, Bertram Hage, Christian Rand +2Maritime NavigationHybrid Transformer

  11. Dual Attention Heads for Personalized Federated Learning in ECG Classification

    Jul 7, 2026Kien Le, Joseph Lindley, Quoc Bao Phan +1Electrocardiogram ClassificationFederated Learning

  12. Morphing into Hybrid Attention Models

    Jun 29, 2026Disen Lan, Jianbin Zheng, Yuxi Ren +5Hybrid TransformerTransformer Attention

  13. HTC-SGA Former: A Hybrid Transformer-CNN Network with Self-Guided Attention and a New Boundary-Weighted Adaptive Loss for Coronary DSA Vessel Segmentation

    Jun 29, 2026Rayan Merghani Ahmed, Marwa Omer Mohammed Omer, Mohamed Elmanna +3Coronary AngiographyHybrid Transformer

  14. Parameter Efficient Hybrid Transformer (PEHT) for Network Traffic Prediction via Dynamic Urban Congestion Integration

    Jun 26, 2026Abdolazim Rezaei, Mehdi Sookhak, Mahboobeh HaghparastAccurate Traffic ForecastingHybrid Transformer

  15. HybridCodec: Modeling Discrete and Continuous Representations for Efficient Speech Language Models

    Jun 26, 2026Artem Ploujnikov, Francesco Verdini, Samir Sadok +1Discrete Speech RepresentationsHybrid Transformer

  16. SubdivAR: Autoregressive Next-Scale Prediction for Neural Mesh Subdivision

    Jun 25, 2026Huipeng Guo, Zikai Song, Hang Long +7Mesh GenerationMeshes

  17. SwitchBraidNet: Quantisation-Aware Lightweight Architecture for Hybrid Brain-Computer Interface

    Jun 17, 2026Gourav Siddhad, Yogesh Kumar MeenaBrain-Computer InterfaceElectroencephalography

  18. Long-Context Modeling via GSS-Transformer Hybrid Architecture with Learnable Mixing

    Jun 15, 2026Kuzey Torlak, Hüseyin Arda Arslan, Anıl Dervişoğlu +2Efficient Long-Context InferenceHybrid Transformer

  19. Binary Black Hole Parameter Estimation with Hybrid CNN-Transformer Neural Networks

    Jun 11, 2026Panagiotis N. Sakellariou, Spiros V. Georgakopoulos, Sotiris Tasoulis +1Gravitational WavesGeneral Relativity

  20. SpikeWFM: Spiking-Aided Wireless Foundation Model for Robust Channel Prediction

    May 28, 2026Liwen Jing, Yisha Lu, Tingting Yang +5Spiking Neural NetworksHybrid Transformer

  21. Benchmarking Convolutional, Transformer, Hybrid, and Vision Language Models for Multi Disease Retinal Screening

    May 25, 2026Durjoy Dey, Aymane Ajbar, Yuhong YanMedical Vision-Language ModelsGlaucoma Detection

  22. A Lightweight Hybrid Transformer-CRF Architecture for Multi-Type Bangla Medical Entity Recognition

    May 25, 2026Peyal Saha, Ahsanul Haque Hasib, Shoumik Barman PolokMedical OntologyBert-Based Models

  23. Learned Suppression for 3D Keypoint Detection with a Graph-Transformer Backbone

    May 14, 2026Batuhan Arda Bekar, Can Sarı, Hüseyin Can Gülkan +1Light Detection And Ranging Point CloudsPoint Clouds

  24. Private Vertical Federated Inference for Time-Series

    May 8, 2026Lucas Fenaux, Larris Xie, Aditya Bang +3Federated LearningHybrid Transformer

  25. Lightweight Cross-Spectral Face Recognition via Contrastive Alignment and Distillation

    May 6, 2026Anjith George, Sebastien MarcelFace Recognition ModelHybrid Transformer

  26. Domain-Adaptive Arrhythmia Classification Using a Hybrid Transformer on Wearable Heart Signals

    May 5, 2026Maedeh H. Toosi, Siamak MohammadiArrhythmia ClassificationHeart Rate

  27. Edge-Efficient Image Restoration: Transformer Distillation into State-Space Models

    May 4, 2026Srinivas Soumitri Miriyala, Sowmya Vajrala, Sravanth Kodavanti +2Image RestorationHybrid Transformer

  28. HyMaTE: A Hybrid Mamba and Transformer Model for EHR Representation Learning

    Sep 28, 2025Md Mozaharul Mottalib, Thao-Ly T. Phan, Rahmatollah BeheshtiMedical World ModelHybrid Transformer

  29. BiHDTrans: binary hyperdimensional transformer for efficient multivariate time series classification

    Date pendingJingtao Zhang, Yi Liu, Qi Shen +1Hybrid TransformerTime-Series Classification