Multi-Scale Attention

Ask about this topic

Overview

Multi-scale attention studies how models can combine fine-grained features with broader context across image regions, feature-pyramid levels, or time windows. Common approaches include hierarchical and window-based attention, cross-scale feature fusion, and efficient linear attention that allocates computation across resolutions. These methods are used in tasks such as object detection and segmentation on benchmarks like COCO and ADE20K, as well as time-series forecasting and sequence modeling. A central challenge is aligning useful information across scales while controlling computation, and gains must be tested across varied datasets and settings.

Latest papers

CardsList

39 papers7 papers in the last four weeks, up 133% on the four weeks before. 0.0% of all new papers.

  1. ACSAN: All-Convolutional Self-Attention Network Integrating Convolutional Operations with Vision Transformer

    Oct 26, 2026Zimian Wei, Tianqi Zhang, Hengyue PanHybrid CNN-Transformer ArchitecturesEfficient ViTs

    College of Computer Science and Technology, National University of Defense Technology, 109 Deya Road, Changsha, 410073, Hunan, China

  2. Cross-Scale Sparse Attention for Referring Segmentation in Remote Sensing

    Oct 24, 2026Yuxi Li, Lu Si, Xia Liao +4Referring Image SegmentationRemote Sensing Image Segmentation

    Westlake Institute for Advanced Study, Hangzhou, Zhejiang, China · School of Engineering, Westlake University, Hangzhou, Zhejiang, China · Beijing National Research Center for Information Science and Technology (BNRist), Tsinghua University, Beijing, China +2

  3. DST-Net: Decomposed Spatio-Temporal Network for Time Series Forecasting

    Oct 15, 2026Yaohua Zha, Hai Wu, Shu-Tao XiaTime Series ForecastingMultivariate Time Series Forecasting

    Pengcheng Laboratory · Tsinghua Shenzhen International Graduate School, Tsinghua University

  4. MIST: Multi-Scale Spatial Context for Gene Expression Prediction from Histology

    Oct 13, 2026Koushik Howlader, Tirtho Roy, Md Tauhidul Islam +1Spatial Context ModelingSpatial Gene Expression Prediction

    Iowa State University, Iowa, USA · Stanford University, CA, USA

  5. SANet: Selective Attention Network for Infrared Small Target Detection

    Oct 7, 2026Yingmei Zhang, Wangtao Bao, Qin Xiao +5Small Object DetectionInfrared Small Target Detection

    School of Software and Internet of Things Engineering, Jiangxi University of Finance and Economics, Nanchang 330032, China · School of Information Management and Mathematics, Jiangxi University of Finance and Economics, Nanchang 330032, China · School of Computer Science and Technology, Tiangong University, Tianjin 300387, China

  6. Self-attention summary networks for subsurface velocity-model building from common-image gathers

    Oct 7, 2026Shiqin Zeng, Yunlin Zeng, Abhinav Prakash Gahlot +2Seismic ImagingInverse Problems

    Georgia Institute of Technology

  7. No Scale Left Behind: Multi-Scale Autoencoder with Bi-directional Attention for Time Series Anomaly Detection

    Sep 29, 2026Jiaheng Guo, Haochen Zhang, Yu-Chao Huang +3Reconstruction-Based Anomaly DetectionAttention Mechanisms

    UNITES Lab, University of North Carolina at Chapel Hill

  8. MS-GLA: Multi-Scale Gated Linear Attention for Addressing Representational Bottlenecks via Multi-Temporal Resolution

    Sep 28, 2026Prasoon Dev, Anirudh Sankar, Vasudeva VarmaLong-Context Language ModelingGated Attention

    Language Technologies Research Center International Institute of Information Technology Hyderabad Hyderabad, Telangana, India

  9. Progressive Memory Transformer: Memory-Aware Attention for Time-Series

    Sep 25, 2026Tord Sture Stangeland, Andreas Köhler, Steffen Mæland +1Self-Supervised Time Series Representation LearningTemporal Representation Learning

    University of Oslo, Department of Informatics, Oslo, Norway · NORSAR, Lillestrøm, Norway · University of Tromsø, Department of Geosciences, Tromsø, Norway +1

  10. MSCA-UNet: Multi-Scale Context and Attention U-Net for Image Segmentation

    Sep 6, 2026Sheng-Wei ChanImage SegmentationU-Net

    Dept. of Electrical Engineering Tamkang University

  11. EMCStereo: Attention-Enhanced Stereo Matching for Thin-Structure Depth Estimation with a Synthetic Tree-Branch Benchmark

    Sep 2, 2026Yida Lin, Bing Xue, Mengjie Zhang +2Depth EstimationStereo Matching

    Centre for Data Science and Artificial Intelligence Victoria University of Wellington, Wellington, New Zealand · Department of Computer Science and Software Engineering University of Canterbury, Canterbury, New Zealand

  12. HSMLA: Hierarchical Softmax Multi-scale Linear Attention for Efficient Vision Transformers

    Aug 7, 2026Dong Liu, Yanxuan Yu, Renata Borovica-Gajic +2Efficient ViTsLinear Attention

    University of California, Los Angeles, USA · Columbia University, USA · The University of Melbourne, Australia +1

  13. Low-light Image Enhancement via Multi-scale Attention combined with Fourier Transform

    Jul 27, 2026Wenbin Du, Jian Long, Zhu CaoFrequency-Domain Feature LearningLow-Light Image Enhancement

    aKey Laboratory of Smart Manufacturing in Energy Chemical Process, Ministry of Education, East China University of Science and Technology, Shanghai, 200237, China · bCollege of Electronics and Information Engineering, Tongji University, Shanghai 201804, China · cShanghai Research Institute for Intelligent Autonomous Systems, Tongji University, Shanghai 201210, China

  14. Ms. Forcing: Efficient Streaming Video Generation with Multi-Scale Patchification and Attention

    Jul 23, 2026Zekun Li, Xiaoyan Cong, Hongyu Li +5Video Diffusion ModelsLong-Horizon Video Generation

    1Brown University · 2Massachusetts Institute of Technology · 3Meta

  15. Context-Guided Semantic Alignment for Feature Fusion Networks

    Jun 12, 2026Hyungseop Lee, Jiho Lee, Woochul KangMulti-Scale Feature FusionObject Detection

    Department of Embedded Systems Engineering, Incheon National University, Yeonsu-gu 22012, South Korea

  16. Multiscale POD of Transformer Attention Fields: Scale-Selective Analysis via Morlet Scalogram

    Jun 4, 2026Athanasios ZerisTransformer InterpretabilityProper Orthogonal Decomposition

    Independent Researcher, Athens, Greece.

  17. HyperDiT: Hyper-Connected Transformers for High-Fidelity Pixel-Space Diffusion

    May 15, 2026Yu He, Lichen Ma, Zipeng Guo +5Diffusion TransformerImage Generation

  18. An End-to-End Decision-Aware Multi-Scale Attention-Based Model for Explainable Autonomous Driving

    Apr 30, 2026Maryam Sadat Hosseini Azad, Shahriar Baradaran Shokouhi, Amir Abbas Hamidi Imani +2Explainable Artificial IntelligenceAutonomous Driving

    Department of Electrical Engineering, Iran University of Science and Technology, Tehran, Iran · Department of Computing Science, University of Alberta, Edmonton, AB T6G, Canada

  19. IMPA-Net: Meteorology-Aware Multi-Scale Attention and Dynamic Loss for Extreme Convective Radar Nowcasting

    Apr 27, 2026Haofei Cui, Guangxin He, Juanzhen Sun +5Precipitation ForecastingMulti-Scale Feature Fusion

    Key Laboratory of Meteorological Disaster, Ministry of Education (KLME) / International Joint Research Laboratory on Climate and Environment Change (ILCEC) / Collaborative Innovation Center on Forecast and Evaluation of Meteorological Disasters, Nanjing University of Information Science and Technology, Nanjing 210044, China. · Nanchang Meteorological Bureau, Nanchang 330000, China. · National Center for Atmospheric Research, Boulder, CO 80301, USA. +3

  20. Multi-modal, multi-scale representation learning for satellite imagery analysis just needs a good ALiBi

    Apr 11, 2026Patrick Kage, Pavlos AndreadisRepresentation LearningRemote Sensing Image Understanding

    Artificial Intelligence and its Applications Institute, (University of Edinburgh, 10 Crichton Street, Newington, Edinburgh EH8 9AB)

  21. A3-FPN: Asymptotic Content-Aware Pyramid Attention Network for Dense Visual Prediction

    Apr 11, 2026Meng'en Qin, Yu Song, Quanling Zhao +3Dense PredictionMulti-Scale Feature Fusion

    Henan Engineering Research Center for Artificial Intelligence Theory and Algorithms, Henan University, Kaifeng, China · Faculty of Computer Science and Control Engineering, Shenzhen University of Advanced Technology, Shenzhen, China · Department of Electrical and Electronic Engineering, The Hong Kong Polytechnic University, Hong Kong, China

  22. Adaptive Dual Residual U-Net with Attention Gate and Multiscale Spatial Attention Mechanisms (ADRUwAMS)

    Apr 10, 2026Mohsen Yaghoubi SurakiBrain Tumor SegmentationU-Net

  23. Hierarchical Kernel Transformer: Multi-Scale Attention with an Information-Theoretic Approximation Analysis

    Apr 10, 2026Giansalvo CirrincioneAttention ApproximationTransformer Attention

    Laboratoire LTI, Université de Picardie Jules Verne, 33 rue Saint-Leu, Amiens, 80039, France

  24. Generative 3D Gaussian Splatting for Arbitrary-ResolutionAtmospheric Downscaling and Forecasting

    Apr 9, 2026Tao Han, Zhibin Wen, Zhenghao Chen +4Weather Forecasting3D Gaussian Splatting

    Department of Computer Science and Engineering, The Hong Kong University of Science and Technology, 999077, Hong Kong, China · Shanghai Artificial Intelligence Laboratory, Shanghai, 200232, China · Department of Computer Science and Engineering, Southern University of Science and Technology, Shenzhen, 518055, Guangdong, China +2

  25. MSGL-Transformer: A Multi-Scale Global-Local Transformer for Rodent Social Behavior Recognition

    Apr 8, 2026Muhammad Imran Sharif, Doina CarageaAnimal Behavior AnalysisTransformer

    Department of Computer Science, Kansas State University, Manhattan, KS, 66506, USA.

  26. Cross-Stage Attention Propagation for Efficient Semantic Segmentation

    Apr 7, 2026Beoungwoo KangEfficient Semantic SegmentationSemantic Segmentation

    Vision Platform Team, Hyundai Mobis, South Korea

  27. Skillful Kilometer-Scale Regional Weather Forecasting via Global and Regional Coupling

    Mar 30, 2026Weiqi Chen, Wenwei Wang, Qilong Yuan +5Weather ForecastingMulti-Scale Feature Fusion

    DAMO Academy, Alibaba Group Hangzhou, China · Northwest Polytechnical University Xi’an, China · Zhejiang University Hangzhou, China +1

  28. MD-RWKV-UNet: Scale-Aware Anatomical Encoding with Cross-Stage Fusion for Multi-Organ Segmentation

    Mar 28, 2026Zhuoyi FangMulti-Organ SegmentationMedical Image Segmentation

    School of Mathematical Sciences Yangzhou University

  29. FSGNet: A Frequency-Aware and Semantic Guidance Network for Infrared Small Target Detection

    Mar 26, 2026Yingmei Zhang, Wangtao Bao, Yong Yang +3Infrared Small Target DetectionObject Detection

    School of Software and Internet of Things Engineering, Jiangxi University of Finance and Economics, Nanchang 330032, China · the postdoctoral researcher, CGN Begood Technology co., Ltd, Nanchang 330032, China · School of Computer Science and Technology, Tiangong University, Tianjin 300387, China +1

  30. GradAttn: Replacing Fixed Residual Connections with Task-Modulated Attention Pathways

    Mar 23, 2026Soudeep Ghoshal, Himanshu BuckchashConvolutional Neural NetworksAttention Residual Connections

    Kalinga Institute of Industrial Technology, Bhubaneswar, India · IMC University of Applied Sciences Krems, Krems, Austria