Visual SSMs

SSM: State Space Model

Ask about this topic

Overview

Visual state-space models adapt recurrent sequence architectures, especially selective state-space models such as Mamba, to images and video. They turn spatial or temporal features into sequences using directional scans, while newer designs explore bidirectional scans, graphs, clusters, frequency-domain processing, and combinations with CNNs or attention. These approaches are used for classification, segmentation, restoration, depth estimation, and video understanding, with benchmarks spanning natural images, medical scans, and remote sensing. A central tension is how to retain linear-time efficiency without losing local detail, boundary accuracy, or robustness to scan direction and domain shift.

Latest papers

CardsList

81 papers7 papers in the last four weeks, down 36% on the four weeks before. 0.0% of all new papers.

  1. A Controlled Benchmark of Visual State-Space Backbones with Domain-Shift and Boundary Analysis for Remote-Sensing Segmentation

    Apr 20, 2026Nichula Wasalathilaka, Dineth Perera, Oshadha Samarakoon +4Remote Sensing Image SegmentationDomain Generalization

    University of Peradeniya Peradeniya, Sri Lanka

  2. DGSSM: Diffusion guided state-space models for multimodal salient object detection

    Apr 19, 2026Suklav Ghosh, Arijit Sur, Pinaki MitraDiffusion Model GuidanceSalient Object Detection

    Dept. of Computer Science and Engineering, Indian Institute of Technology, Guwahati

  3. Attention Is not Everything: Efficient Alternatives for Vision

    Apr 19, 2026Nur Mohammad Kazi, Ibteshum Khaled, Md. Luthful Hasan Galib +2Visual SSMsConvolutional Neural Networks

    Ahsanullah University of Science and Technology Dhaka, Bangladesh

  4. HAMSA: Scanning-Free Vision State Space Models via SpectralPulseNet

    Apr 16, 2026Badri N. Patro, Vijay S. AgneeswaranFrequency-Domain Feature LearningVisual SSMs

    Microsoft

  5. Efficient Spatial-Temporal Focal Adapter with SSM for Temporal Action Detection

    Apr 10, 2026Yicheng Qiu, Keiji YanaiTemporal Action DetectionTemporal Action Localization

    Department of Informatics The University of Electro-Communications Chofu, Tokyo, Japan

  6. Beyond Mamba: Enhancing State-space Models with Deformable Dilated Convolutions for Multi-scale Traffic Object Detection

    Apr 9, 2026Jun Li, Yingying Shi, Zhixuan Ruan +2Object DetectionVisual SSMs

    School of Computer and Electronic Information, Nanjing Normal University, 210023, China

  7. Bridging the Geometry Mismatch: Frequency-Aware Anisotropic Serialization for Thin-Structure SSMs

    Mar 30, 2026Jin Bai, Huiyao Zhang, Qi Wen +4Thin-Structure SegmentationTopology-Preserving Image Segmentation

    University of Chinese Academy of Sciences · Technology and Engineering Center for Space Utilization, Chinese Academy of Sciences · University of Peshawar, Pakistan +1

  8. Towards Controllable Low-Light Image Enhancement: A Continuous Multi-illumination Dataset and Efficient State Space Framework

    Mar 26, 2026Hongru Han, Tingrui Guo, Liming Zhang +3Image EnhancementLow-Light Image Enhancement

    Department of Computer and Information Science, University of Macau, Taipa, Macau 999078, China · School of Automation, China University of Geosciences, Wuhan 430074, China · Department of Electromechanical Engineering, University of Macau, Taipa, Macau 999078, China

  9. RS-SSM: Refining Forgotten Specifics in State Space Model for Video Semantic Segmentation

    Mar 25, 2026Kai Zhu, Zhenyu Cui, Zehua Zang +1Semantic SegmentationVisual SSMs

    Wangxuan Institute of Computer Technology, Peking University · Tsinghua University · Institute of Software Chinese Academy of Sciences +1

  10. MFil-Mamba: Multi-Filter Scanning for Spatial Redundancy-Aware Visual State Space Models

    Mar 20, 2026Puskal Khadka, KC SantoshVisual SSMsImage Classification

    USD Artifical Intelligence Research, Department of Computer Science, University of South Dakota, Vermillion, 57069, USA.

  11. SF-Mamba: Rethinking State Space Model for Vision

    Mar 17, 2026Masakazu Yoshimura, Teruaki Hayashi, Yuki Hoshino +2Visual SSMs

    Sony Group Corporation, Tokyo, Japan

  12. PDE-SSM: A Spectral State Space Approach to Spatial Mixing in Diffusion Transformers

    Mar 14, 2026Eshed Gal, Moshe Eliasof, Eldad HaberDiffusion TransformerVisual SSMs

    University of British Columbia, Vancouver, BC Canada · University of Cambridge, Cambridge, United Kingdom

  13. Decoding Matters: Efficient Mamba-Based Decoder with Distribution-Aware Deep Supervision for Medical Image Segmentation

    Mar 13, 2026Fares Bougourzi, Fadi Dornaika, Abdenour HadidMedical Image SegmentationCross-Modality Medical Image Segmentation

    IEMN UMR CNRS 8520, Université Polytechnique Hauts-de-France, 59313 Valenciennes, France · University of the Basque Country (UPV/EHU), Donostia-San Sebastián, Spain · Sorbonne Center for Artificial Intelligence, Sorbonne University Abu Dhabi, Abu Dhabi, UAE

  14. Progressive Split Mamba: Effective State Space Modelling for Image Restoration

    Mar 10, 2026Mohammed Hassanin, Nour Moustafa, Weijian Deng +1Image RestorationVisual SSMs

  15. BuildMamba: A Visual State-Space Based Model for Multi-Task Building Segmentation and Height Estimation from Satellite Images

    Mar 9, 2026Sinan U. Ulu, A. Enes Doruk, I. Can Yagmur +3Remote Sensing Image SegmentationSemantic Segmentation

    Graduate School of Engineering, Ozyegin university, 34794 Istanbul, Türkiye. · Department of Computer Science, University of Rochester, Rochester, NY 14627 USA. · School of Engineering and Natural Sciences, Istanbul Medipol University, 34810 Istanbul, Türkiye. +1

  16. MoEMambaMIL: Structure-Aware Selective State Space Modeling for Whole-Slide Image Analysis

    Mar 6, 2026Dongqing Xie, Yonghuang WuWhole-Slide Image AnalysisMultiple Instance Learning

    Tongji University · Fudan University

  17. Mask-aware inference with State-Space Models

    Mar 4, 2026Ignasi Mas, Ramon Morros, Javier-Ruiz Hidalgo +1Visual SSMsState Space Models

  18. Separators in Enhancing Autoregressive Pretraining for Vision Mamba

    Mar 4, 2026Hanpeng Liu, Zidan Wang, Shuoxi Zhang +2Visual Autoregressive ModelsVisual SSMs

    Huazhong University of Science and Technology

  19. SpectralMamba-UNet: Frequency-Disentangled State Space Modeling for Texture-Structure Consistent Medical Image Segmentation

    Feb 26, 2026Fuhao Zhang, Lei Liu, Jialin Zhang +2Medical Image SegmentationVisual SSMs

    College of Computer Science, Sichuan Normal University, Chengdu, Sichuan 610068, China · Zhejiang University & Ant Group, Hangzhou, Zhejiang, China · State Key Laboratory of Public Big Data, Guizhou University, Guiyang, Guizhou 550025, China

  20. Scan Clusters, Not Pixels: A Cluster-Centric Paradigm for Efficient Ultra-high-definition Image Restoration

    Feb 25, 2026Chen Wu, Ling Wang, Zhuoran Zheng +6Image RestorationVisual SSMs

    National University of Defense Technology · HKUST(GZ) · Qilu University of Technology +3

  21. MambaX: Image Super-Resolution with State Predictive Control

    Nov 22, 2025Chenyu Li, Danfeng Hong, Bing Zhang +3Visual SSMsImage Super-Resolution

    Southeast University, Nanjing 210096, China · Aerospace Information Research Institute, Chinese Academy of Sciences, 100094 Beijing, China, and the College of Resources and Environment, University of Chinese Academy of Sciences, Beijing 100049, China, and also with the School of Mathematics, Southeast University, 210096 Nanjing, China · Department of Complexity Science and Engineering, Graduate School of Frontier Sciences, the University of Tokyo, Chiba 277-8561, Japan +1