State Space Model
State space models (SSMs) are a powerful class of models used to represent dynamic systems by tracking their hidden states over time. Current research focuses on developing efficient SSM architectures, such as Mamba and its variants, to overcome limitations of traditional methods in handling long sequences and high-dimensional data, particularly in applications involving time series forecasting, image processing, and dynamic system modeling. These advancements are improving the accuracy and scalability of SSMs across diverse fields, leading to significant improvements in areas like medical image analysis, autonomous driving, and natural language processing. The resulting models offer a compelling alternative to computationally expensive methods like transformers, while maintaining or exceeding performance in many applications.
Papers
Topological Deep Learning with State-Space Models: A Mamba Approach for Simplicial Complexes
Marco Montagna, Simone Scardapane, Lev Telyatnikov
DocMamba: Efficient Document Pre-training with State Space Model
Pengfei Hu, Zhenrong Zhang, Jiefeng Ma, Shuhang Liu, Jun Du, Jianshu Zhang
Distillation-free Scaling of Large SSMs for Images and Videos
Hamid Suleman, Syed Talal Wasim, Muzammal Naseer, Juergen Gall
CoMamba: Real-time Cooperative Perception Unlocked with State Space Models
Jinlong Li, Xinyu Liu, Baolu Li, Runsheng Xu, Jiachen Li, Hongkai Yu, Zhengzhong Tu
Flash STU: Fast Spectral Transform Units
Y. Isabel Liu, Windsor Nguyen, Yagiz Devre, Evan Dogariu, Anirudha Majumdar, Elad Hazan
Mamba-ST: State Space Model for Efficient Style Transfer
Filippo Botti, Alex Ergasti, Leonardo Rossi, Tomaso Fontanini, Claudio Ferrari, Massimo Bertozzi, Andrea Prati
OCTAMamba: A State-Space Model Approach for Precision OCTA Vasculature Segmentation
Shun Zou, Zhuo Zhang, Guangwei Gao
Learning Brain Tumor Representation in 3D High-Resolution MR Images via Interpretable State Space Models
Qingqiao Hu, Daoan Zhang, Jiebo Luo, Zhenyu Gong, Benedikt Wiestler, Jianguo Zhang, Hongwei Bran Li