State Space Model
State space models (SSMs) are a powerful class of models used to represent dynamic systems by tracking their hidden states over time. Current research focuses on developing efficient SSM architectures, such as Mamba and its variants, to overcome limitations of traditional methods in handling long sequences and high-dimensional data, particularly in applications involving time series forecasting, image processing, and dynamic system modeling. These advancements are improving the accuracy and scalability of SSMs across diverse fields, leading to significant improvements in areas like medical image analysis, autonomous driving, and natural language processing. The resulting models offer a compelling alternative to computationally expensive methods like transformers, while maintaining or exceeding performance in many applications.
Papers - Page 7
Topological Deep Learning with State-Space Models: A Mamba Approach for Simplicial Complexes
Marco Montagna, Simone Scardapane, Lev TelyatnikovDocMamba: Efficient Document Pre-training with State Space Model
Pengfei Hu, Zhenrong Zhang, Jiefeng Ma, Shuhang Liu, Jun Du, Jianshu ZhangStableMamba: Distillation-free Scaling of Large SSMs for Images and Videos
Hamid Suleman, Syed Talal Wasim, Muzammal Naseer, Juergen Gall
CoMamba: Real-time Cooperative Perception Unlocked with State Space Models
Jinlong Li, Xinyu Liu, Baolu Li, Runsheng Xu, Jiachen Li, Hongkai Yu, Zhengzhong TuFlash STU: Fast Spectral Transform Units
Y. Isabel Liu, Windsor Nguyen, Yagiz Devre, Evan Dogariu, Anirudha Majumdar, Elad HazanMamba-ST: State Space Model for Efficient Style Transfer
Filippo Botti, Alex Ergasti, Leonardo Rossi, Tomaso Fontanini, Claudio Ferrari, Massimo Bertozzi, Andrea Prati
OCTAMamba: A State-Space Model Approach for Precision OCTA Vasculature Segmentation
Shun Zou, Zhuo Zhang, Guangwei GaoLearning Brain Tumor Representation in 3D High-Resolution MR Images via Interpretable State Space Models
Qingqiao Hu, Daoan Zhang, Jiebo Luo, Zhenyu Gong, Benedikt Wiestler, Jianguo Zhang, Hongwei Bran Li
OMEGA: Efficient Occlusion-Aware Navigation for Air-Ground Robot in Dynamic Environments via State Space Model
Junming Wang, Xiuxian Guan, Zekai Sun, Tianxiang Shen, Dong Huang, Fangming Liu, Heming CuiMambaEVT: Event Stream based Visual Object Tracking using State Space Model
Xiao Wang, Chao wang, Shiao Wang, Xixi Wang, Zhicheng Zhao, Lin Zhu, Bo Jiang