State Space Model
State space models (SSMs) are a powerful class of models used to represent dynamic systems by tracking their hidden states over time. Current research focuses on developing efficient SSM architectures, such as Mamba and its variants, to overcome limitations of traditional methods in handling long sequences and high-dimensional data, particularly in applications involving time series forecasting, image processing, and dynamic system modeling. These advancements are improving the accuracy and scalability of SSMs across diverse fields, leading to significant improvements in areas like medical image analysis, autonomous driving, and natural language processing. The resulting models offer a compelling alternative to computationally expensive methods like transformers, while maintaining or exceeding performance in many applications.
Papers
OMEGA: Efficient Occlusion-Aware Navigation for Air-Ground Robot in Dynamic Environments via State Space Model
Junming Wang, Dong Huang, Xiuxian Guan, Zekai Sun, Tianxiang Shen, Fangming Liu, Heming Cui
MambaEVT: Event Stream based Visual Object Tracking using State Space Model
Xiao Wang, Chao wang, Shiao Wang, Xixi Wang, Zhicheng Zhao, Lin Zhu, Bo Jiang
Transformers to SSMs: Distilling Quadratic Knowledge to Subquadratic Models
Aviv Bick, Kevin Y. Li, Eric P. Xing, J. Zico Kolter, Albert Gu
Multi-Scale Representation Learning for Image Restoration with State-Space Model
Yuhong He, Long Peng, Qiaosi Yi, Chen Wu, Lu Wang
OccMamba: Semantic Occupancy Prediction with State Space Models
Heng Li, Yuenan Hou, Xiaohan Xing, Xiao Sun, Yanyong Zhang
MambaLoc: Efficient Camera Localisation via State Space Model
Jialu Wang, Kaichen Zhou, Andrew Markham, Niki Trigoni
DyGMamba: Efficiently Modeling Long-Term Temporal Dependency on Continuous-Time Dynamic Graphs with State Space Models
Zifeng Ding, Yifeng Li, Yuan He, Antonio Norelli, Jingcheng Wu, Volker Tresp, Yunpu Ma, Michael Bronstein
Enhanced Prediction of Multi-Agent Trajectories via Control Inference and State-Space Dynamics
Yu Zhang, Yongxiang Zou, Haoyu Zhang, Zeyu Liu, Houcheng Li, Long Cheng