State Space Model
State space models (SSMs) are a powerful class of models used to represent dynamic systems by tracking their hidden states over time. Current research focuses on developing efficient SSM architectures, such as Mamba and its variants, to overcome limitations of traditional methods in handling long sequences and high-dimensional data, particularly in applications involving time series forecasting, image processing, and dynamic system modeling. These advancements are improving the accuracy and scalability of SSMs across diverse fields, leading to significant improvements in areas like medical image analysis, autonomous driving, and natural language processing. The resulting models offer a compelling alternative to computationally expensive methods like transformers, while maintaining or exceeding performance in many applications.
Papers
Recursive Learning of Asymptotic Variational Objectives
Alessandro Mastrototaro, Mathias Müller, Jimmy Olsson
Modulating State Space Model with SlowFast Framework for Compute-Efficient Ultra Low-Latency Speech Enhancement
Longbiao Cheng, Ashutosh Pandey, Buye Xu, Tobi Delbruck, Vamsi Krishna Ithapu, Shih-Chii Liu