Mamba in Mamba
Mamba, a novel state-space model, is being explored as an efficient alternative to Transformers in various sequence modeling tasks. Current research focuses on adapting Mamba architectures for diverse applications, including computer vision, natural language processing, and signal processing, often comparing its performance and efficiency against established methods like Transformers and CNNs. This research aims to improve the speed and scalability of deep learning models while maintaining or exceeding performance, with implications for resource-constrained applications and large-scale deployments. The potential impact spans numerous fields, from medical image analysis and autonomous driving to personalized recommendations and drug discovery.
Papers
Decision Mamba: A Multi-Grained State Space Model with Self-Evolution Regularization for Offline RL
Qi Lv, Xiang Deng, Gongwei Chen, Michael Yu Wang, Liqiang Nie
CMamba: Channel Correlation Enhanced State Space Models for Multivariate Time Series Forecasting
Chaolv Zeng, Zhanyu Liu, Guanjie Zheng, Linghe Kong
MambaDepth: Enhancing Long-range Dependency for Self-Supervised Fine-Structured Monocular Depth Estimation
Ionuţ Grigore, Călin-Adrian Popa
TSCMamba: Mamba Meets Multi-View Learning for Time Series Classification
Md Atik Ahamed, Qiang Cheng
CDMamba: Remote Sensing Image Change Detection with Mamba
Haotian Zhang, Keyan Chen, Chenyang Liu, Hao Chen, Zhengxia Zou, Zhenwei Shi
Learning to Estimate System Specifications in Linear Temporal Logic using Transformers and Mamba
İlker Işık, Ebru Aydin Gol, Ramazan Gokberk Cinbis
Decision Mamba: Reinforcement Learning via Hybrid Selective Sequence Modeling
Sili Huang, Jifeng Hu, Zhejian Yang, Liwei Yang, Tao Luo, Hechang Chen, Lichao Sun, Bo Yang
Demystify Mamba in Vision: A Linear Attention Perspective
Dongchen Han, Ziyi Wang, Zhuofan Xia, Yizeng Han, Yifan Pu, Chunjiang Ge, Jun Song, Shiji Song, Bo Zheng, Gao Huang
Mamba4KT:An Efficient and Effective Mamba-based Knowledge Tracing Model
Yang Cao, Wei Zhang
MambaTS: Improved Selective State Space Models for Long-term Time Series Forecasting
Xiuding Cai, Yaoyao Zhu, Xueyao Wang, Yu Yao