Self-Supervised Time Series Representation Learning

Overview

Self-supervised time series representation learning studies how to learn useful features from sequences without relying on extensive labels, which are often costly or unavailable. Common approaches include contrastive learning between related views, masked reconstruction, generative prediction, and joint-embedding predictive architectures (JEPAs), implemented with convolutional networks, Transformers, or state-space models. These representations are tested across tasks such as activity recognition, forecasting, anomaly detection, and clinical analysis of ECG, EEG, and wearable signals, often using frozen linear probes, fine-tuning, and cross-dataset transfer. A central open question is which objectives and inductive biases help each task: gains vary across datasets and architectures, while invariance to nuisance variation can also erase meaningful changes over time.

Latest papers

CardsList

164 papers20 papers in the last four weeks, down 23% on the four weeks before. 0.2% of all new papers.

  1. BrainRVQ: A High-Fidelity EEG Foundation Model via Dual-Domain Residual Quantization and Hierarchical Autoregression

    Feb 18, 2026Mingzhe Cui, Tao Chen, Yang Jiao +4EEG Foundation ModelsSelf-Supervised Time Series Representation Learning

  2. SleepMaMi: A Universal Sleep Foundation Model for Integrating Macro- and Micro-structures

    Feb 7, 2026Keondo Park, Younghoon Na, Yourim Choi +3Self-Supervised Time Series Representation Learning

  3. SAMBA: Toward an EEG Foundation Model via Differential Mamba and Coordinate-Driven Spatial Embedding

    Nov 23, 2025Jiazhen Hong, Geoffrey Mackellar, Soheila GhaneEEG Foundation ModelsElectroencephalography

  4. LEAF: Language-EEG Aligned Foundation Model for Brain-computer interfaces

    Sep 29, 2025Muyun Jiang, Shuailei Zhang, Zhenjie Yang +10EEG DecodingEEG Foundation Models

  5. SpellerSSL: Self-Supervised Learning with P300 Aggregation for Speller BCIs

    Sep 23, 2025Jiazhen Hong, Geoff Mackellar, Soheila GhaneBrain-Computer InterfacesEEG Decoding

  6. SingLEM: Single-Channel Large EEG Model

    Sep 22, 2025Jamiyan Sukhbaatar, Satoshi Imamura, Ibuki Inoue +5Representation LearningSelf-Supervised Time Series Representation Learning

  7. EEGDM: Learning EEG Representation with Latent Diffusion Model

    Aug 28, 2025Shaocong Wang, Tong Liu, Yihan Li +6ElectroencephalographyEEG Signal Generation

  8. EEGDM: Label-Efficient EEG Representation Learning with Generative Diffusion Model

    Aug 13, 2025Jia Hong Puah, Sim Kuan Goh, Ziwei Zhang +6ElectroencephalographyEEG Seizure Detection

  9. FISHER: A Foundation Model for Multi-Modal Industrial Signal Comprehensive Representation

    Jul 22, 2025Pingyi Fan, Anbai Jiang, Shuwei Zhang +9Representation LearningSelf-Supervised Time Series Representation Learning

  10. Mantis: Lightweight Foundation Model for Time Series Classification

    Feb 21, 2025Vasilii Feofanov, Songkang Wen, Shifeng Xie +10Time Series ClassificationSelf-Supervised Time Series Representation Learning

  11. Stochastic Optimal Control for Continuous-Time fMRI Representation Learning

    Feb 7, 2025Joonhyeong Park, Byoungwoo Park, Chang-Bae Bang +4Latent Dynamics ModelingSelf-Supervised Time Series Representation Learning