Self-Supervised

Follow this topic Ask about this topic

Recent momentum

-25%

15 papers in the last 28 days · 0.2% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

11 new papers

A weekly snapshot of new work published in Self-Supervised.

Period ending 2026-09-07

5 new papers

A weekly snapshot of new work published in Self-Supervised.

191 papers

Latest in Self-Supervised

Browse all topics →

Quantifying the Pre-training Dividend: Generative versus Latent Self-Supervised Learning for Time Series Foundation Models
May 19, 2026Noam Major, Kathy Razmadze, Yoli ShavitTime Series Foundation Models Self-Supervised
Knowing When Not to Predict: Self Supervised Learning and Abstention for Safer DR Screening
May 18, 2026Muskaan Chopra, Lorenz Sparrenberg, Jan H. Terheyden +1Interpretable Diabetic Retinopathy Grading Self-Supervised
Harnessing Self-Supervised Features for Art Classification
May 18, 2026Federico Melis, Davide Bilardello, Emanuele Prato +2Image Classification Self-Supervised
Benchmarking transferability of SSL pretraining to same and different modality segmentation tasks
May 18, 2026Jue Jiang, Harini VeeraraghavanSwin Self-Supervised
Instance Discrimination for Link Prediction
May 18, 2026Valentin Cuzin-Rambaud, Mathieu Lefort, Rémy CazabetZero-Shot Link Prediction Self-Supervised
Task-Aligned Self-Supervised Learning for Medical Image Analysis: A Task-Oriented Review with Practical Design Guidelines
May 18, 2026Chathura Wimalasiri, Kishor Nandakishor, Marimuthu PalaniswamiSelf-Supervised Medical Imaging
Escaping the Linearity Trap: Manifold Detours for Black-Box Adversarial Attacks on Singing Audio Deepfake Detection
May 18, 2026Yifan Liao, Yule Liu, Zhen Sun +5Audio Deepfake Detection Singing Voice Conversion
UST-Hand: An Uncertainty-aware Spatiotemporal Point Cloud Interaction Network for 3D Self-supervised Hand Pose Estimation
May 18, 2026Tianhao Han, Haoyang Zhang, Liang Xie +53D Hand Hand
SOLAR: Self-supervised Joint Learning for Symmetric Multimodal Retrieval
May 15, 2026Wenjie Yang, Hang Yu, Yuyu Guo +1Multimodal Retrieval Image-Text Pairs
Masked Next-Scale Prediction for Self-supervised Scene Text Recognition
May 14, 2026Zhuohao Chen, Zeng Li, Yifei Zhang +2Scene Text Recognition Self-Supervised
Beyond Instance-Level Self-Supervision in 3D Multi-Modal Medical Imaging
May 14, 2026Tan Pan, Shuhao Mei, Yixuan Sun +8Multimodal Pretraining Medical Imaging
VCR: Learning Valid Contextual Representation for Incomplete Wearable Signals
May 13, 2026Yuxuan Weng, Wenhan Luo, Qijia ShaoMissing Modalities Remote Physiological Measurement
AOI-SSL: Self-Supervised Framework for Efficient Segmentation of Wire-bonded Semiconductors In Optical Inspection
May 12, 2026Joaquín Figueira, Rob Van Gastel, Giacomo D'Amicantonio +4Self-Supervised Self-Supervised Vision Transformers
Contrastive Learning under Noisy Temporal Self-Supervision for Colonoscopy Videos
May 12, 2026Luca Parolari, Pietro Gori, Lamberto Ballan +2Colonoscopy Polyp Segmentation
Modulation Consistency-based Contrastive Learning for Self-Supervised Automatic Modulation Classification
May 12, 2026Chenxu Wang, Shuang Wang, Lirong Han +4Automatic Modulation Classification Self-Supervised
Information theoretic underpinning of self-supervised learning by clustering
May 12, 2026Josef Kittler, Sara Atito, Muhammad AwaisSelf-Supervised Kullback-Leibler Divergence
Martingale-Consistent Self-Supervised Learning
May 12, 2026Moritz Gögl, Hanwen Xing, Christopher YauSelf-Supervised Conformal Test Martingales
Deploying Self-Supervised Learning for Real Seismic Data Denoising
May 11, 2026Giovanny A. M. Arboleda, Claudio D. T. de Souza, Carlos E. M. dos Anjos +6Full Waveform Inversion Self-Supervised
Likelihood scoring for continuations of mathematical text: a self-supervised benchmark with tests for shortcut vulnerabilities
May 11, 2026Daniel RanardNext-Token Prediction Continuation
Learning to Perceive "Where": Spatial Pretext Tasks for Robust Self-Supervised Learning
May 11, 2026Yang Shen, Yusen Cai, Weronika Hryniewska-Guzik +2Self-Supervised Spatial Representation
Team-Based Self-Play With Dual Adaptive Weighting for Fine-Tuning LLMs
May 11, 2026Wu Li, Yigeng Zhou, Zesheng Shi +3Large Language Model Alignment Self-Play
Improved monocular depth prediction using distance transform over pre-semantic contours with self-supervised neural networks
May 8, 2026Marwane Hariat, Antoine Manzanera, David FilliatMonocular Depth Estimation Self-Supervised
GRASP -- Graph-Based Anomaly Detection Through Self-Supervised Classification
May 8, 2026Robin Buchta, Carsten Kleiner, Felix Heine +1Intrusion Detection Anomaly Detection
Beyond ViT Tokens: Masked-Diffusion Pretrained Convolutional Pathology Foundation Model for Cell-Level Dense Prediction
May 8, 2026Weiming Chen, Xitong Ling, Zhenyang Cai +5Pathology Foundation Models Dense Prediction
Boosting Self-Supervised Tracking with Contextual Prompts and Noise Learning
May 7, 2026Yaozong Zheng, Qihua Liang, Bineng Zhong +4Self-Supervised Multi-Object Tracking
Enabling Unsupervised Training of Deep EEG Denoisers With Intelligent Partitioning
May 7, 2026Qiyu Rao, Haozhe Tian, Homayoun Hamedmoghadam +1Electroencephalography Spatial Super-Resolution Self-Supervised
TinySSL: Distilled Self-Supervised Pretraining for Sub-Megabyte MCU Models
May 7, 2026Bibin WilsonSelf-Supervised Chain-Of-Thought Distillation
Tumor-aware augmentation with task-guided attention analysis improves rectal cancer segmentation from magnetic resonance images
May 6, 2026Aneesh Rangnekar, Joao Miranda, Natally Horvat +13Lesion Segmentation Magnetic Resonance Imaging
Attention-Based Chaotic Self-Supervision for Medical Image Classification
May 6, 2026Joao Batista Florindo, Amanda Pontes de Oliveira OrnelasMedical Image Classification Self-Supervised
Enhancing Self-Supervised Talking Head Forgery Detection via a Training-Free Dual-System Framework
May 5, 2026Ke Liu, Jiwei Wei, Shuchang Zhou +5Face Forgery Detection Detection Framework
SignMAE: Segmentation-Driven Self-Supervised Learning for Sign Language Recognition
May 3, 2026Kunyuan Xie, Zhixi Cai, Kalin StefanovSign Language Recognition Self-Supervised
PointCSP: Cross-Sample Semantic Propagation and Stability Preservation in Self-Supervised Point Cloud Learning
May 3, 2026Xinxing Yu, Ajian Liu, Sunyuan Qiang +53D Semantic Segmentation Self-Supervised
Rhamba: Region-Aware Hybrid Attention-Mamba Framework for Self-Supervised Learning in Resting-State fMRI
May 2, 2026Ruthwik Reddy Doodipala, Pankaj Pandey, Pratheek Eranki +3Brain Magnetic Resonance Imaging Self-Supervised
CGM-JEPA: Learning Consistent Continuous Glucose Monitor Representations via Predictive Self-Supervised Pretraining
May 1, 2026Hada Melino Muhammad, Zechen Li, Flora Salim +1Continuous Glucose Monitoring Hypoglycemia Classification
MeshReGen: A Unified 3D Geometry Regeneration Framework
Apr 30, 2026Geon Yeong Park, Roman Shapovalov, Rakesh Ranjan +33D Generation 3D Geometry
LA-Pose: Latent Action Pretraining Meets Pose Estimation
Apr 30, 2026Zhengqing Wang, Saurabh Nair, Prajwal Chidananda +4Latent Actions Inverse Dynamics
Large-scale semi-supervised learning with online spectral graph sparsification
Apr 29, 2026Daniele Calandriello, Alessandro Lazaric, Michal ValkoSemi-Supervised Learning Sparsity
Complexity of Linear Regions in Self-supervised Deep ReLU Networks
Apr 27, 2026Mufhumudzi Muthivhi, Terence L. van ZylSelf-Supervised Rectified Linear Unit
Intervention-Based Self-Supervised Learning: A Causal Probe Paradigm for Remote Photoplethysmography
Apr 26, 2026Zhiyi Niu, Xiaoguang Tu, Bo Zhao +3Remote Photoplethysmography Physiological Data
H-SemiS: Hierarchical Fusion of Semi and Self-Supervised Learning for Knee Osteoarthritis Severity Grading
Apr 25, 2026Chandravardhan Singh Raghaw, Anushka Parwal, Shahid Shafi Dar +2Knee Osteoarthritis Semi-Supervised Learning
ArmSSL: Adversarial Robust Black-Box Watermarking for Self-Supervised Learning Pre-trained Encoders
Apr 24, 2026Yongqi Jiang, Yansong Gao, Boyu Kuang +3Watermarking Watermarks
Advancing automatic speech recognition using feature fusion with self-supervised learning features: A case study on Fearless Steps Apollo corpus
Apr 24, 2026Szu-Jui Chen, John H. L. HansenSelf-Supervised Speech Models Self-Supervised
Reshoot-Anything: A Self-Supervised Model for In-the-Wild Video Reshooting
Apr 23, 2026Avinash Paliwal, Adithya Iyer, Shivin Yadav +2Controllable Video Generation Camera Control
Trust-SSL: Additive-Residual Selective Invariance for Robust Aerial Self-Supervised Learning
Apr 23, 2026Wadii Boulila, Adel Ammar, Bilel Benjdira +1Self-Supervised Contrastive Loss
MAE-Based Self-Supervised Pretraining for Data-Efficient Medical Image Segmentation Using nnFormer
Apr 22, 2026R. M. Krishna Sureddi, T. Satyanarayana Murthy, Nomula Varsha Reddy +2Medical Image Segmentation Self-Supervised
Self-supervised pretraining for an iterative image size agnostic vision transformer
Apr 22, 2026Nedyalko Prisadnikov, Danda Pani Paudel, Yuqian Fu +1Self-Supervised Vision Transformers Vision Encoders
RAFT-MSF++: Temporal Geometry-Motion Feature Fusion for Self-Supervised Monocular Scene Flow
Apr 21, 2026Xunpei Sun, Zuoxun Hou, Yi Chang +2Optical Flow Motion-Focused Representations
Geometry-Guided Self-Supervision for Ultra-Fine-Grained Recognition with Limited Data
Apr 21, 2026Shijie Wang, Yadan Luo, Zijian Wang +3Semantic-Geometric Representations Fine-Grained Perception
iDocV2: Leveraging Self-Supervision and Open-Set Detection for Improving Pattern Spotting in Historical Documents
Apr 17, 2026Jose M. Saavedra, Crhistopher Stears, Marcelo Pizarro +2Visual Document Retrieval Retrieval Layer
SSMamba: A Self-Supervised Hybrid State Space Model for Pathological Image Classification
Apr 17, 2026Enhui Chai, Sicheng Chen, Tianyi Zhang +2Feature Pyramid Networks Mamba
SPLIT: Self-supervised Partitioning for Learned Inversion in Nonlinear Tomography
Apr 17, 2026Markus Haltmeier, Lukas Neumann, Nadja Gruber +1Image Reconstruction Ill-Posed Inverse Problem
Co-distilled attention guided masked image modeling with noisy teacher for self-supervised learning on medical images
Apr 16, 2026Jue Jiang, Aneesh Rangnekar, Harini VeeraraghavanSwin Self-Supervised
Using Deep Learning Models Pretrained by Self-Supervised Learning for Protein Localization
Apr 13, 2026Ben Isselmann, Dilara Göksu, Heinz Neumann +1Microscopy Self-Supervised
Learning Concepts, Not Tokens: Self-Supervised Semantic Alignment for Language Models
Mar 31, 2026Christine Zhang, Dan Jurafsky, Chen ShaniNext-Token Prediction Geo-Contextual Alignment
On the Asymptotics of Self-Supervised Pre-training: Two-Stage M-Estimation and Representation Symmetry
Mar 29, 2026Mohammad Tinati, Stephen TuSelf-Supervised Model Pretraining
SpectralSplats: Robust Differentiable Tracking via Spectral Moment Supervision
Mar 25, 2026Avigail Cohen Rimon, Amir Mann, Mirela Ben Chen +1Multi-Object Tracking Large Inter-Frame Displacements
Human-like Object Grouping in Self-supervised Vision Transformers
Mar 14, 2026Hossein Adeli, Seoyoung Ahn, Andrew Luo +3Self-Supervised Object-Centric Learning
Learning to Discover Iterative Spectral Algorithms
Feb 10, 2026Zihang Liu, Oleg Balabanov, Yaoqing Yang +1Spectral Preconditioning Self-Supervised
Self-Supervised Learning from Structural Invariance
Feb 2, 2026Yipeng Zhang, Hafez Ghaemi, Jungyoon Lee +3Self-Supervised Photometric Supervision
Radiance-Field Guided Pretraining: Scaling Localization Models with Unlabeled Wireless Signals
Dec 8, 2025Guosheng Wang, Shen Wang, Lei YangSelf-Supervised Geometry-Aware Foundation Model

May 19, 2026 · cs.LGJ/K move · Enter open · S save

Quantifying the Pre-training Dividend: Generative versus Latent Self-Supervised Learning for Time Series Foundation Models

Noam Major, Kathy Razmadze, Yoli Shavit

Faculty of Engineering, Bar-Ilan University, Israel

The success of self-supervised learning (SSL) in vision and NLP has motivated its rapid adoption for time series. However, research has focused primarily on Generative paradigms and forecasting tasks, leaving the broader utility of learned representations unquantified. We establish a controlled framework to evaluate the "pre-training dividend": the value added by SSL across diverse temporal tasks. We systematically compare Generative paradigms against Latent Alignment architectures, introducing adaptations of LeJEPA and DINO for time series. These adaptations utilize Discrete Wavelet Transform (DWT) augmentations to enforce invariance to local fluctuations. Our analysis reveals that the pre-training dividend is highly asymmetric: SSL yields gains of up to 375% for anomaly detection and classification, yet remains marginal for forecasting. We demonstrate that representational utility is non-universal, governed by a precision-invariance trade-off where the specific signal resolution required by the task must align with the objective. Finally, we show that representation quality is largely independent of data origin and saturates at moderate architectural depths, suggesting a path to scaling via massive synthetic generation. Our code is available at: https://github.com/noammajor/Models

Time Series Foundation Models Self-Supervised Time Series Model Pretraining Latent Bridge Matching Generative Framework Discrete Wavelet Transform Generative

Open paper Ask about it PDF