Self-Supervised Learning

Also known as SSL

Overview

Self-supervised learning creates training signals from the data itself, for example by matching augmented views, predicting masked content, or using temporal, geometric, and physical consistency. Contrastive learning, masked autoencoders, teacher–student distillation, and joint-embedding predictive architectures are common approaches across images, video, audio, language, medical data, and scientific measurements. These methods can reduce dependence on costly labels and support transfer, but useful representations depend on how well the pretext signal fits the data and downstream task. A central tension is balancing invariance and non-collapse with retaining fine-grained information, while establishing reliable transfer under domain shifts and limited compute remains an open challenge.

Latest papers

CardsList

280 papers27 papers in the last four weeks, down 13% on the four weeks before. 0.2% of all new papers.

  1. Label-Efficient 3D Forest Mapping: Self-Supervised and Transfer Learning for Instance Segmentation, Semantic Segmentation, and Species Classification

    Nov 9, 2025Aldino Rizaldy, Fabian Ewald Fassnacht, Ahmed Jamal Afifi +3Self-Supervised LearningTree Species Classification

  2. Patent Representation Learning via Self-supervision

    Nov 3, 2025You Zuo, Kim Gerdes, Éric de la Clergerie +1Contrastive LearningRepresentation Learning

  3. Revela: Dense Retriever Learning via Language Modeling

    Jun 19, 2025Fengyu Cai, Tong Chen, Xinran Zhao +5Dense RetrievalInformation Retrieval

  4. SPAR: Placement-aware Self-Supervised Representation Learning for Distributed Sensing

    May 22, 2025Yizhuo Chen, Tianchen Wang, You Lyu +9Representation LearningSelf-Supervised Learning

  5. AdaDim: Dimensionality Adaptation for SSL Representational Dynamics

    May 18, 2025Kiran Kokilepersaud, Mohit Prabhushankar, Ghassan AlRegibSelf-Supervised Learning

  6. Meta-Representational Predictive Coding: Neuroscience-Informed Self-Supervised Learning

    Mar 22, 2025Alexander Ororbia, Karl Friston, Rajesh P. N. RaoSelf-Supervised LearningPredictive Coding

  7. Hyperspectral Image Restoration and Super-resolution with Physics-Aware Deep Learning for Biomedical Applications

    Mar 3, 2025Yuchen Xiang, Zhaolu Liu, Monica Emili Garcia-Segura +12Hyperspectral ImagingPhysics-Guided Image Restoration

  8. ACT-JEPA: Novel Joint-Embedding Predictive Architecture for Efficient Policy Representation Learning

    Jan 24, 2025Aleksandar Vujinovic, Aleksandar KovacevicRepresentation LearningWorld Model Learning

  9. Structure-Guided Self-Supervised Matching for One-Shot Medical Landmark Detection

    Mar 3, 2022Qingsong Yao, Zhen Huang, Ao Wang +4Few-Shot LearningImage Matching