Self-Supervised Learning

Also known as SSL

Overview

Self-supervised learning creates training signals from the data itself, for example by matching augmented views, predicting masked content, or using temporal, geometric, and physical consistency. Contrastive learning, masked autoencoders, teacher–student distillation, and joint-embedding predictive architectures are common approaches across images, video, audio, language, medical data, and scientific measurements. These methods can reduce dependence on costly labels and support transfer, but useful representations depend on how well the pretext signal fits the data and downstream task. A central tension is balancing invariance and non-collapse with retaining fine-grained information, while establishing reliable transfer under domain shifts and limited compute remains an open challenge.

Latest papers

CardsList

280 papers27 papers in the last four weeks, down 13% on the four weeks before. 0.2% of all new papers.

  1. Self-Supervised Representations for Binary Program Clustering: From Empirical Study to Retrieval-Augmented Learning

    Aug 3, 2026Martin Mocko, Daniela ChudáRepresentation LearningSelf-Supervised Learning

  2. Global-Scale Self-Supervised Spatiotemporal Learning for NDVI Time-Series Reconstruction

    Aug 3, 2026Ang Li, Menghui Jiang, Xiaobin Guan +2Time Series ImputationSelf-Supervised Learning

  3. PixVL: Self-Supervised Training of Pixel-Level MLLMs via a Unified Mask--Text Consistency Cycle

    Aug 2, 2026Yicheng Xiao, Haoxuan Ma, Caorui Li +7Self-Supervised LearningVLM Adaptation

  4. Asleep at the Wheel: JEPA's Limitations in Evaluating Novel Driving Data

    Aug 2, 2026Advait Pavuluri, Shamik Karkhanis, Uzma MushtaqueSelf-Supervised LearningJoint-Embedding Predictive Architecture

  5. Geometric Self-Supervised Pre-training for Neural Combinatorial Optimization

    Jul 31, 2026David Aguado, Daniel Fuertes, Carlos R. del-Blanco +1Traveling Salesperson ProblemSelf-Supervised Learning

  6. Bootstrapping Self-Supervised Learning of Binary Classification Using Error Bounds: A Case Study on a Robotic Insertion Task

    Jul 31, 2026Zebin Duan, Norbert Krüger, Juan Heredia +2Self-Supervised LearningRobotic Data Collection

  7. MoRAE: Flow-Friendly Self-Supervised Latents for Text-to-Motion Generation

    Jul 31, 2026Yifei Zhu, Dafei Qin, Zijiao Zeng +4Self-Supervised LearningText-to-Motion Generation

  8. Building a User Foundation Model for the Open Web

    Jul 30, 2026Solal Vernier, Ivan Can Arisoy, Merwan Barlier +1Self-Supervised LearningCTR Prediction

  9. Training Skills Like Parameters via Self-Supervised Semantic Diffusion

    Jul 30, 2026Mo Li, Zixin Yin, Ting Cao +1Self-Supervised LearningLLM Agent Skill Learning

  10. WALoMA: A Multitask Wireless Foundation Model via Adaptive Low-Rank Masked Autoencoders

    Jul 28, 2026Madi Makin, Asmaa Abdallah, Abdulkadir Celik +1Wireless Foundation ModelsMasked Autoencoders

  11. Mind the Microphone Gap: Benchmarking Array Upsampling Strategies for Latent Acoustic Mapping

    Jul 27, 2026Philipp Schmidt, Huw Cheston, Juan Azcarreta +3Audio Representation LearningSelf-Supervised Learning

  12. LoTA-N2N: Local Trace Adaptation for Zero-Shot Self-Supervised Image Denoising

    Jul 27, 2026Jintong Hu, Bin Xia, Junlin Liu +2Self-Supervised Image DenoisingSelf-Supervised Learning

  13. Self-Supervised Consistency Enhanced Disentangled Learning for Neural Decoding Generalization in Brain-Machine Interface

    Jul 27, 2026Jiyu Wei, Di Hong, Zhanjie Zhang +3Disentangled Representation LearningBrain-Computer Interfaces

  14. Unbiased Open World Regularization for Fair Self-Supervised Learning

    Jul 24, 2026Léo Nicollier, Marc Pic, Pablo Musé +2Self-Supervised LearningDistribution Matching

  15. TextSLIP: Text Self-Supervised CLIP for Medical Report Generation

    Jul 24, 2026Haoyu Jiang, Ziping CongRadiology Report GenerationSelf-Supervised Learning

  16. Representation learning of human cortical folding to reveal long lasting neurodevelopmental signatures

    Jul 22, 2026Julien Laval, Robin Guiavarch, Antoine Dufournet +24Representation LearningSelf-Supervised Learning

  17. DINS-IO: Learned Inertial Odometry via Differentiable INS Consistency

    Jul 22, 2026Hao Qiao, Yan Wang, Jian Kuang +1Inertial OdometrySelf-Supervised Learning

  18. Sentence Splitter: Uncovering Latent Factual Structure for Self-Supervised Learning

    Jul 22, 2026Ahmad Pouramini, Mahsa AfsharizadehSelf-Supervised Learning

  19. Physical Self-Supervised Learning: IMU Sensing without Manual Labels

    Jul 20, 2026Yuyang Leng, Renyuan Liu, Shaohan Hu +4Self-Supervised LearningPhysics-Informed ML

  20. WiFi-JEPA: Self-supervised Learning for WiFi-CSI 3D Human Pose Estimation

    Jul 13, 2026Doeon Kim, Jungyoon Lee, Seongsin Kim +1Self-Supervised LearningJoint-Embedding Predictive Architecture

  21. Design Choices in Splitting-Based Self-Supervised Sparse-View CT Reconstruction

    Jul 12, 2026Nadja Gruber, Lukas Neumann, Ander Biguri +3Self-Supervised LearningSparse-View CT Reconstruction

  22. TOLiD: Bridging the Architecture Gap in Vision Foundation Model to LiDAR Pretraining via Token Lifting for Distillation

    Jul 12, 2026Sutharsan Mahendran, Darshana Priyasad, Kaushik Roy +4Cross-Modal Knowledge DistillationSelf-Supervised Learning

  23. MeloBottleneck: Self-Supervised Melody Skeleton Extraction with a Latent Subsequence Bottleneck

    Jul 11, 2026Fan Bu, Rongfeng Li, Linfeng FanSelf-Supervised LearningMusic Information Retrieval

  24. Lifelong Representations: A Survey on Continual Self-Supervised Learning for Vision Models

    Jul 8, 2026Sergi Masip, Alicja Dobrzeniecka, Jonathan Swinnen +4Self-Supervised LearningSelf-Supervised Visual Representation Learning

  25. `Attention-Guided Cross-Temporal Clustering for Self-Supervised Video Object Segmentation

    Jul 8, 2026Waqas Arshid, Mohammad Awrangjeb, Alan Wee-Chung Liew +1Video Object SegmentationSelf-Supervised Learning

  26. Converge to Surprise: Evolutionary Self-supervised Image Clustering

    Jul 8, 2026Canlin Zhang, Xiuwen LiuUnsupervised LearningSelf-Supervised Learning