Self-Supervised Learning

Ask about this topic

Momentum

37 papers in the last four weeks, up 429% on the four weeks before. 0.4% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 273

All topics
CardsList

  1. Increasing Width Allows Greedy Layer-wise Training to Rival End-to-End Backpropagation in Self-Supervised Learning

    Sep 30, 2026Syon Mansur, Joel ZylberbergBackpropagationLayer-Wise

    Jules Stein Eye Institute University of California, Los Angeles Los Angeles, CA 90095, USA

  2. Reformulation-Contrastive Learning for Mixed Integer Programs

    Sep 30, 2026Ousema Bouaneni, Mathis Le Bail, Clément Elliker +2Mixed-Integer ProgrammingLinear Programming

    LIX (École Polytechnique, IP Paris, CNRS) · AMIAD (Agence Ministérielle pour l’IA de Défense)

  3. JEPA-TTT: Persistent Test-Time Training of Latent World Models for Planning under Dynamics Shifts

    Sep 30, 2026Zheyuan Zhang, Suyu Ye, Nakul Agarwal +5Latent World ModelsTest-Time Training

    Honda Research Institute USA · Johns Hopkins University

  4. I Have a Stream: Making Self-Supervised Learning Work on Continuous Video

    Sep 30, 2026Ivan Martinović, Lukas Knobel, Yuki M. AsanoSelf-Supervised LearningVideo Dataset

    Faculty of Electrical Engineering and Computing, University of Zagreb · Fundamental AI Lab, University of Technology Nuremberg

  5. VANDAM: Viewing a nucleotide sequence with DNA molecular priors

    Sep 30, 2026Jeremy Levy, Ariel Larey, Yury Nahshan +18Genome-Wide Association StudySequence Modeling

    Applied AI Architecture, NVIDIA, Israel. · Worldwide Field Ops, NVIDIA, Israel. · Developer Programs, NVIDIA, Israel. +3

  6. A Width-Matched Comparison of Hybrid Quantum-Classical Self-Supervised Learning for Fingerprint Recognition

    Sep 30, 2026Maria S. Edwards, Kidwell Dlamini, Pin-An Lin +2FingerprintSelf-Supervised Learning

    Department of Computer Science and Information Engineering, National Dong Hwa University, Hualien, Taiwan · Department of Computer Science and Information Engineering, National Chiayi University, Chiayi City, Taiwan

  7. Online Evolution Strategy for Flow-Matching VLA Policies via Self-Supervised Trajectory Distribution Optimization

    Sep 30, 2026Gongxin Yao, Yongsheng Zhao, Jiayin Deng +4Flow-Matching Vision-Language-ActionFlow Policies

    China Mobile (Hangzhou) Information Technology Co., Ltd., Hangzhou, 311121, China

  8. Which Tasks Survive Self-Supervised Learning?

    Sep 29, 2026Achleshwar Luthra, Lucas Bryant, Tracy Zhu +1Self-Supervised LearningWhitening

    Department of Computer Science and Engineering Texas A&M University

  9. TrackFish3D: Self-Supervised 3D Tracking of Schooling Fish from Multi-view Videos

    Sep 29, 2026Patt Phurtivilai, Zhiyang Dou, Yifan Wu +53D TrackingMulti-Object Tracking

    The University of Hong Kong, Hong Kong, China · Centre for Transformative Garment Production · Hong Kong University of Science and Technology, Hong Kong, China +1

  10. Masked Swingers: Harnessing Data Augmentation to Advance Autoencoders for Self-Supervised Learning

    Sep 29, 2026Anthony Fuller, Scott C. Lowe, Daniel G. Kyrollos +3Self-Supervised LearningAutoencoder Architectures

    Vector Institute · Carleton University · University of Guelph +1

  11. GLaS-JEPA: Gaussian-Regularized Speech SSL without Engineered Prediction Targets

    Sep 29, 2026Gaspard Botté, Séverin Baroudi, Samir Sadok +5Discrete Speech RepresentationsSpeech Encoder

    Concordia University · Mila – Qu´ebec AI Institute · Univ Toulon, Aix Marseille Univ, CNRS, LIS +4

  12. Improving Generative Model Self-Training with Geometrically Modified Outputs

    Sep 28, 2026Patrick Batsell, Thomas Walker, Richard BaraniukGenerative ModelsSelf-Supervised Learning

    Department of Electrical and Computer Engineering Rice University Houston, TX 77005, USA

  13. Handwritten Text Recognition Lives in the High-Pixel Variance Subspace

    Sep 28, 2026Carlos Garrido-Munoz, Jorge Calvo-ZaragozaHandwritten Text RecognitionHandwriting

    University of Alicante, Spain

  14. W2Rep: Learning Visual Representations by Watching the World Change

    Sep 28, 2026Wen Huang, Hang Guo, Jiarui Yang +3Fine-Grained Video UnderstandingVision Encoders

    Tsinghua Shenzhen International Graduate School, Tsinghua University, Shenzhen, China · Nankai University, Tianjin, China · Shenzhen University, Shenzhen, China

  15. GLAD: Global-Local Adaptive Detector for Robust Speech Deepfake Detection

    Sep 28, 2026Zelin Zhao, Guanjie Huang, Danny Hin Kwok Tsang +1Audio Deepfake DetectionSpeech Synthesis

    The Hong Kong University of Science and Technology (Guangzhou)

  16. Generative Uncertainty as a Self-supervised Signal for Semantic Similarity Learning

    Sep 28, 2026Enrico Pallotta, Sina Raoufi, Lars Doorenbos +2Deep Semantic RepresentationsSelf-Supervised Learning

    University of Bonn · Lamarr Institute for ML & AI · ENSTA Paris, Institut Polytechnique de Paris

  17. λλ-JEPA Spectral Anti-Collapse Regularization for Self-Supervised Learning

    Sep 28, 2026Berker Demirel, Clémentine Dominé, Valentino Maiorca +3Self-Supervised LearningRegularization

    Institute of Science and Technology Austria (ISTA) Am Campus 1, 3400 Klosterneuburg, Austria

  18. Compute Time Scaling with Recursive Models for Combinatorial Optimization

    Sep 28, 2026Zhengxi Zhang, Paul SwobodaCombinatorial OptimizationNeural Solvers

  19. A Light Bilevel Refinement Aligns Self-Supervised Representations for Stronger Task-Specific Learning

    Sep 27, 2026Gustav Wagner Zakarias, Zheng-Hua TanSelf-Supervised LearningBilevel Optimization

    Aalborg University · Pioneer Centre for Artificial Intelligence, Denmark

  20. RD-JEPA: Predictive latent pretraining for few-trajectory transfer across reaction--diffusion equations

    Sep 24, 2026Chenhao Si, Ming YanLatent PredictionSurrogate Models

    School of Data Science, The Chinese University of Hong Kong, Shenzhen, Shenzhen, China

  21. Spooftral: Can Voxtral Audio-Language Model Detect Speech Spoofing?

    Sep 23, 2026Avishai Weizman, Yehuda Ben-Shimol, Itshak LapidotSpoofingSelf-Supervised Speech Models

    School of Electrical and Computer Engineering, Ben-Gurion University of the Negev, Israel · Department of Electrical Engineering, Afeka the Academic College of Engineering, Israel · Avignon University, LIA, France

  22. Physics-Informed Self-Supervised Learning for Joint Wire Calibration and Interaction Position Reconstruction in Multi-Wire Parallel Plate Avalanche Counters

    Sep 23, 2026Antoine Lemasson, Maurycy RejmundSelf-Supervised LearningWiring

    GANIL, CEA/DRF - CNRS/IN2P3, Bd Henri Becquerel, BP 55027, F-14076 Caen Cedex 5, France.

  23. Two Global Crops Suffice: Locating Semantic Emergence in DINO-Style Self-Supervised Learning

    Sep 23, 2026Basavaraj Sunagad, Artur Jesslen, Adam KortylewskiSelf-Supervised LearningDino

    CISPA Helmholtz Center for Information Security · University of Freiburg

  24. Self-Supervised Combinatorial Optimization with Constraints via Frank-Wolfe

    Sep 22, 2026Akbar Rafiey, Yifei Xu, Nikolaos KaraliasNeural Combinatorial OptimizationCombinatorial Optimization

    NYU · MIT

  25. A JEPA Recipe for Tabular Foundation Models

    Sep 22, 2026Mingyu Jeon, Suwan Cho, Jae Young SuhTabular Foundation ModelsJoint-Embedding Predictive Architectures

    Modulabs, Seoul, Republic of Korea

  26. Toward a foundation model for forest point clouds

    Sep 21, 2026Yuanwen Yue, Stefano Puliti, Damien Robert +7ForestsForest Biomass

    ETH Zurich · University of Oxford · Norwegian Institute of Bioeconomy Research (NIBIO) +1

  27. End-to-end Jordanian dialect speech-to-text self-supervised learning framework

    Sep 21, 2026Ali A. Safieh, Ibrahim Abu Alhaol, Rawan GhnematSelf-Supervised Speech ModelsArabic Natural Language Processing

    Data Science Department, King Hussein School of Computing Sciences, Princess Sumaya University for Technology, Amman, Jordan

  28. Tactile-JEPA: Topology-Aware Self-Supervised Representation Learning for Distributed Tactile Sensors

    Sep 21, 2026Elizaveta Kovtun, Matvey Konovalov, Andrey Sakhovskiy +1TactileGround Reaction Forces

    Sber AI, Moscow, Russia · Skolkovo Institute of Science and Technology (Skoltech), Moscow, Russia · HSE University, Moscow, Russia +1

  29. TReViS: Temporal Repetition Structure Aware Video Synthesis for Self-supervised Repetitive Action Counting

    Sep 21, 2026Fanqi Yu, Shengming Ma, Stefano Fiorini +4Video DatasetSelf-Supervised Learning

    AIGO Unit, Istituto Italiano di Tecnologia, Genoa, 16152, Italy · University of Genoa, Genoa, 16152, Italy · Independent Researcher, China +2

  30. Enhancing Shrimp Disease Detection via Deep Learning and Data Refinement for Resilient Aquaculture

    Sep 20, 2026Vinh Canh-Thanh Truong, Hai-Binh Pham, Ngoc Hong TranLeaf Disease ClassificationVision Transformer

    Computer Science Program Vietnamese-German University Ho Chi Minh City, Vietnam

  31. Similarity Pairing with Energy Mover's Distance for Self-Supervised Pre-Training at the LHC

    Sep 15, 2026Ho Fung Tsoi, Dylan RankinSelf-Supervised LearningSelf-Distillation Framework

    Department of Physics and Astronomy University of Pennsylvania, USA

  32. Self-Supervised Learning for Robust Resonance Mass Regression in Cascade Decays

    Sep 15, 2026Ho Fung Tsoi, Alex Yang, Luis Felipe Gutierrez Zagazeta +2Self-Supervised LearningTransformer Encoder

    Department of Physics and Astronomy University of Pennsylvania, USA · Department of Physics Kyoto University, Japan

  33. Distributed JEPA: A Self-Supervised Framework for Energy Forecasting

    Sep 15, 2026Liana Toderean, Tudor Cioara, Vasilis Michalakopoulos +3Energy ForecastingJoint-Embedding Predictive Architectures

    Distributed Systems Research Laboratory, Computer Science Department, Technical University of Cluj-Napoca, G. Barițiu 26-28, 400027 Cluj-Napoca, Romania · Decision Support Systems Laboratory, School of Electrical & Computer Engineering, National Technical University of Athens, Ir. Politechniou 9, 157 73 Athens, Greece

  34. Which Pretext Task Transfers? Self-Supervised Pretraining Objectives for Lung Ultrasound

    Sep 15, 2026Moein Heidari, Junbo Rao, Jai Choraria +3UltrasoundSelf-Supervised Learning

    University of British Columbia, Vancouver, BC, Canada · Rutgers Cancer Institute of New Jersey, New Brunswick, NJ, USA

  35. MAST: Label-Efficient, Robust, and Generalizable Sound Detection for Biodiversity Monitoring via Masked Audio Pretraining and Self-Training

    Sep 14, 2026Tianyi Xu, Daniel Pimentel-Alarcón, Zuzana Buřivalová +1Passive Acoustic MonitoringSound Event Detection

    University of Wisconsin–Madison

  36. Self-supervised Pre-training Helps Retinal Disease Progression Modelling Most When Data Is Scarce

    Sep 14, 2026Ifeoma Veronica Nwabufo, Julius Gervelmeyer, Sarah Müller +1Self-Supervised LearningLongitudinal Imaging

    Hertie Institute for AI in Brain Health, Faculty of Medicine, University of Tübingen, Germany · Tübingen AI Center, University of Tübingen, Germany

  37. BRIDGE-EEG: Bridging Self-Supervised Pretraining and Efficient Deployment for Cross-Dataset EEG Classification

    Sep 14, 2026Meghna Roy Chowdhury, Chengwei Zhou, Haotian Yu +2Electroencephalography Foundation ModelsElectroencephalography

    Purdue University, Indiana, USA · Case Western University, Ohio, USA

  38. Is Semantics Enough for Speech Mean Opinion Score Prediction?

    Sep 3, 2026Tianyu Lan, Yufei Shi, Yang Ai +3Mean Opinion ScoresSpeaker

    National Engineering Research Center of Speech and Language Information Processing, University of Science and Technology of China, Hefei, China

  39. Pix2Rep-v2: Data-Efficient Representation Learning for Dense Medical Imaging Applications

    Sep 1, 2026S. Sifaoui, E. Angelini, S. Toupin +2Self-Supervised RepresentationsDense Prediction

    LTCI, Télécom Paris, Institut Polytechnique de Paris, Palaiseau, France · MIRACL.ai Laboratory, Hôpital Universitaire Lariboisière (AP-HP), Paris, France · Université Paris Cité, Inserm MASCOT, Paris, France

  40. Physics-Driven Independent Pair Generation for Iterative Self-Supervised Low-Dose CT Denoising

    Sep 1, 2026Xianlei Han, Shaoyu Wang, Jiancheng Fang +2Positron Emission TomographyCone-Beam Computed Tomography

    School of Mathematics and Computer Sciences, Nanchang University, Nanchang 330031, China · School of Information Engineering, Nanchang University, Nanchang 330031, China · School of Biomedical Engineering, Sun Yat-sen University, Shenzhen 510275, Guangdong, China

  41. Three Steps at a Time: Learning Representations from Action Sequences in Contrastive RL

    Aug 31, 2026Michal Korniak, Kamil Dybek, Benjamin Eysenbach +2Action ChunksAction Sequences

    ETH Zurich · University of Warsaw · Princeton University +3

  42. Self-Supervised Pretext Tasks for Infant Cry Analysis: A Controlled Comparison and a Cautionary Result on Donateacry

    Aug 31, 2026Luigi SimeoneSelf-Supervised LearningSpeech Encoder

    Independent researcher

  43. Scalable Self-Supervised Learning for Multiphase AC-OPF in Distribution Systems with Topology Reconfiguration

    Aug 25, 2026Hoang T. Nguyen, Shaohui Liu, Reetam Sen Biswas +4Optimal Power FlowSelf-Supervised Learning

    Massachusetts Institute of Technology, Cambridge, MA, USA. · GE Vernova Advanced Research Center, Niskayuna, NY, USA.

  44. A Controlled Study of Self-Supervised Image and Video Pretraining under Limited Resources

    Aug 13, 2026Brunó B. Englert, Gijs DubbelmanSelf-Supervised LearningVision Foundation Models

    Eindhoven University of Technology

  45. Fourier Self-Supervision for Fine-Grained Generalized Category Discovery

    Aug 9, 2026Sarah Rastegar, Mina Ghadimi Atigh, Pascal Mettes +2Generalized Category DiscoveryFine-Grained Perception

    University of Amsterdam · University of Technology Nuremberg

  46. Three Necessary Principles for Self-Supervised Visual Representation Learning

    Aug 8, 2026Nikos Giakoumoglou, Paschalis Giakoumoglou, Tania StathakiSelf-Supervised RepresentationsSelf-Supervised Learning

    Imperial College London · CERTH, ITI

  47. Vernata: Self-Supervised Learning of LiDAR Point Representations

    Aug 7, 2026Oliver Lemke, Alexander Liniger, Abel Gawel +1Light Detection And Ranging Point CloudsSelf-Supervised Learning

    1Robotics and AI Institute · 2ETH Zurich

  48. Is Self-Pretraining really useful to improve diagnosis in medical Time Series?

    Aug 6, 2026Omar Coser, Antonio Orvieto, Paolo Soda +1Spatio-Temporal TransformersTime Series

    Unit of Artificial Intelligence & Computer Systems, Universit`a Campus Bio-Medico di Roma, Via ´Alvaro del Portillo, 21, Rome, 00128, Italy. · Unit of Advanced Robotics and Human-Centered Technologies, Universit`a Campus Bio-Medico di Roma, Via ´Alvaro del Portillo, 21, Rome, 00128, Italy. · Max Planck Institute for Intelligent Systems +2

  49. Spectral Aliasing Pretext: A novel task for Self-Supervised fault diagnosis in rotating machinery

    Aug 6, 2026Victor Gialis, Maxime Metz, David Esteve +1Fault DiagnosisSelf-Supervised Learning

    LASPI, Univ. Jean Monnet, Roanne, 42300, France · Pellenc ST, Applied Research Group, Pertuis, 84120, France · LabCom Aioly, Artificial Intelligence and Optics Laboratory, Montpellier, 34196, France +1

  50. Lesion Detection in CT with Frozen Self-Distilled Features: SALT, a Spatially Adaptive Label-Guided Temperature

    Aug 5, 2026Mahmut S. Gokmen, Evan W. Damron, Mitchell A. Klusty +3LesionSelf-Supervised Learning

    University of Kentucky Lexington, KY, USA · University of Louisville Louisville, KY, USA

  51. NodeJEPA: Structure-Conditioned Latent Prediction for Node-Level Graph Self-Supervised Learning

    Aug 5, 2026Tinghe Zhang, Jian Xu, Jiaheng Chen +3Joint-Embedding Predictive ArchitecturesGraph Representation Learning

    1Northeastern University

  52. Attention-Only White-Box Transformer via LeJEPA-Based Self-Supervised Pretraining

    Aug 4, 2026Yang Bai, Linyuan Wang, Haoyang Jiang +3Transformer AttentionSelf-Supervised Learning

    Information Engineering University, ZhengZhou,China

  53. ED-DiT: Physics-Guided Diffusion Pretraining for Transferable Molecular Representations from Electron Density

    Aug 4, 2026Liang Shuang, Haocheng Wang, Jiayi Song +2Physics-Guided DiffusionSelf-Supervised Learning

    Fudan University, Shanghai, China · Shenzhen Loop Area Institute, Shenzhen, China · The Chinese University of Hong Kong, Hong Kong SAR, China

  54. Scaling an Autoregressive Transformer for Single-Cell Generation

    Aug 3, 2026Aleksandr Sharipov, Yusif Mukhtarov, Igor MolybogAutoregressive TransformersSingle-Cell Rna

    HawAII, University of Hawai’i at Manoa

  55. Self-Supervised Representations for Binary Program Clustering: From Empirical Study to Retrieval-Augmented Learning

    Aug 3, 2026Martin Mocko, Daniela ChudáMalwareClustering

    Faculty of Information Technology, Brno University of Technology, Brno, Czech Republic · Kempelen Institute of Intelligent Technologies (KInIT), Bratislava, Slovakia · Faculty of Electrical Engineering and Information Technology, Slovak University of Technology, Bratislava, Slovakia

  56. Multi-Backbone Self-Supervised Ensembles for Audio Deepfake Detection and a Cross-Track Analysis of Generation-Detection Asymmetry

    Aug 3, 2026Seunghyun Kim, Junghyun Kim, Jiyoung WooAudio Deepfake DetectionAudio Understanding

    Soonchunhyang University, Department of AI and Big Data Engineering, Asan, Republic of Korea

  57. Asleep at the Wheel: JEPA's Limitations in Evaluating Novel Driving Data

    Aug 2, 2026Advait Pavuluri, Shamik Karkhanis, Uzma MushtaqueNaturalistic Driving DataVideo Joint Embedding Predictive Architecture

    Rensselaer Polytechnic Institute, Troy, NY, USA

  58. Self Supervised Learning from Automatically Generated Demonstrations for Visual Robotic Manipulation

    Aug 1, 2026Andres Rivas, Anselmo R. Cukla, Rodrigo S. Guerra +2Robotic ManipulationSelf-Supervised Learning

    Robotics and AI Lab, Technological University of Uruguay, Rivera, Uruguay · Center of Technology, Federal University of Santa Maria, Santa Maria, Brazil · Computer Science Center, Federal University of Rio Grande, Rio Grande, Brazil

  59. REIMU: Efficient Heterogeneous Hierarchical Reasoning for SSL-Based Speech Deepfake Detection

    Aug 1, 2026Kwok-Ho Ng, Tingting Song, Bingwen Feng +1Audio Deepfake DetectionVoice Conversion

    College of Cyber Security, Jinan University, Guangzhou, China

  60. HP-JEPA: Hierarchical Partitioning for Multi-Resolution Graph Joint-Embedding Predictive Learning

    Aug 1, 2026Ruichen Xu, Jingxiang Qu, Wenhan Gao +5Graph Representation LearningPartitioning

    Department of Applied Mathematics and Statistics Stony Brook University Stony Brook, NY, USA · Department of Computer Science Stony Brook University Stony Brook, NY, USA · TikTok Bellevue, WA, USA +2