Self-Supervised Visual Representation Learning

Follow this topic Ask about this topic

Momentum

20 papers in the last four weeks, up 100% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 151

All topics

Shared Gaussianization: What Gaussian Regularizers Certify About Contrastive Learning, and What They Miss
Oct 7, 2026Ruoyu Zhao, Yuting Chen, Jinheng Zhang +2Contrastive Learning Self-Supervised Visual Representation Learning
City University of Hong Kong · Georgia Institute of Technology · University of Pennsylvania +2
Scalable Patch-Level Self-Supervised Learning
Oct 7, 2026Maximilian Seitzer, Gabriele Trivigno, Antonín Vobecký +5Self-Supervised Learning Self-Supervised Visual Representation Learning
Meta FAIR
DisParQ: Self-Supervised Part Concepts for Interpretable Vision Foundation Models
Oct 7, 2026Adam Pardyl, Siddhartha Gairola, Sukrut Rao +4Explainable Image Classification Vision Foundation Models
Jagiellonian University, Faculty of Mathematics and Computer Science · Jagiellonian University, Doctoral School of Exact and Natural Sciences · Max Planck Institute for Informatics, Saarland Informatics Campus +2
Unlocking Fine-Grained Perception in CLIP via Structurally-Aware Latent Masked Modeling
Oct 6, 2026Juntong Li, Lingwei Dang, Haomin Wu +3VLM Adaptation Dense Prediction
School of Software Engineering, South China University of Technology
From Pixels, Without Pre-training: Joint Generative and Self-Supervised Representation Learning in One Model
Oct 5, 2026Vicente Balmaseda, Ching-Long Lin, Tianbao YangRepresentation Learning Image Generation
Department of Computer Science and Engineering Texas A&M University College Station, TX, USA · Mechanical Engineering University of Iowa Iowa City, IA, USA
CI-JEPA: A Counterfactual Analysis of Latent Representations in Joint-Embedding Predictive Architectures for Self-Supervised Learning
Oct 4, 2026Mintu Dutta, Ritesh Vyas, Mohendra Roy *Causal Representation Learning Joint-Embedding Predictive Architecture
Department of Information and Communication Technology, Pandit Deendayal Energy University, Gandhinagar, Gujarat, India · Department of Electrical and Electronics Engineering, Birla Institute of Technology & Science, Pilani, Rajasthan, India
The hidden advantage of mask resampling: a theory of masked autoencoders
Oct 1, 2026Jorge Medina Moreira, Lorenzo Bardone, Lenka ZdeborováMasked Autoencoders Masked Language Modeling
Statistical Physics of Computation Laboratory, École Polytechnique Fédérale de Lausanne (EPFL), CH-1015 Lausanne, Switzerland
Increasing Width Allows Greedy Layer-wise Training to Rival End-to-End Backpropagation in Self-Supervised Learning
Sep 30, 2026Syon Mansur, Joel ZylberbergDeep Learning Optimization Convolutional Neural Networks
Jules Stein Eye Institute University of California, Los Angeles Los Angeles, CA 90095, USA
I Have a Stream: Making Self-Supervised Learning Work on Continuous Video
Sep 30, 2026Ivan Martinović, Lukas Knobel, Yuki M. AsanoMasked Autoencoders Self-Supervised Learning
Faculty of Electrical Engineering and Computing, University of Zagreb · Fundamental AI Lab, University of Technology Nuremberg
Emergent Multi-View Geometry Through Self-Distillation
Sep 30, 2026David Nordström, Thibaut Loiseau, Vincent Lepetit +3Multi-View Geometry Multi-View 3D Reconstruction
Chalmers University of Technology, Sweden · LIGM, Ecole des Ponts, Univ. Gustave Eiffel, CNRS, France · Linköping University, Sweden +1
Masked Swingers: Harnessing Data Augmentation to Advance Autoencoders for Self-Supervised Learning
Sep 29, 2026Anthony Fuller, Scott C. Lowe, Daniel G. Kyrollos +3Masked Autoencoders Invariant Representation Learning
Vector Institute · Carleton University · University of Guelph +1
End-to-End Self-Supervised RGB-T Tracking without Modality Misleading
Sep 29, 2026Shenglan Li, Rui Yao, Kunyang Sun +4Multimodal Robustness Visual Object Tracking
School of Computer Science and Technology / School of Artificial Intelligence, China University of Mining and Technology, China. · Mine Digitization Engineering Research Center of the Ministry of Education, China. · University of Auckland, Auckland, New Zealand. +1
Representation by Design in Generation: Cross-View Class-Token Alignment in Diffusion Transformers
Sep 28, 2026Xiaoyu Wu, Yifei Wang, Chen WeiFlow Matching Diffusion Transformer
Carnegie Mellon University · Rice University
Sparse-View Interpretable 3D Animal Behavior Representations for Neural Encoding and Decoding
Sep 28, 2026Xinming Dai, Qihang Jin, Tianshu Tan +8Representation Learning Sparse-View 3D Reconstruction
Columbia University · University of Science and Technology of China · Harvard University +3
W2Rep: Learning Visual Representations by Watching the World Change
Sep 28, 2026Wen Huang, Hang Guo, Jiarui Yang +3Video Representation Learning Self-Supervised Visual Representation Learning
Tsinghua Shenzhen International Graduate School, Tsinghua University, Shenzhen, China · Nankai University, Tianjin, China · Shenzhen University, Shenzhen, China
Generative Uncertainty as a Self-supervised Signal for Semantic Similarity Learning
Sep 28, 2026Enrico Pallotta, Sina Raoufi, Lars Doorenbos +2Video Representation Learning Feature Selection
University of Bonn · Lamarr Institute for ML & AI · ENSTA Paris, Institut Polytechnique de Paris
$λ$ -JEPA Spectral Anti-Collapse Regularization for Self-Supervised Learning
Sep 28, 2026Berker Demirel, Clémentine Dominé, Valentino Maiorca +3Spectral Regularization Joint-Embedding Predictive Architecture
Institute of Science and Technology Austria (ISTA) Am Campus 1, 3400 Klosterneuburg, Austria
A Light Bilevel Refinement Aligns Self-Supervised Representations for Stronger Task-Specific Learning
Sep 27, 2026Gustav Wagner Zakarias, Zheng-Hua TanFine-Tuning Bilevel Optimization
Aalborg University · Pioneer Centre for Artificial Intelligence, Denmark
When Does Geometric View Synthesis Help Wine Label Retrieval? A Public One-Shot Benchmark Across Self-Supervised and Vision-Language Backbones
Sep 27, 2026Yueh-Cheng HuangVLM Adaptation Novel View Synthesis
Department of Computer Science and Information Engineering, National Dong Hwa University, Hualien 974301, Taiwan
Conditional Predictive Sufficient Statistics for Visual Representation Learning
Sep 25, 2026Yuzhou HongVisual Representation Learning Predictive Representation Learning
Zhejiang Sci-Tech University
Learning a Flow to Self-Supervised Representations
Sep 24, 2026Yuling Jiao, Wensen Ma, Houduo Qi +1Flow Matching Representation Learning
School of Artificial Intelligence, National Center for Applied Mathematics in Hubei, Hubei Key Laboratory of Computational Science, Wuhan University, Wuhan, China. · Department of Applied Mathematics, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong SAR, China. · Department of Data Science and Artificial Intelligence, The Hong Kong Polytechnic University, Hung Hom, Kowloon, Hong Kong SAR, China.
Two Global Crops Suffice: Locating Semantic Emergence in DINO-Style Self-Supervised Learning
Sep 23, 2026Basavaraj Sunagad, Artur Jesslen, Adam KortylewskiMulti-View Learning Self-Distillation
CISPA Helmholtz Center for Information Security · University of Freiburg
Positive Pair Geometry Matters: Optimal Transport for Contrastive Learning of Visual Representations
Sep 21, 2026Akshit Nanda, Shahzad Ahmad, Ram Prasad PadhyContrastive Learning Data Augmentation
Department of Computer Science and Engineering, Indian Institute of Technology Bhubaneswar · Østfold University of Applied Sciences, NTNU
Vision Transformers versus convolutional neural networks for fine-grained orchid genus identification in a species-rich, data-poor flora: a controlled benchmark on the Orchidaceae of New Guinea
Sep 21, 2026Reza Saputra, Diah Harnoni Apriyanti, André Schuiteman +4Vision Transformer Fine-Grained Image Retrieval
College of Science and Engineering, James Cook University. McGregor Rd, Smithfield, Cairns, QLD 4878, Australia · Southwest Papua Natural Resources Conservation Agency, Ministry of Forestry, Indonesia. Jalan Klamono KM 16, Sorong, Southwest Papua Province, Indonesia · The Directorate of Scientific Collection Management, National Research and Innovation Agency (BRIN), Republic of Indonesia, Gedung Kehati, KST Soekarno BRIN, Jl. Raya Jakarta - Bogor KM 46, Cibinong, Kabupaten Bogor, Jawa Barat, 16911, Indonesia. +5
ParticleSplat: Self-supervised Object-centric Latent Particle Splatting
Sep 16, 2026Lyuxing He, Daniel Guo, Elizabeth Terveen +33D Gaussian Splatting Object-Centric Representation Learning
Robotics Institute, Carnegie Mellon University
CoViT: Instance-Correspondence Contrastive Learning for Vision Transformer
Sep 1, 2026Yisen Wang, Zhirong Wu, Limin WangContrastive Learning Instance Segmentation
State Key Laboratory for Novel Software Technology Nanjing University, China
Benchmarking Spatial, Spectral, and Self-Supervised Cues for Face Forgery Detection under Realistic Degradation
Sep 1, 2026Lucas Cunha, Lucas Sotomaior, Lucas Gasperin +3Image Corruption Robustness Image Forgery Detection
Pontifical Catholic University of Paraná, Curitiba, Brazil
Pix2Rep-v2: Data-Efficient Representation Learning for Dense Medical Imaging Applications
Sep 1, 2026S. Sifaoui, E. Angelini, S. Toupin +2Representation Learning Visual Representation Learning
LTCI, Télécom Paris, Institut Polytechnique de Paris, Palaiseau, France · MIRACL.ai Laboratory, Hôpital Universitaire Lariboisière (AP-HP), Paris, France · Université Paris Cité, Inserm MASCOT, Paris, France
CMRVision: A Foundation Model for Cardiac MR Image Analysis
Sep 1, 2026Athira J. Jacob, Puneet Sharma, Daniel RueckertMedical Imaging Foundation Models Medical Image Classification
Digital Technology and Innovation, Siemens Healthineers, Princeton, NJ, USA · Chair for Al in Healthcare and Medicine, Technical University of Munich (TUM) and TUM University Hospital, Munich, Germany · Department of Computing, Imperial College London, UK
ViTAMINS: An Empirical Study of Training Self-Supervised Vision Transformers with Synthetic Hard Negatives
Sep 1, 2026Nikos Giakoumoglou, Andreas Floros, Kleanthis-Marios Papadopoulos +1Contrastive Learning Vision Transformer
Imperial College London
Motion-Saliency Complementary Masked Modeling for Point Cloud Video Understanding
Aug 31, 2026Wei Wang, Yiding Sun, Yuyan Wang +4Point Cloud Learning Generative Modeling
School of Computer Science and Technology, Xi’an Jiaotong University, Xi’an, 710049, China · Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ), Shenzhen, 518107, China · School of Software Engineering, Xi’an Jiaotong University, Xi’an, 710049, China +4
DINOcular: Self-Supervised Visuospatial Representations
Aug 27, 2026Farkhat Almukhamedov, Sami Azirar, Hermann BlumVisual Representation Learning Geometric Representation Learning
Robot Perception and Learning Lab University of Bonn & Lamarr Institute
RIPE++: Reinforced Keypoint Learning from Positive Pairs Only
Aug 20, 2026Johannes Künzel, Peter Eisert, Anna HilsmannRepresentation Learning Reinforcement Learning
Fraunhofer Heinrich-Hertz-Institute, HHI, Germany · Humboldt University Berlin, Germany
A Controlled Study of Self-Supervised Image and Video Pretraining under Limited Resources
Aug 13, 2026Brunó B. Englert, Gijs DubbelmanVision Foundation Models Self-Supervised Pre-Training
Eindhoven University of Technology
SAR2Agri: Learning SAR Intensity Representations for Agricultural Monitoring
Aug 11, 2026Moti Rattan Gupta, Anupam SobtiRepresentation Learning Agricultural Remote Sensing
Plaksha University, Mohali, Punjab, India
Fourier Self-Supervision for Fine-Grained Generalized Category Discovery
Aug 9, 2026Sarah Rastegar, Mina Ghadimi Atigh, Pascal Mettes +2Frequency-Domain Feature Learning Fine-Grained Image Classification
University of Amsterdam · University of Technology Nuremberg
Three Necessary Principles for Self-Supervised Visual Representation Learning
Aug 8, 2026Nikos Giakoumoglou, Paschalis Giakoumoglou, Tania StathakiContrastive Learning Representation Collapse
Imperial College London · CERTH, ITI
UniJEPA: A Unified Joint-Embedding Predictive Architecture for Task-Agnostic Visual World Modeling
Aug 7, 2026An Lanji, Dawei Liu, Jin Li +3World Model Learning Joint-Embedding Predictive Architecture
University of Electronic Science and Technology of China, Chengdu, China.
Learning visual representations for compositional analysis of artworks and photographs
Aug 6, 2026Fatemeh Behrad, Tinne Tuytelaars, Johan WagemansVisual Representation Learning Compositional Representation Learning
KU Leuven University Belgium
Attention-Only White-Box Transformer via LeJEPA-Based Self-Supervised Pretraining
Aug 4, 2026Yang Bai, Linyuan Wang, Haoyang Jiang +3Vision Transformer Efficient ViTs
Information Engineering University, ZhengZhou,China
Self-supervised DXA representations encode multi-system disease risk, biological aging and heritability
Aug 3, 2026Gil Sasson, Zachary Levine, Smadar Shilo +9Medical Imaging Medical Image Representation Learning
Department of Computer Science and Applied Mathematics, Weizmann Institute of Science, Rehovot, Israel. · Gray Faculty of Medical and Health Sciences, Tel Aviv University, Tel-Aviv, Israel. · The Jesse Z and Sara Lea Shafer Institute for Endocrinology and Diabetes, National Center for Childhood Diabetes, Schneider Children’s Medical Center of Israel, Petah Tikva, Israel. +5
Physics-Aligned Self-Supervised Learning for Scientific Imaging
Jul 30, 2026Bashir Kazimi, Stefan SandfeldData Augmentation Scientific ML
Institute for Materials Data Science and Informatics (IAS-9), Forschungszentrum Jülich GmbH, 52425, Jülich, Germany · Chair of Materials Data Science and Materials Informatics, Faculty 5 – Georesources and Materials Engineering, RWTH Aachen University, 52056, Aachen, Germany
OrganLens: Organ-Specific Representation Learning for CT Foundation Models
Jul 28, 2026Zhixuan Ge, Anqi Li, Sadeer Al-Kindi +2Medical Imaging Foundation Models Representation Learning
Rice University Houston, Texas, USA · Department of Cardiology DeBakey Heart and Vascular Center Houston, Texas, USA · University of Washington Seattle, Washington, USA
A Scale-adaptive Vision Model Links C. elegans Neuronal Morphology to Behavior for Neurotoxicity Assessment
Jul 25, 2026Haochao Ying, Shenchong Lv, Yutao Sun +8Vision Foundation Models Toxicity Detection
School of Public Health and Second Affiliated Hospital, Zhejiang University School of Medicine, Hangzhou, 310058, China. · State Key Laboratory of Transvascular Implantation Devices and TIDRI, Second Affiliated Hospital of Zhejiang University School of Medicine, Hangzhou, 310009, China. · Polytechnic Institute, Zhejiang University, Hangzhou, 310058, China. +5
Self-Supervised Learning of Structured Dynamics from Videos
Jul 23, 2026Lukas Knobel, Andrew Zisserman, Yuki M. AsanoVideo Representation Learning Self-Supervised Visual Representation Learning
Fundamental AI Lab, UTN · VGG, University of Oxford
scMIR: a vision-language foundation model for single-cell light microscopy image representation
Jul 21, 2026Yifan Shang, Jiahui Tan, Xiangxiang Zeng +1Cross-Modal Representation Learning Visual Representation Learning
Laser Metrology and Biomedicine Lab, Department of Biomedical Engineering, The Chinese University of Hong Kong, Hong Kong, China · State Key Laboratory of Chemo and Biosensing, College of Computer Science and Electronic Engineering, Hunan University, Changsha 410082, China
Emergent Region-Level Facial Correspondence in Frozen Vision Foundation Models
Jul 15, 2026Izaldein Al-Zyoud, Abdulmotaleb El SaddikSemantic Correspondence Vision Foundation Models
MCRLab, School of Electrical Engineering and Computer Science University of Ottawa, Ottawa, ON, Canada
Self-Supervised Visual Representation Learning: Pretrain-Finetuning or Joint Training?
Jul 14, 2026Nusrat Munia, Tyler Ward, Nishat Nayla +2Supervised Fine-Tuning Semi-Supervised Learning
Department of Computer Science University of Kentucky Lexington, KY 40506, USA · Kentucky Geological Survey University of Kentucky Lexington, KY 40506, USA
A Masked Autoencoder Approach to Unsupervised Steel Surface Defect Recognition
Jul 14, 2026Shrey PatelMasked Autoencoders Industrial Anomaly Detection
University of Maryland, College Park · United States of America
Joint-Embedding Predictive Architecture for Solar PV Panel Fault Classification
Jul 10, 2026Seyyedhamid Azimidokht, Mehdi Monemi, Abdelhak Kharbouch +4Thermal Imaging Joint-Embedding Predictive Architecture
University of Oulu, Oulu, Finland · Central Queensland University, Australia
Lifelong Representations: A Survey on Continual Self-Supervised Learning for Vision Models
Jul 8, 2026Sergi Masip, Alicja Dobrzeniecka, Jonathan Swinnen +4Self-Supervised Learning Self-Supervised Visual Representation Learning
PSI, KU Leuven, Leuven, Belgium · NASK - National Research Institute, Warsaw, Poland · Computer Vision Center, Universitat Autonoma de Barcelona, Barcelona, Spain +1
`Attention-Guided Cross-Temporal Clustering for Self-Supervised Video Object Segmentation
Jul 8, 2026Waqas Arshid, Mohammad Awrangjeb, Alan Wee-Chung Liew +1Video Object Segmentation Self-Supervised Learning
School of Information and Communication Technology, Griffith University, Brisbane, QLD, Australia. · School of Engineering and Built Environment – Electrical and Electronic Engineering, Griffith University, Brisbane, QLD, Australia.
Converge to Surprise: Evolutionary Self-supervised Image Clustering
Jul 8, 2026Canlin Zhang, Xiuwen LiuUnsupervised Learning Self-Supervised Learning
Independent Researcher · Department of Computer Science Florida State University
Breaking Spurious Correlations via Generative Randomization and Cross-Variant Self-Supervised Learning
Jul 7, 2026Suraj Yadav, Anjaneya Sharma, Siddharth YadavContrastive Learning OOD Generalization
Indraprastha Institute of Information Technology Delhi
Vision Pretraining for Dense Spatial Perception
Jul 6, 2026Zelin Fu, Bin Tan, Changjiang Sun +6Depth Estimation Self-Supervised Visual Representation Learning
Probing Geospatial SSL Representations with Environmental Signals
Jul 6, 2026Rohita Mocharla, Vishal M. PatelRepresentation Geometry Geospatial Representation Learning
Johns Hopkins Applied Physics Laboratory · Johns Hopkins University · Laurel, MD +1
HASSL: Hierarchy-Aware Self-Supervised Learning Framework for Single Cell Microscopy
Jul 5, 2026Julius Riel, Vishwa Mohan Singh, Sai Anirudh Aryasomayajula +10Contrastive Learning Hierarchical Representation Learning
TUM.ai, Munich, Germany · Ludwig-Maximilian-University, Munich, Germany · Technical University of Munich, Munich, Germany +6
Mask-based Predictive Representations for Reinforcement Learning
Jul 5, 2026Kai ZhaoRepresentation Learning Predictive Representation Learning
School of Systems Science, Beijing Normal University · Beijing, China
SiamJEPA: On the Role of Siamese Student Encoders in JEPA
Jul 4, 2026Makoto YamadaJoint-Embedding Predictive Architecture Siamese Neural Networks
Okinawa Institute of Science and Technology
Mask-supervised Object-centric Representation Learning with LeJEPA
Jul 2, 2026Jakob Geusen, Ender KonukogluContrastive Learning Representation Learning
Biomedical Image Computing Group, ETH Zurich

Oct 7, 2026, cs.LGJ/K move · Enter open · S save

Shared Gaussianization: What Gaussian Regularizers Certify About Contrastive Learning, and What They Miss

Ruoyu Zhao, Yuting Chen, Jinheng Zhang, Zhehao Zou+1

City University of Hong Kong · Georgia Institute of Technology · University of Pennsylvania+2

Contrastive Learning Self-Supervised Visual Representation Learning Latent Space Alignment

Open paper AskPDF arXiv

What can a distribution-matching regularizer such as SIGReg in LeJEPA certify about contrastive learning? We study shared Gaussianization (SG), a characteristic-function Gaussianity test on the average of two normalized views, scaled by an independent

χ_d

radius. Because disagreeing views shorten the average, one test detects both misalignment and non-uniformity. SG vanishes exactly at the aligned, uniform minimizers of population InfoNCE, and under equal marginals it bounds the InfoNCE excess by

4\cdot 3^{3/4}β

times the square root of the SG loss, plus a term linear in the loss. The square-root rate and this dimension-free constant are sharp, and no squared mean-embedding distance on view pairs achieves a faster rate. With an explicit alignment term, a rotation-invariant uniformity test gives a linear bound if and only if its spectrum dominates that of InfoNCE's kernel

e^{βu^\top v}

; SG's own test does, Gaussian kernels

e^{-γ\|u-v\|^2}

qualify exactly when

γ\ge β/2

, and moment matching never does. Away from the optimum, the objectives differ. Along an isotropic nuisance channel, pure SG lowers its loss by adding per-view nuisance whenever the shared code is non-uniform. An alignment weight above the channel's gain makes the nuisance-free solution a strict local minimizer; for LeJEPA, the same rule gives a critical SIGReg weight that decreases with the batch size. At finite batch size, an off-diagonal U-statistic removes a plug-in bias toward misalignment. In controlled latent-variable models, pure SG retains per-view style, an alignment weight above the measured gain removes it, and for LeJEPA at three batch sizes the measured gain separates the encoders that retain style from those that do not. InfoNCE training also reaches a lower SG

_{0.2}

loss than SG

_{0.2}

training from scratch, which points to an optimization gap.

Momentum

Related topics

Latest papers 151