Overview

Masked autoencoders study how models can learn useful representations from unlabeled data by predicting hidden patches, tokens, or time segments. Common approaches encode only the visible input and use a decoder for reconstruction, while newer variants guide masking with domain structure, predict latent features, or combine reconstruction with contrastive and cross-modal learning. These methods are used across images, video, medical scans, audio, biosignals, and remote sensing, with evaluations spanning tasks such as ImageNet classification, NTU action recognition, and medical image segmentation. A central open question is when reconstruction pretraining transfers better than alternatives: results depend on the masking strategy, data scale, and downstream task, and faithful reconstruction does not always produce the most useful features.

Latest papers

CardsList

112 papers10 papers in the last four weeks, down 37% on the four weeks before. 0.1% of all new papers.

  1. Defect-Aware Masked Autoencoders for Unsupervised Clustering of Steel Surface Defects

    Nov 16, 2026Shrey PatelMasked AutoencodersUnsupervised Clustering

  2. SLICES: A Benchmark and Evaluation Framework for Self-Supervised Learning on Sparse ICU Time Series

    Nov 13, 2026Hannes Ill, Dimitrios Proios, Leo Anthony Celi +1Self-Supervised Time Series Representation LearningClinical Outcome Prediction

  3. Rethinking Radar 3D Perception: Representation Learning from Raw Spectra

    Nov 9, 2026Miao Zhang, Mohamed Abdelsamad, Bin Yang +5Representation Learning3D Representation Learning

  4. CABrain: A Correlation-Aware Brain Foundation Model for EEG Decoding

    Nov 9, 2026SuGil Choi, Mooseop Kim, Chi Yoon JeongEEG Foundation ModelsEEG Decoding

  5. AudioSphere: Towards Self-Supervised Spatial Audio Representation Models

    Nov 6, 2026Goksenin Yuksel, Marcel van Gerven, Kiki van der HeijdenAudio Representation LearningSpatial Audio

  6. SensOFormer: Foundation Models for Particle Accelerators

    Nov 1, 2026Mahindra Rautela, Alexander ScheinkerSelf-Supervised Time Series Representation LearningTime-Series Foundation Models

  7. Efficient and Scalable Multi-View Masked Autoencoder for Heterogeneous Graph Self-Supervised Learning

    Oct 31, 2026Hao Geng, Deqing Wang, Lihao Ge +5Graph SSLMasked Autoencoders

  8. Observability-Aligned Evidential Masked Pretraining for Reliable VRU Motion Prediction

    Oct 29, 2026Shang Gao, Franz Götz-Hahn, Konrad Doll +1Uncertainty QuantificationMasked Autoencoders

  9. SpectralTF-MAE: A Pre-trained Spectral Foundation Model for Tokamak Fusion Plasma Diagnostics

    Oct 28, 2026Xiao Wang, Zhijie Lu, Duoqing Yang +7Representation LearningSelf-Supervised Pre-Training

  10. WildMAE: Structure-Aware Masked Autoencoding for Wildlife Image Reconstruction

    Oct 20, 2026Yicheng Zhang, Yujie Jin, Ke Zhang +1Masked Image ModelingMasked Autoencoders

  11. Data-Efficient ConvNeXt Pretraining for High-Resolution Sentinel-1 GRD SAR Representation Learning

    Oct 15, 2026Yuki Natsume, Sang-Ho Yun, Chai Kiat YeoSelf-Supervised Pre-TrainingMasked Autoencoders

  12. Variable Input Masked Autoencoders for Wrist-Worn Accelerometry

    Oct 12, 2026Harish Haresamudram, Wanting Mao, Aditya Radhakrishnan +2Self-Supervised Time Series Representation LearningTime-Series Foundation Models

  13. DIME: Scaling Facial Representation Learning via Differential Masked Autoencoding

    Oct 12, 2026Hao Yu, Haoyu Chen, Hui Wei +3Visual Representation LearningSelf-Supervised Visual Representation Learning

  14. Growing to See: Efficient Pretraining of Self-Supervised Vision Transformers

    Oct 12, 2026Amir Mohammad Karimi Mamaghan, Ferdinand Kapl, Andrea Dittadi +4Self-Supervised Visual Representation LearningSelf-Supervised Pre-Training

  15. Event-based Action Recognition by Pre-Training on Multi-Frame Representations

    Oct 9, 2026Emma Norrby, Tomas Wilkinson, Per Nyblom +1Event-Based VisionMasked Autoencoders

  16. HuC-VideoMAE: Human-Centric Video Masked Autoencoding from synthetic data

    Oct 6, 2026Ricardo Pizarro, Roberto Valle, José M. Buenaposada +2Synthetic Data PretrainingMasked Autoencoders

  17. LEON: Location Embeddings from OSM Neighborhoods via Hexagonal Graph Masked Autoencoders

    Oct 4, 2026Szymon Soltysiak, Radoslaw Malek, Jedrzej Kusnierz +3Masked AutoencodersGeospatial Representation Learning

  18. The hidden advantage of mask resampling: a theory of masked autoencoders

    Oct 1, 2026Jorge Medina Moreira, Lorenzo Bardone, Lenka ZdeborováMasked AutoencodersMasked Language Modeling

  19. I Have a Stream: Making Self-Supervised Learning Work on Continuous Video

    Sep 30, 2026Ivan Martinović, Lukas Knobel, Yuki M. AsanoMasked AutoencodersSelf-Supervised Learning

  20. Masked Swingers: Harnessing Data Augmentation to Advance Autoencoders for Self-Supervised Learning

    Sep 29, 2026Anthony Fuller, Scott C. Lowe, Daniel G. Kyrollos +3Masked AutoencodersInvariant Representation Learning

  21. What masking geometry works best for EEG foundation models?

    Sep 27, 2026Pierre Guetschel, Bruno Aristimunha, Yassine El Ouahidi +3Masked AutoencodersEEG Decoding

  22. BarcodeMAE+: Rethinking Masked Pretraining and Global Representations for DNA Barcode Foundation Models

    Sep 26, 2026Monireh Safari, Pablo Millan Arias, Scott C. Lowe +3Molecular Representation LearningMasked Autoencoders

  23. Structure-Guided Masked Autoencoders for Ultra-High Resolution Scientific Image Understanding

    Sep 25, 2026Enzhi Zhang, Du Wu, Rui Zhong +18Masked AutoencodersMasked Image Modeling

  24. Fed-ReMasker: Federated Tabular Imputation under Feature-Level Missingness

    Sep 23, 2026Ioannis Papathanail, Rooholla Poursoleymani, Lubnaa Abdur Rahman +1Incomplete Data ImputationMasked Autoencoders

  25. MiTHras: Task-specific Hierarchical Semi-supervised Contrastive Masked Autoencoder for Mitotic Figure Analysis

    Sep 21, 2026Trinh T. L. Vuong, Simon Graham, Quoc Dang Vu +5Contrastive LearningMasked Autoencoders

  26. Mask 2D-3D: Adaptive Dual-Masked Autoencoder Network for Image-to-Point Cloud Registration

    Sep 16, 2026Zhixin Cheng, Jiacheng Deng, Xiaotian Yin +3Masked AutoencodersPoint Cloud Registration

  27. MAETrack: Unleashing the Potential of Pretrained Geometric Priors for 3D Single Object Tracking

    Sep 15, 2026Sifan Zhou, Qiwei Wang, Linyue Tan +3Masked AutoencodersSelf-Supervised Pre-Training