Supervised Autoencoder
Supervised autoencoders are neural networks trained to reconstruct input data (e.g., images, time series, 3D models) via a compressed latent representation, often used for dimensionality reduction, feature extraction, and anomaly detection. Current research emphasizes developing novel architectures like Kolmogorov-Arnold Networks and hierarchical autoencoders, and integrating autoencoders with other techniques such as diffusion models and contrastive learning to improve reconstruction quality and downstream task performance. This approach finds applications across diverse fields, from improving network throughput in autonomous vehicles to enhancing image generation and analysis in astronomy and medical imaging, demonstrating the broad utility of supervised autoencoders in data processing and analysis.
Papers
Masked Autoencoder for Self-Supervised Pre-training on Lidar Point Clouds
Georg Hess, Johan Jaxing, Elias Svensson, David Hagerman, Christoffer Petersson, Lennart Svensson
Unsupervised Cross-Domain Feature Extraction for Single Blood Cell Image Classification
Raheleh Salehi, Ario Sadafi, Armin Gruber, Peter Lienemann, Nassir Navab, Shadi Albarqouni, Carsten Marr
Attention-Guided Autoencoder for Automated Progression Prediction of Subjective Cognitive Decline with Structural MRI
Hao Guan, Ling Yue, Pew-Thian Yap, Shifu Xiao, Andrea Bozoki, Mingxia Liu
Using Autoencoders on Differentially Private Federated Learning GANs
Gregor Schram, Rui Wang, Kaitai Liang
Data-driven reduced order models using invariant foliations, manifolds and autoencoders
Robert Szalai
Pre-training via Denoising for Molecular Property Prediction
Sheheryar Zaidi, Michael Schaarschmidt, James Martens, Hyunjik Kim, Yee Whye Teh, Alvaro Sanchez-Gonzalez, Peter Battaglia, Razvan Pascanu, Jonathan Godwin
Semantic Autoencoder and Its Potential Usage for Adversarial Attack
Yurui Ming, Cuihuan Du, Chin-Teng Lin
itKD: Interchange Transfer-based Knowledge Distillation for 3D Object Detection
Hyeon Cho, Junyong Choi, Geonwoo Baek, Wonjun Hwang