Supervised Autoencoder
Supervised autoencoders are neural networks trained to reconstruct input data (e.g., images, time series, 3D models) via a compressed latent representation, often used for dimensionality reduction, feature extraction, and anomaly detection. Current research emphasizes developing novel architectures like Kolmogorov-Arnold Networks and hierarchical autoencoders, and integrating autoencoders with other techniques such as diffusion models and contrastive learning to improve reconstruction quality and downstream task performance. This approach finds applications across diverse fields, from improving network throughput in autonomous vehicles to enhancing image generation and analysis in astronomy and medical imaging, demonstrating the broad utility of supervised autoencoders in data processing and analysis.
Papers
An efficient light-weighted signal reconstruction method consists of Fast Fourier Transform and Convolutional-based Autoencoder
Pu-Yun Kow, Pu-Zhao Kow
AVATAR: Adversarial Autoencoders with Autoregressive Refinement for Time Series Generation
MohammadReza EskandariNasab, Shah Muhammad Hamdi, Soukaina Filali Boubrahimi
Causal Graph Guided Steering of LLM Values via Prompts and Sparse Autoencoders
Yipeng Kang, Junqi Wang, Yexin Li, Fangwei Zhong, Xue Feng, Mengmeng Wang, Wenming Tu, Quansen Wang, Hengli Li, Zilong Zheng
Superposition in Transformers: A Novel Way of Building Mixture of Experts
Ayoub Ben Chaliah, Hela Dellagi
KAE: Kolmogorov-Arnold Auto-Encoder for Representation Learning
Fangchen Yu, Ruilizhen Hu, Yidong Lin, Yuqi Ma, Zhenghao Huang, Wenye Li
Schödinger Bridge Type Diffusion Models as an Extension of Variational Autoencoders
Kentaro Kaba, Reo Shimizu, Masayuki Ohzeki, Yuki Sughiyama
Developing Cryptocurrency Trading Strategy Based on Autoencoder-CNN-GANs Algorithms
Zhuohuan Hu, Richard Yu, Zizhou Zhang, Haoran Zheng, Qianying Liu, Yining Zhou
Tracking the Feature Dynamics in LLM Training: A Mechanistic Study
Yang Xu, Yi Wang, Hao Wang
Towards An Unsupervised Learning Scheme for Efficiently Solving Parameterized Mixed-Integer Programs
Shiyuan Qu, Fenglian Dong, Zhiwei Wei, Chao Shang
The Dynamic Duo of Collaborative Masking and Target for Advanced Masked Autoencoder Learning
Shentong Mo