Joint-Embedding Predictive Architecture

Joint-Embedding Predictive Architectures learn useful representations by predicting a target encoder’s latent features from visible or past context, rather than reconstructing every input detail. Common approaches use masked context-target prediction, online or EMA target encoders, and regularizers such as SIGReg to prevent collapse; action-conditioned variants model latent dynamics for planning. These methods are being applied to images, video, robotics, medical and scientific data, and time series, with evaluations ranging from linear probes to control and forecasting benchmarks. A central open tension is that predictable, non-collapsed features are not necessarily the features needed for a task: work tests how to preserve control-relevant or diagnostic information and how well prediction metrics reflect downstream performance.