Predictive Representation Learning

Overview

Predictive representation learning studies how models can build useful internal states by predicting masked, future, or cross-view representations rather than reproducing every input detail. Common approaches include joint-embedding predictive architectures such as JEPA, contrastive predictive coding, masked latent prediction, and models that forecast temporal dynamics; they are used in vision, speech, health data, and robotics. Researchers evaluate learned features with transfer tasks, linear probes, forecasting benchmarks, and measures of control or planning performance. A central open tension is that predictability alone may discard rare but important information, so preventing collapse and aligning representations with causal, clinical, or action-relevant structure remain key challenges.

Latest papers

CardsList

190 papers25 papers in the last four weeks, down 34% on the four weeks before. 0.2% of all new papers.

  1. PROSPECT: Unified Streaming Vision-Language Navigation via Semantic--Spatial Fusion and Latent Predictive Representation

    Mar 4, 2026Zehua Fan, Wenqi Lyu, Wenxuan Song +12Vision-Language NavigationVision-Language-Action Models

  2. Expectation and Acoustic Neural Network Representations Enhance Music Identification from Brain Activity

    Mar 3, 2026Shogo Noguchi, Taketo Akama, Tai Nakamura +2EEG DecodingPredictive Representation Learning

  3. Online Register for Dual-Mode Self-Supervised Speech Models: Mitigating The Lack of Future Context

    Feb 27, 2026Keita Goto, Takashi Maekaku, Jin Sakuma +3Self-Supervised Speech Representation LearningPredictive Representation Learning

  4. FRAPPE: Infusing World Modeling into Generalist Policies via Multiple Future Representation Alignment

    Feb 19, 2026Han Zhao, Jingbo Wang, Wenxuan Song +5World Models for RoboticsLatent World Models

  5. Cross-Sectional Asset Retrieval via Future-Aligned Soft Contrastive Learning

    Feb 11, 2026Hyeongmin Lee, Chanyeol Choi, Jihoon Kwon +8Contrastive LearningInformation Retrieval

  6. Predicting upcoming visual features during eye movements yields scene representations aligned with human visual cortex

    Nov 16, 2025Sushrut Thorat, Adrien Doerig, Alexander Kroner +2Predictive CodingVisual Neuroscience

  7. Deep Fair Learning: Task-Aware Fair Representations via Joint Distance-Covariance Regularization

    Apr 8, 2025Enze Shi, Yiqun Xiao, Linglong Kong +1Representation LearningAlgorithmic Fairness

  8. Meta-Representational Predictive Coding: Neuroscience-Informed Self-Supervised Learning

    Mar 22, 2025Alexander Ororbia, Karl Friston, Rajesh P. N. RaoSelf-Supervised LearningPredictive Coding

  9. Stochastic Optimal Control for Continuous-Time fMRI Representation Learning

    Feb 7, 2025Joonhyeong Park, Byoungwoo Park, Chang-Bae Bang +4Latent Dynamics ModelingSelf-Supervised Time Series Representation Learning