Predictive Representation Learning

Ask about this topic

Overview

Predictive representation learning studies how models can build useful internal states by predicting masked, future, or cross-view representations rather than reproducing every input detail. Common approaches include joint-embedding predictive architectures such as JEPA, contrastive predictive coding, masked latent prediction, and models that forecast temporal dynamics; they are used in vision, speech, health data, and robotics. Researchers evaluate learned features with transfer tasks, linear probes, forecasting benchmarks, and measures of control or planning performance. A central open tension is that predictability alone may discard rare but important information, so preventing collapse and aligning representations with causal, clinical, or action-relevant structure remain key challenges.

Latest papers

CardsList

176 papers40 papers in the last four weeks, up 111% on the four weeks before. 0.2% of all new papers.

  1. Self-Predictive Representation for Autonomous UAV Object-Goal Navigation

    Apr 22, 2026Angel Ayala, Donling Sui, Francisco Cruz +3UAV NavigationPredictive Representation Learning

    Escola Polit´ecnica de Pernambuco, Universidade de Pernambuco, Recife, Brasil · School of Mechanical and Manufacturing Engineering, University of New South Wales, Sydney, Australia · Escuela de Ingenier´ıa, Universidad Central de Chile, Santiago, Chile

  2. Sonata: A Hybrid World Model for Inertial Kinematics under Clinical Data Scarcity

    Apr 20, 2026Blaise Delaney, Salil Patel, Yuji Xing +3Medical DiagnosisPredictive Representation Learning

    1TimeTrace Labs · 2NVIDIA · University of Oxford

  3. Representation Before Training: A Practical Benchmark for Generative Medical Event Model Tokenization

    Apr 18, 2026Inhyeok Lee, Luke Solo, Michael C. Burkhart +5HealthcarePredictive Representation Learning

    University of Chicago

  4. Predict and Reconstruct: Joint Objectives for Self-Supervised Language Representation Learning

    Apr 16, 2026Aimen BoukhariJoint-Embedding Predictive ArchitectureMasked Language Modeling

    ´Ecole Nationale Sup´erieure d’Informatique (ESI), Algiers , Algeria

  5. From Alignment to Prediction: A Study of Self-Supervised Learning and Predictive Representation Learning

    Apr 15, 2026Mintu Dutta, Ritesh Vyas, Mohendra RoySelf-Supervised LearningPredictive Representation Learning

    Department of Information and Communication Technology, School of Technology, Pandit Deendayal Energy University, Gandhinagar, Gujarat 382007, India

  6. Temporal Contrastive Transformer for Financial Crime Detection: Self-Supervised Sequence Embeddings via Predictive Contrastive Coding

    Mar 31, 2026Danny Butvinik, Yonit Marcus, Nitzan Tal +1Self-Supervised Time Series Representation LearningPredictive Representation Learning

    NICE Actimize

  7. Gaussian Joint Embeddings For Self-Supervised Representation Learning

    Mar 26, 2026Yongchao HuangRepresentation LearningMultimodal Embedding

  8. From Topic to Transition Structure: Unsupervised Concept Discovery at Corpus Scale via Predictive Associative Memory

    Mar 19, 2026Jason DuryUnsupervised Visual Concept DiscoveryText Clustering

    Independent Researcher

  9. Predictive Statistics Shape Emergent World Representations of Grid Walkers

    Mar 17, 2026Sasha Brenner, Thomas R. Knösche, Nico ScherfPredictive Representation LearningWorld Model Learning

    Max Planck Institute for Human Cognitive and Brain Sciences, Leipzig, Germany · Leipzig University, Germany · ScaDS.AI, Dresden/Leipzig, Germany

  10. Laya: A LeJEPA Approach to EEG via Latent Prediction over Reconstruction

    Mar 17, 2026Saarang Panchavati, Uddhav Panchavati, Hiroki Nariai +2EEG Foundation ModelsSelf-Supervised Time Series Representation Learning

    Department of Medical Informatics UCLA Los Angeles, USA · Department of Cognitive Science UCSD San Diego, USA · David Geffen School of Medicine UCLA Mattel Children’s Hospital Los Angeles, USA

  11. Regularized Latent Dynamics Prediction is a Strong Baseline For Behavioral Foundation Models

    Mar 16, 2026Pranaya Jajoo, Harshit Sikchi, Siddhant Agarwal +3Behavioral Foundation ModelsZero-Shot RL

    Department of Computing Science, University of Alberta, Canada · Alberta Machine Intelligence Institute (Amii) · The University of Texas at Austin +2

  12. Self-Distillation of Hidden Layers for Self-Supervised Representation Learning

    Mar 16, 2026Scott C. Lowe, Anthony Fuller, Sageev Oore +2Self-Supervised Visual Representation LearningPredictive Representation Learning

    Vector Institute · Carleton University · Dalhousie University +2

  13. Embedding-Aware Feature Discovery: Bridging Latent Representations and Interpretable Features in Event Sequences

    Mar 16, 2026Artem Sakhno, Ivan Sergeev, Alexey Shestov +5Large Language Model-Based Feature EngineeringAutomated Feature Engineering

    Sber AI Lab · ISP RAS Research Center for Trusted AI

  14. Is the reconstruction loss culprit? An attempt to outperform JEPA

    Mar 14, 2026Alexey Potapov, Oleg Shcherbakov, Ivan KravchenkoPredictive Representation LearningAutoencoders

    SingularityNET

  15. DT-BEHRT: Disease Trajectory-aware Transformer for Interpretable Patient Representation Learning

    Mar 10, 2026Deyi Li, Zijun Yao, Qi Xu +4Disease Progression ModelingLongitudinal EHR Modeling

    University of Florida, Gainesville, Florida, USA · University of Kansas, Lawrence, Kansas, USA · MD Anderson Cancer Center, Houston, Texas, USA +1

  16. LEPA: Learning Geometric Equivariance in Satellite Remote Sensing Data with a Predictive Architecture

    Mar 7, 2026Erik Scheurer, Rocco Sedona, Stefan Kesselheim +1Equivariant Representation LearningGeometric Representation Learning

    Jülich Supercomputing Centre (JSC), Forschungszentrum Jülich, 52428 Jülich, Germany · Institute for Visualization and Interactive Systems (VIS), University of Stuttgart, 70569 Stuttgart · School of Engineering and Natural Sciences (SENS), University of Iceland, 102 Reykjavík, Iceland

  17. Dreamer-CDP: Improving Reconstruction-free World Models Via Continuous Deterministic Representation Prediction

    Mar 7, 2026Michael Hauri, Friedemann ZenkeWorld Model LearningWorld Models

    Friedrich Miescher Instiute for Biomedical Research, Fabrikstrasse 24, 4056 Basel, Switzerland

  18. PROSPECT: Unified Streaming Vision-Language Navigation via Semantic--Spatial Fusion and Latent Predictive Representation

    Mar 4, 2026Zehua Fan, Wenqi Lyu, Wenxuan Song +12Vision-Language NavigationVision-Language-Action Models

    Z. Fan and F. Gao are with Shanghai Jiao Tong University, Shanghai, China. · W. Lyu is with the University of Adelaide, Adelaide, Australia. · W. Song and J. He are with the Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China. +5

  19. Expectation and Acoustic Neural Network Representations Enhance Music Identification from Brain Activity

    Mar 3, 2026Shogo Noguchi, Taketo Akama, Tai Nakamura +2EEG DecodingPredictive Representation Learning

    Sony Computer Science Laboratories, Inc., Tokyo, Japan

  20. Online Register for Dual-Mode Self-Supervised Speech Models: Mitigating The Lack of Future Context

    Feb 27, 2026Keita Goto, Takashi Maekaku, Jin Sakuma +3Self-Supervised Speech Representation LearningPredictive Representation Learning

    LY Corporation, Tokyo, Japan · Carnegie Mellon University, PA, USA

  21. FRAPPE: Infusing World Modeling into Generalist Policies via Multiple Future Representation Alignment

    Feb 19, 2026Han Zhao, Jingbo Wang, Wenxuan Song +5World Models for RoboticsLatent World Models

    Zhejiang University · Westlake University · HKUST (GZ) +3

  22. Cross-Sectional Asset Retrieval via Future-Aligned Soft Contrastive Learning

    Feb 11, 2026Hyeongmin Lee, Chanyeol Choi, Jihoon Kwon +8Contrastive LearningInformation Retrieval

    Seoul National University of Science and Technology Seoul, Republic of Korea · LinqAlpha Cambridge, MA, United States · Massachusetts Institute of Technology Cambridge, MA, United States +7

  23. Predicting upcoming visual features during eye movements yields scene representations aligned with human visual cortex

    Nov 16, 2025Sushrut Thorat, Adrien Doerig, Alexander Kroner +2Predictive CodingVisual Neuroscience

    Institute of Cognitive Science, Osnabrück University, Osnabrück 49069, Germany. · Lossfunk, Bengaluru 560038, India. · Department of Education and Psychology, Freie Universität, Berlin 14195, Germany. +1

  24. Deep Fair Learning: Task-Aware Fair Representations via Joint Distance-Covariance Regularization

    Apr 8, 2025Enze Shi, Yiqun Xiao, Linglong Kong +1Representation LearningAlgorithmic Fairness

    Department of Mathematical and Statistical Science, University of Alberta.

  25. Meta-Representational Predictive Coding: Neuroscience-Informed Self-Supervised Learning

    Mar 22, 2025Alexander Ororbia, Karl Friston, Rajesh P. N. RaoSelf-Supervised LearningPredictive Coding

    Rochester Institute of Technology · Rochester, New York, USA · VERSES AI Research Lab +3

  26. Stochastic Optimal Control for Continuous-Time fMRI Representation Learning

    Feb 7, 2025Joonhyeong Park, Byoungwoo Park, Chang-Bae Bang +4Latent Dynamics ModelingSelf-Supervised Time Series Representation Learning

    KAIST · Yonsei University · EverEx +1