Predictive Representation Learning

Overview

Predictive representation learning studies how models can build useful internal states by predicting masked, future, or cross-view representations rather than reproducing every input detail. Common approaches include joint-embedding predictive architectures such as JEPA, contrastive predictive coding, masked latent prediction, and models that forecast temporal dynamics; they are used in vision, speech, health data, and robotics. Researchers evaluate learned features with transfer tasks, linear probes, forecasting benchmarks, and measures of control or planning performance. A central open tension is that predictability alone may discard rare but important information, so preventing collapse and aligning representations with causal, clinical, or action-relevant structure remain key challenges.

Latest papers

CardsList

190 papers25 papers in the last four weeks, down 34% on the four weeks before. 0.2% of all new papers.

  1. Reconstruction vs. Prediction Pre-Training of Discrete Video Representations for Continuous Control

    Nov 18, 2026Ron Kosova, Francesco CroceVideo Representation LearningPredictive Representation Learning

  2. CascadeJEPA: Enhancing 3D Geometric Representations via Spatially Coupled Cascaded Prediction

    Nov 17, 2026Kailai Zhou, Ziqi Chen, Xiaoning Xu +8Joint-Embedding Predictive Architecture3D Representation Learning

  3. SADL: On the Demand-Supply Geometry of Representation Collapse

    Nov 16, 2026Junhan Sun, Yigui Feng, Mingzhe Liu +7Representation CollapsePredictive Representation Learning

  4. SurgWorld: Learning Surgical Representations Beyond Observation via Latent Prediction

    Nov 8, 2026Jingkun Yue, Pengxiang Wang, Siqi Zhang +7Surgical Video UnderstandingVideo Representation Learning

  5. A Stochastic Latent Variable Generalization of Joint-Embedding Predictive Architectures

    Nov 6, 2026Nikos Giakoumoglou, Paschalis Giakoumoglou, Tania StathakiJoint-Embedding Predictive ArchitecturePredictive Representation Learning

  6. STEP: Spatiotemporal Training with Explicit Prediction for Perceptive Humanoid Locomotion

    Nov 5, 2026Youhao Lyu, Chenghao Sun, Zhenxuan Ding +3Humanoid Robot LocomotionTerrain-Aware Robot Locomotion

  7. TAPES: Task-Aligned Joint Predictive Pretraining for Transaction Event Sequences

    Nov 3, 2026Ruobing Zuo, Weiyu Han, Huilin He +6Predictive Representation LearningTemporal Representation Learning

  8. Benchmark Prediction with Sparse and Unpaired Cached Responses

    Nov 2, 2026Hayden Helm, Avijit Ghosh, Ben Johnson +1Generative AI EvaluationPredictive Representation Learning

  9. Proving and Improving the Platonic Representation Hypothesis with JEPAs

    Oct 29, 2026Randall Balestriero, Yann LeCunPlatonic Representation HypothesisCross-Modal Alignment

  10. PT3^3: Prototype-Guided Self-Supervised Pretraining for Generalizable mmWave Human Point Cloud Representation

    Oct 28, 2026Ziyang Liu, Kieren Yu, Xiao Yang +2Self-Supervised Point Cloud LearningmmWave Radar Sensing

  11. Vision-Language-Action or World-Action? Just Action Models

    Oct 27, 2026Yonghao Yu, Lang Huang, Runyi Li +1VLA TrainingWorld Action Models

  12. Video World Models Need Predictable Latents

    Oct 26, 2026Mattia Scardecchia, Sherry YangVideo World ModelsWorld Model Learning

  13. BriLLM-MetaPred: A Representation-Prediction Unity Language Model with Adaptive Self-Measurement

    Oct 25, 2026Junyuan Liu, Hongyue Lin, Jiale Hong +2Predictive Representation LearningArtificial General Intelligence

  14. DT-JEPA: Learning to Predict Future Representations for Decision-Making

    Oct 23, 2026Changxu Ni, Yiyang Ni, Jun Li +4Transformer-Based RLSelf-Supervised RL

  15. From Predictive Geometry to Action: Learning Complementary Predictive Representations for Embodied Manipulation

    Oct 20, 2026Xiaoxu Xu, Hao Li, Hongtao Zhang +6Robotic ManipulationPredictive Representation Learning

  16. From Complex Histories to Simple Predictors: Predictive Dimension in Dynamic Graph Learning

    Oct 20, 2026Hantong Feng, Duxin Chen, Wenwu YuDynamic Graph LearningPredictive Representation Learning

  17. Slot-JEPA: Object-Structured Prediction Interfaces for Latent World Models

    Oct 20, 2026Peisong Wen, Qianqian Xu, Minye Lei +3Goal-Conditioned PlanningJoint-Embedding Predictive Architecture

  18. Predictive Closure: A Set-Level Characterization of JEPA's Feature Selection

    Oct 19, 2026Mosh Levy, Aly Lidayan, Yoav GoldbergJoint-Embedding Predictive ArchitecturePredictive Representation Learning

  19. Ontic state recovery through prediction

    Oct 19, 2026Ping Zhang, Quang-Huy Nguyen, Yingtie Lei +1Predictive State RepresentationsState Representation Learning

  20. See the Future, Classify the Present: Stochastic Latent World Modeling for Hyperspectral Images

    Oct 19, 2026Muhammad Ahmad, Gemine Vivone, Ronny Hänsch +3Hyperspectral Image ClassificationPredictive Representation Learning

  21. GeoThinker-FF: Endogenous Predictive World Representations for Fast Spatial Intelligence

    Oct 14, 2026Haoyuan Li, Qihang Cao, Huanyuan Zhou +103D VLMs3D Spatial Reasoning