Joint-Embedding Predictive Architecture

Also known as JEPA

Follow this topic Ask about this topic

Momentum

32 papers in the last four weeks, up 146% on the four weeks before. 0.3% of all new papers.

Jul 13Week of Sep 28

Latest papers 158

All topics

LeWAM: A JEPA World Action Model with Diffusion-Steering-Based MPC
Oct 8, 2026Shashank Hegde, Alexander Popov, Elie Aljalbout +1World Action Models Latent World Models
NVIDIA
SplitJEPA: Learning Invariant and Variant Latent Worlds without Reconstruction
Oct 8, 2026Ruijin Hua, Zichuan Liu, Zhuokai Zhao +1Representation Learning Invariant Representation Learning
University of Illinois Urbana-Champaign · Carnegie Mellon University · University of Chicago
RoboJEPA: Scaling Robotic Latent World Models
Oct 7, 2026Artem Zholus, Nicolas Beltran-Velez, Jianhao Yuan +9World Models Latent World Models
FAIR at Meta · Chandar Research Lab · Mila - Quebec AI Institute +2
Juno: Taming Predictive Latents for Vision-Language-Action Models
Oct 7, 2026Yuchen Zhu, Chenyi Xu, Yulin Zhang +2Vision-Language-Action Models World Models for Robotics
University of Science and Technology of China · Eastern Institute of Technology, Ningbo · Hangzhou Dianzi University +1
DSReg: Provably Recovering Individual World Latents without Reconstruction
Oct 7, 2026Yujia Zheng, David Klindt, Randall Balestriero +1Representation Identifiability Latent World Models
University of Illinois Urbana-Champaign · Cold Spring Harbor Laboratory · Brown University +2
Patient, Place, Prior (P $^3$ ): What Counts as Personalization in Medical World Models?
Oct 6, 2026Xingrui Gu, Hanxue Gu, Yuxiang Zhang +1Longitudinal Medical Image Analysis Predictive Representation Learning
University of California, Berkeley · University of California, San Francisco · Southern Methodist University
Atom-JEPA: Joint-Embedding Predictive Architecture for 3D Atomistic Systems
Oct 6, 2026Kasper Helverskov Petersen, Rasmus Hannibal Tirsgaard, François R J Cornet +2Joint-Embedding Predictive Architecture Materials Property Prediction
Department of Applied Mathematics and Computer Science Technical University of Denmark
MacJEPA: Missingness-Robust Audio-Visual Recognition from Untrimmed Egocentric Videos
Oct 6, 2026Souptik Sen, Zahra AhmadiMissing-Modality Learning Audio-Visual Understanding
Peter L. Reichertz Institute for Medical Informatics, Hannover Medical School, Germany · Lower Saxony Center for Artificial Intelligence and Causal Methods in Medicine (CAIMed), Hannover, Germany
Preserving Unstable Modes Through Inverse Dynamics in JEPA World Models
Oct 6, 2026Leonardo F. Toso, Yann LeCun, James Anderson +1Representation Learning World Model Learning
Columbia University · New York University, AMI Labs · New York University
H-JEPA: End-to-End Learning of Hierarchical World Models for Visual Planning
Oct 5, 2026Wancong Zhang, Basile Terver, Michael Rabbat +2World Models for Robotics World Models
NYU · Advanced Machine Intelligence · INRIA Paris +1
LeAVJEPA: A Minimalist Architecture for Audio-Visual Self-Supervised Learning
Oct 5, 2026Benjamin Robson, Santeri Mentu, Wenshuai Zhao +1Audio-Visual Representation Learning Joint-Embedding Predictive Architecture
ELLIS Institute Finland Aalto University
EpicWorldModel: Exploration-driven Planning with Latent World Models
Oct 5, 2026Bowen Feng, Julian Ost, May Mei +2Partially Observable RL World Model-Based Planning
Princeton University · Torc Robotics
T-JEPA: A Temporal Joint-Embedding Predictive Architecture for Learning Better Remote Sensing Representations
Oct 5, 2026Bowen Peng, Li Liu, Yongxiang Liu +3Geospatial Representation Learning Self-Supervised Time Series Representation Learning
National University of Defense Technology, Changsha, China
BeliefGraph-JEPA: Structured Latent World Models for Action-Conditioned Time Series
Oct 4, 2026Yue Li, Kangqi Ni, Zhen Tan +1Multivariate Time Series Forecasting Latent Dynamics Modeling
Carnegie Mellon University · University of North Carolina at Chapel Hill · Stevens Institute of Technology
Pythia: Toward Foundation World Models for Multimodal Time Series
Oct 4, 2026Xilin Dai, Hongzhou Chen, Yifan Hu +3Multivariate Time Series Forecasting World Model Learning
Ant International
CI-JEPA: A Counterfactual Analysis of Latent Representations in Joint-Embedding Predictive Architectures for Self-Supervised Learning
Oct 4, 2026Mintu Dutta, Ritesh Vyas, Mohendra Roy *Causal Representation Learning Joint-Embedding Predictive Architecture
Department of Information and Communication Technology, Pandit Deendayal Energy University, Gandhinagar, Gujarat, India · Department of Electrical and Electronics Engineering, Birla Institute of Technology & Science, Pilani, Rajasthan, India
Latent JEPA: Abstract Future Prediction for Latent Reasoning in Chemistry
Oct 1, 2026Xinjian Zhao, Yaoyao Xu, Xuemin Chen +2Molecular Optimization Joint-Embedding Predictive Architecture
School of Data Science, The Chinese University of Hong Kong, Shenzhen · Shanghai Artificial Intelligence Laboratory
JEPA-TTT: Persistent Test-Time Training of Latent World Models for Planning under Dynamics Shifts
Sep 30, 2026Zheyuan Zhang, Suyu Ye, Nakul Agarwal +5Test-Time Adaptation Latent Dynamics Modeling
Honda Research Institute USA · Johns Hopkins University
VR-JEPA: Learning Contrastive-State Latent Guidance for Generation-based Video Reasoning
Sep 30, 2026Zehua Ma, Kun Xiang, Yunshuang Nie +9Contrastive Learning Physical Consistency in Video Generation
Shenzhen Campus of Sun Yat-sen University · Tsinghua Shenzhen International Graduate School · Shenzhen Loop Area Institute +3
DeepJEPA: Scaling World Models from Within
Sep 30, 2026Zijian Jin, Yunbei Zhang, Yuanzhe Liu +5World Model Learning World Model-Based Planning
New York University · Tulane University · UIUC +4
PrecipJEPA: JEPA-Regularized Future-State Prediction with Motion-Source Rendering for Precipitation Nowcasting
Sep 30, 2026Yufeng Zhu, Dan Niu, Qiliang Wu +4Precipitation Forecasting Joint-Embedding Predictive Architecture
Department of Automation, Southeast University, Nanjing 210096, China
GLaS-JEPA: Gaussian-Regularized Speech SSL without Engineered Prediction Targets
Sep 29, 2026Gaspard Botté, Séverin Baroudi, Samir Sadok +5Joint-Embedding Predictive Architecture Predictive Representation Learning
Concordia University · Mila – Qu´ebec AI Institute · Univ Toulon, Aix Marseille Univ, CNRS, LIS +4
ER-JEPA: Experience Replay Improves Joint-Embedding Predictive Learning in Language Models
Sep 29, 2026Jingnan Pu, Zi-En Fan, Feng LianMemory-Augmented Language Models Joint-Embedding Predictive Architecture
School of Automation Science and Technology, Xi’an Jiaotong University No. 28, West Xianning Road, Xi’an, Shaanxi 710049, China
$λ$ -JEPA Spectral Anti-Collapse Regularization for Self-Supervised Learning
Sep 28, 2026Berker Demirel, Clémentine Dominé, Valentino Maiorca +3Spectral Regularization Joint-Embedding Predictive Architecture
Institute of Science and Technology Austria (ISTA) Am Campus 1, 3400 Klosterneuburg, Austria
PDE-JEPA: Predictive Representation Learning of Latent Dynamics Modeling for Parametric PDEs
Sep 28, 2026Zhentao Tan, Jianrong Zhang, Ruijie Quan +1Latent Dynamics Modeling Joint-Embedding Predictive Architecture
Zhejiang University.
AD-E2E-JEPA: A Joint-Embedding Predictive Architecture For End-to-End Autonomous Driving
Sep 28, 2026Haoran Zhu, Wancong Zhang, Yann LeCun +1Efficient Inference World Model-Based Planning
New York University · AMI Labs
Behavioral Monitoring of JEPA World Models with Jacobian Centroids
Sep 27, 2026Thomas Walker, Randall Balestriero, Richard BaraniukDistribution Shift World Model-Based Planning
Rice University · Brown University
MA-JEPA: Joint-Embedding World Models for Multi-Agent Reinforcement Learning
Sep 27, 2026Brandon Gary Kaplowitz, Osaze James Obahor, Christian Schroeder de WittGame-Playing Agents World Model Learning
Department of Engineering Science, University of Oxford
Hamiltonian JEPA: Action-Conditioned World Models with an Inherited Control State
Sep 27, 2026Tamim Zoabi, Ameen Ali, Lior WolfJoint-Embedding Predictive Architecture Model-Based Planning
The Blavatnik School of Computer Science, Tel Aviv University
Adaptive Latent Capacity for World Models
Sep 26, 2026Idan Achituve, Lior Dikstein, Idit Diamant +2World Model Learning Latent Dynamics Modeling
Arm Research Israel

Oct 8, 2026, cs.ROJ/K move · Enter open · S save

LeWAM: A JEPA World Action Model with Diffusion-Steering-Based MPC

Shashank Hegde, Alexander Popov, Elie Aljalbout, Nikolai Smolyanskiy

NVIDIA

World Action Models Latent World Models World Model-Based Planning Joint-Embedding Predictive Architecture Model Predictive Control

Open paper AskPDF arXiv

World action models (WAMs) predict actions and future observations, typically from a reconstruction-based representation that carries noisy, redundant information which can complicate downstream predictions. We introduce LeWAM, a bidirectional transformer for forward, backward, inverse dynamics and policy prediction, on a decoder-free JEPA latent trained end-to-end through all four modes. We see the following benefits: 1) Alignment: linear probes read robot and object state from LeWAM's latent better than from a regular Le World Model (a forward-only JEPA world model), while the latent ignores visual distractors as well as LeWM does and far better than a reconstruction-based WAM. 2) Acting: Closed-loop evaluations of LeWAM match a regular flow-matching policy trained on the same encoder at matched size, while also providing a world model. 3) Planning: Sampling raw actions when planning with WAMs lets MPC exploit dynamics-model inaccuracies; planning in the noise space of the policy head instead improves the closed-loop performance of these WAMs.

Momentum

Related topics

Latest papers 158