cs.LGJul 24, 2026

On the Identifiability of Controlled World Models

Authors: Xiangteng ZhangYang GuanBo ZhangHongyang LiYa-Qin ZhangShengbo Eben Li

Organizations: School of Vehicle and Mobility, Tsinghua University · 2Didi Voyager Labs, Didi Autonomous Driving · School of Computing and Data Science, The University of Hong Kong · Institute for AI Industry Research, Tsinghua University · College of AI, Tsinghua University

Abstract

World model serves as a promising tool to infer environment dynamics under high-dimensional observations and candidate actions. Recently, LeCun's JEPA provides a compelling framework for learning such models in representation space. Its action-conditioned extension plays a central role in visual control and latent-space planning, but leaves a fundamental question: can it recover the controlled dynamics from nonlinear observations? This paper presents a joint identifiability condition for controlled world models with Gaussian latent states, which consists of two coupled components: (1) representation identifiability and (2) transition identifiability. The former depends on the spectral separation property while the latter is related to non-degenerate variation of conditional action. We prove that when this condition holds, minimizing the LeJEPA-style predictive objective can recover both latent states and controlled dynamics in the sense of orthogonal transformation. We further prove that the upper bound of transition prediction error is inversely proportional to the spectral separation margin. We also characterize an attainable amplification of counterfactual prediction error that scales inversely with the weakest conditional action-excitation margin. The theoretical predictions are empirically supported across four nonlinear observation settings.

Explore similar work

CardsList
  1. When Does LeJEPA Learn a World Model?

    May 25, 2026David Klindt, Yann LeCun, Randall BalestrieroLatent World ModelsWorld Models