Correcting a learned physical invariant improves world-model rollouts
Organizations: Independent Researcher
Abstract
World models can predict video without learning dynamics that they reliably preserve. We test whether a frozen DreamerV3 trained only on pendulum video learns a scalar that its own latent transition treats as approximately conserved. A label-free search recovers the same energy-like invariant across independently trained conservative models, while the same procedure finds no comparable invariant in matched damped models. During autonomous rollouts, this quantity drifts. Projecting the latent state back toward its initial level set reduces rollout error in all three conservative models, whereas matched random constraints usually increase it. These results distinguish a dynamically meaningful invariant from a merely decodable correlate and reveal a concrete failure mode: a world model can learn a physical constraint from pixels yet violate that constraint when it imagines forward.
Figures & tables
| statistic | conservative | damped | median ratio |
|---|---|---|---|
| 0.967–0.975 | 0.018–0.090 | ||
| drift of | – | 0.203–0.266 | |
| held-out invariance ratio | 0.0027–0.0121 | 0.983–0.994 | |
| pairing residual | 0.829–0.865 | 0.934–0.957 | n/a |
Appendix figures & tables2 assets
Supplementary material from the paper’s appendix.
Appendix
World Models
World models represent and predict how environments change, helping agents plan, act, and reason about possible futures.
See all 360 papers