Latent world models enable visual control by planning action sequences in compact representation spaces, but a gap remains between how latent dynamics are learned and how they are used for planning. First, teacher-forced training does not expose the dynamics model to the recursively predicted latent states encountered during planning. Second, sampling-based planners typically initialize action search from goal-agnostic proposals, without exploiting the action-conditioned dynamics learned by the world model. We introduce Dynamics-Informed Action Learning (DIAL) to bridge these two gaps. During training, rollout alignment exposes the forward model to its own autoregressive latent predictions, while multi-step inverse supervision trains a lightweight inverse dynamics head to infer actions from latent-state transitions. We further apply the inverse head to model-generated transitions with its parameters held fixed, encouraging predicted rollouts to retain action-relevant information. At test time, DIAL autoregressively couples the inverse and forward dynamics to construct a dynamics-informed action sequence toward the goal, which initializes the mean of the Cross-Entropy Method (CEM) proposal distribution. The subsequent CEM search then refines this initialization using the standard sampling and updating procedure. Experiments across four visual control benchmarks demonstrate that DIAL outperforms existing latent world models and planning baselines in both standard and long-horizon scenarios.
Figures & tables
Figure 1: DIAL aligns latent dynamics learning with goal-directed planning. (a) During training, teacher forcing performs one-step prediction from observed latent states. (b) At planning time, autoregressive rollouts can accumulate prediction drift, while generic action proposals lack goal-directed initialization. (c) DIAL addresses both gaps by training on model-generated rollouts and using learned inverse dynamics to construct a dynamics-informed CEM proposal.
Figure 2: Overview of DIAL. (1) Rollout alignment trains the latent dynamics predictor Fθ on autoregressively generated latent contexts to reduce the mismatch between training and planning. (2) Multi-step inverse supervision trains the inverse-dynamics head Gψ on observed latent state pairs and uses a frozen inverse head Gψˉ to encourage model-generated states to preserve action-relevant information. (3) Dynamics-informed planning autoregressively couples Gψ and Fθ to generate a goal-directed action sequence, which initializes only the mean of the CEM proposal.
Method
Offset 25
Offset 50
PushT
Cube
Reacher
TwoRoom
Macro
PushT
Cube
Reacher
TwoRoom
Macro
PLDM [ 19 , 20 ]
78.0
65.0
78.0
97.0
79.5
20.0
46.0
66.0
78.0
52.5
DINO-WM [ 29 ]
74.0
86.0
79.0
100.0
84.8
14.0
46.0
20.0
94.0
43.5
LeWM [ 12 ]
96.0
74.0
86.0
87.0
85.8
60.0
64.0
72.0
56.0
63.0
RC-aux [ 11 ]
90.8
76.0
87.2
98.0
88.0
64.0
54.0
82.0
54.0
63.5
Fast-LeWM [ 3 ]
96.0
80.0
88.0
98.0
90.5
46.0
58.0
80.0
50.0
58.5
Table 1: Success rates (%) at the standard 25-step and long-horizon 50-step goal offsets. Offset-25 results are quoted from the corresponding papers unless otherwise noted. Offset-50 results are evaluated using a unified harness with identical episodes ( n=50 ) and the same CEM candidate budget across methods. Bold and underline indicate the best and second-best results.
Figure 3: Visualization of planning trajectories on Cube and PushT. Compared with LeWM and INTACT, DIAL maintains object interaction and makes greater progress toward the goal, while other methods either lose object interaction or terminate far from target.
Figure 4: Effect of goal consistency in proposal initialization. Success rates (%) for uninitialized, mismatched-goal, and matched-goal proposals across environments and goal offsets under the constrained search budget ( 30×10 , n=50 episodes per setting).
Figure 5: Dynamics-informed initialization under constrained budgets. Success rates (%) across environments for uninitialized and dynamics-informed proposals under different goal offsets and search budgets. Full and low budgets correspond to 300×30 and 30×10 candidate rollouts.
LWM
LRA
Lobs
Lroll
PushT
Cube
Reacher
TwoRoom
Macro
✓
96.0
72.0
80.0
84.0
83.0
✓
✓
94.0
70.0
88.0
82.0
83.5
✓
✓
90.0
80.0
90.0
80.0
85.0
✓
✓
✓
94.0
84.0
82.0
86.0
86.5
✓
✓
✓
✓
96.0
84.0
92.0
86.0
89.5
Table 2: Loss ablation at the 25-step goal offset under unseeded CEM. Each variant is trained from scratch with identical architecture and optimization schedule, and evaluated with the full 300×30 budget. Success rates (%) are reported for different combinations of training objectives.
component
hyperparameter
value
input
image resolution / patch size
224×224 / 14
representation
latent dimension D
192
context
history h / rollout depth L
3 / 5
predictor
layers / heads / MLP width
6 / 16 / 2048
residual branch
layers / bottleneck rank
3 / 32
inverse head
depth / hidden width
2 / 256
Table 3: DIAL training hyperparameters. Values are shared across PushT, Cube, Reacher, and TwoRoom unless noted otherwise.
r
warm start
TwoRoom
PushT
Cube
Reacher
macro
5
on
42→92
62→58
54→58
88→84
61.5→73.0
1
on
44→86
30→28
50→58
38→46
40.5→54.5
1
off
22→90
30→46
54→60
30→82
34.0→69.5
Table 4: Sensitivity to replanning interval and warm starting. Macro success at the 50-step goal offset for standard CEM and dynamics-informed initialization under different replanning intervals. Entries are reported as standard CEM → dynamics-informed initialization.
Figure 10
k=5
k=10
env
nl2
R2
∥a^∥∞
nl2
R2
∥a^∥∞
TwoRoom
0.98
−0.02
1.3
1.07
−0.24
2.3
Reacher
1.09
−0.21
0.8
1.14
−0.32
0.8
Cube
1.94
−2.13
4.3
2.36
−4.55
5.2
PushT
4.61
−13.4
4.1
5.62
−16.8
4.5
Table 5: Inverse-head fidelity at different temporal gaps. Normalized ℓ2 error, R2 , and maximum predicted action magnitude of Gψ at five- and ten-step gaps across four environments.