cs.RONov 12, 2026

Rethinking Actions: Continuity-Aware Priors for World-Model Planning

Authors: Shaobo Yang, Zichen Ai, Ziyang Ma, Qian Yang, Bin Fang

Organizations: Beijing University of Posts and Telecommunications · Alibaba Group

Abstract

Actions in expert demonstrations exhibit temporal structure. An ordered-versus-shuffled analysis across five environments confirms this dependence. We ask whether action proposals that better reflect expert continuity can improve visual world-model planning. Rather than imposing generic smoothness, we learn continuations from the temporal structure of demonstrated actions. Our locality-gated deep-kernel Gaussian-process prior, LG-DKGP, combines recent and longer-range executed action history, predicts a neural continuation, and learns a temporal Gaussian-process (GP) residual. A training-derived exploration scale initializes search around the corrected mean; a frozen world model evaluates progress toward the goal. Training first fits the neural mean, then jointly optimizes the prior with the GP residual using expert future actions. The resulting planner achieves 87.07% macro success across five simulated tasks spanning native and fragment-level goal attainment, compared with 71.03% for INTACT, 61.66% for PRISM, and 58.66% for LeWM. Component interventions and expert-relative action-structure comparisons support demonstration-informed continuations and reveal task-dependent effects of visual conditioning, history length, and planning horizon.

Figures & tables

Appendix figures & tables18 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. PRISM: PRior-guided Imagination Sampling in world Models

    Jun 6, 2026Yuhai Wang, Jiawei Xia, Bowen Sun +5World Models for RoboticsWorld Model-Based Planning

  2. Reinforced Planning with Latent World Models

    Aug 19, 2026Armin Sommer, Jannik SchillingWorld Model-Based PlanningRobotic RL

  3. IMWM: Intuition Models Complement World Models for Latent Planning

    Jun 1, 2026Baoqi Gao, Ruize Han, Miao Wang +1World Model-Based PlanningGoal-Conditioned Planning