cs.AINov 18, 2026

Embodied Graph: A Relational World Model for Long-Horizon Tasks

Authors: Zongyuan Wu, Xin Wang, Tongtong Feng, Yuan Meng, Zeyang Zhang, Ling Feng, Wenwu Zhu

Organizations: Tsinghua University

Abstract

Long-horizon tasks in embodied and web environments involve extended decision sequences and delayed feedback, making accurate planning crucial for success. World models tackle this by learning latent dynamics for imagination-based planning. However, existing approaches merely rely on dense pixel-level observations, which forces the model to absorb redundant information while overlooking relations among task-relevant entities. Consequently, small errors may accumulate over long imagined rollouts and gradually corrupt the predictions. In this paper, we explore world models that imagine over sparse state abstractions, which poses two key challenges: 1) how to remove redundant information and form a compact state abstraction; 2) how to incorporate the relational structure to learn reliable long-horizon dynamics. To address these challenges, we propose Embodied Graph, a relational state abstraction that supports structured dynamics modeling and long-horizon imagination, and the Relational World Model (RWM), which performs imagination directly over graph states. RWM consists of (i) a Task-Aware Embodied Graph Constructor that filters redundant details and maintains graph memory through online updates, and (ii) an Embodied Graph Recurrent State Space Model that learns node-wise latent dynamics while capturing inter-node dependencies. The imagined graph states provide predictions of action consequences to guide decision-making. Experiments on Minecraft and Crafter demonstrate the effectiveness of RWM in embodied environments. Notably, in Minecraft, RWM is the only method that obtains diamonds within the given budget. Experiments on web interaction further illustrate the applicability of relational state prediction to the decision making process of web agents.

Figures & tables

Appendix figures & tables3 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. World-as-Graph: Relational World Modeling Through Latent Space Graphs

    Sep 30, 2026Yaqi Yang, Shuo Huang, Yujin Huang +3Graph Structure LearningWorld Model Learning

  2. MemWM: Associative Memory-Enhanced Latent World Models for Long-Horizon Planning

    Oct 14, 2026Yuwei Sun, Siyu ZhuWorld Model LearningWorld Models for Robotics

  3. Beyond the Next Step: Variable-Length Latent World Models for Long-Horizon Planning

    Jun 19, 2026Tianqi Du, Qi Zhang, Yifei Wang +1Latent Dynamics ModelingWorld Models