cs.RONov 8, 2026

ObjectWorld: Scaling Object-Centric World Models with A Large-Scale 3D Full-Object Flow Dataset

Authors: Haonan Chen, Sicheng Isabella Lu, Haitian Li, Jiajin Wu, Hexiang Wei, Jiawei Zhang, Xin Fei, Yiwen Hou, 

Organizations: School of Computing, National University of Singapore · NUS Guangzhou Research Translation and Innovation Institute · RoboScience

Abstract

Generative world modeling from large-scale visual data offers a promising path toward scalable robot manipulation. This calls for an intermediate representation that can be supervised at scale and remains actionable for downstream control. We propose 3D full-object flow, an object-centric motion representation that assigns dense 3D trajectories to points across the complete surface of a target object, including its occluded regions. By extending visible-surface object flow to the full object geometry, this representation makes complete object motion explicit and applies uniformly to both rigid and deformable objects. To realize the potential of this representation at scale, we introduce a 1210-hour full-object flow dataset that addresses the scarcity of large-scale supervision for complete 3D object motion. The dataset integrates diverse real-world videos and physical simulations, with a scalable annotation pipeline for recovering full-object motion from real-world observations and quality metrics for systematically assessing annotation quality. We then train a world model that takes an image and a task description as input and predicts dense full-object flow over the reconstructed object geometry. Experiments show reliable annotation quality, data-scalable flow prediction, and effective downstream manipulation across novel scenes and robot embodiments. Project website with additional results and videos: https://nus-lins-lab.github.io/ObjectWorld/.

Figures & tables

Appendix figures & tables4 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Deform360: A Massive Multi-view Visuotactile Dataset for Deformable World Models

    Jul 6, 2026Hongyu Li, Wanjia Fu, Xiaoyan Cong +11World ModelsDeformable Object Manipulation

  2. WorldFlow: Joint Video and 3D Motion Prediction via Large-Scale Pretraining

    Oct 29, 2026Yuhao Lu, Jiongxu Chen, Hexiang Wei +9Video World ModelsMultimodal Trajectory Prediction

  3. FlowVLA: Enabling World Dynamics Understanding through Pluggable 3D Flow Learning

    Oct 12, 2026Junhyeong Go, Mingyu Jung, Woobin Im +1Scene Flow EstimationVision-Language-Action Models