cs.CVNov 15, 2026

Pros4D: Modeling Evolving 4D Worlds in Latent Space for Dynamic Spatial Reasoning

Authors: Rongxin Gao, Dongxuan Liu, Chu Li, Chengyang Ji, Jialing Huang, Runyu Chen, Kairun Wen, Chenxin Li, 

Organizations: XMU · CUMT · CUHK · THU · 

Abstract

Dynamic spatial reasoning from monocular video enables vision-language models (VLMs) to understand how 3D environments evolve over time, supporting physical world understanding and embodied intelligence. Existing efforts primarily address observed-dynamics understanding, whereas agents in dynamic environments also require future-dynamics prediction beyond the observation boundary. Moreover, external geometric processing and textual descriptions can increase inference complexity or lose information when representing continuous dynamics. These limitations motivate a shared internal state that preserves observed dynamics and remains predictive beyond the input video. Accordingly, we present Pros4D, a framework for modeling evolving 4D worlds in latent space that unifies retrospective understanding of observed-dynamics with prospective reasoning for future-dynamics prediction. Specifically, Pros4D-Engine derives geometry-grounded supervision and constructs paired examples for both tasks, while Pros4D-Bench evaluates them across eight spatial task categories spanning dynamic cameras, objects, and scenes. At the model level, Pros4D compresses observed dynamics into latent observed states and autoregressively rolls them forward into latent future states. 4D Latent Alignment (4DLA) grounds these states through complementary visual-semantic and geometric supervision, while joint language supervision connects them to task reasoning. Experiments across benchmarks show consistent improvements over strong baselines in both capabilities.

Figures & tables

Appendix figures & tables14 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. 4DThinker: Thinking with 4D Imagery for Dynamic Spatial Understanding

    May 7, 2026Zhangquan Chen, Manyuan Zhang, Xinlei Yu +9Visual Spatial ReasoningVideo Reasoning

  2. Trace4D: Grounded Spatiotemporal Reasoning via 4D State Sequences

    Nov 2, 2026Wooseok Jang, Seungryong Kim, Yan Lu +1Spatiotemporal ReasoningTemporal Reasoning in VLMs