cs.CVOct 30, 2026

GenDSR: Transferring Representations from Video Generation Models for Dynamic Spatial Reasoning

Authors: Ke Yang, Zhenyu Zhang, Jun Li

Organizations: Nanjing University

Abstract

Dynamic spatial reasoning is essential for connecting visual intelligence to thephysical world, yet remains challenging for vision-language models (VLMs), which must preserve scene state while tracking how spatial relations evolve over time. Meanwhile, video generation models (VGMs), trained to synthesize temporally coherent world dynamics, offer a rich source of spatiotemporal representations. We present GenDSR, a framework that transfers intermediate representations from VGM into VLM for dynamic spatial reasoning. Rather than treating a VGM feature as a monolithic prior, GenDSR constructs two complementary branches: a raw branch preserving holistic generative context and a delta branch emphasizing temporal variation. Task-conditioned tokenwise gates then fuse both signals and inject the result into the native visual representation. On DSR-Bench, GenDSR achieves 67.2%, surpassing the previous best result and establishing a new state of the art.

Figures & tables

Explore similar work

CardsList
  1. 4DThinker: Thinking with 4D Imagery for Dynamic Spatial Understanding

    May 7, 2026Zhangquan Chen, Manyuan Zhang, Xinlei Yu +9Visual Spatial ReasoningVideo Reasoning

  2. World2VLM: Distilling World Model Imagination into VLMs for Dynamic Spatial Reasoning

    Apr 29, 2026Wanyue Zhang, Wenxiang Wu, Wang Xu +6Visual Spatial ReasoningVLM Adaptation

  3. Make Geometry Matter for Spatial Reasoning

    Mar 27, 2026Shihua Zhang, Qiuhong Shen, Shizun Wang +2Visual Spatial Reasoning3D Spatial Reasoning