cs.CVNov 12, 2026

Spatial Foundry: A Multimodal Dataset for Spatial Intelligence

Authors: Ethan Lin, Yang Song

Organizations: Ranolabs

Abstract

Spatial intelligence requires connecting visual observations to the geometry, objects, and persistent state of an environment. Images alone leave these relationships implicit, while disconnected annotations make it difficult to study appearance, camera motion, and scene changes under a common reference. We introduce Spatial Foundry, a collection of 5,280 furnished residential 3D scene configurations with editable assets and aligned visual, geometric, and temporal data. Its modalities include floor plans, perspective and panoramic RGB, metric depth, point clouds, meshes, instance-level 3D bounding boxes, and camera trajectories paired with video. Shared scene coordinates link observations across views and time; editable source scenes enable additional camera paths and controlled object changes. We describe the data representation and construction workflow, and discuss applications in floor-plan-conditioned 3D generation, geometric reconstruction, instance-level perception, camera-conditioned video generation, shared world modeling, and scene editing. Controlled camera and scene variations support spatial perception and world-model research. The public project page provides videos and an interactive colored point-cloud preview.

Figures & tables

Explore similar work

CardsList
  1. SPARGen: Unifying Spatial Perception and Reasoning through Native Multimodal Generation

    Aug 14, 2026Jinsheng Quan, Jianhua Li, Siyi Xie +7Multimodal Spatial Reasoning3D Spatial Reasoning

  2. Exploring Spatial Intelligence from a Generative Perspective

    Apr 22, 2026Muzhi Zhu, Shunyao Jiang, Huanyi Zheng +9Spatial ReasoningUnified Multimodal Models

  3. Holi-Spatial: Evolving Video Streams into Holistic 3D Spatial Intelligence

    Mar 8, 2026Yuanyuan Gao, Hao Li, Yifei Liu +143D Scene Understanding3D Spatial Reasoning