cs.CVNov 8, 2026

MoT3DVG: A Benchmark for Outdoor 3D Visual Grounding with Motion-Aware Descriptions and Temporal Cues

Authors: Shijia Zhao, Xusheng Guo, Qiming Xia, Xun Huang, Kezheng Xiong, Zhihong Liu, Chenglu Wen

Organizations: Fujian Key Laboratory of Urban Intelligent Sensing and Computing, Xiamen University, Xiamen, China. · Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University, Xiamen, China. · The Hong Kong Polytechnic University, Hong Kong SAR, China. · Zhongguancun Academy, China.

Abstract

3D visual grounding (3DVG) localizes language-referred objects in 3D scenes, with broad applicability in both indoor and outdoor environments. However, existing 3DVG research focuses on static indoor objects, limiting its use in dynamic outdoor autonomous driving. Motion descriptions, which capture the temporal dynamics of moving objects, offer a promising way to address this challenge. We therefore introduce MoT3DVG, a large-scale dataset for dynamic-aware outdoor 3DVG with temporally evolving motion descriptions. It contains 850 scenarios with 31,128 frames from nuScenes dataset, and provides 144,568 language prompts with motion-aware descriptions for dynamic objects across time. We further propose DynaVG, a novel framework that effectively leverages temporal cues for outdoor 3DVG. In addition to the standard modality-specific encoders, DynaVG introduces a Short-Long Integrated Dynamic Encoding (SLIDE) module before the language-point cloud alignment. SLIDE models both local motion cues and global temporal context via short-term window encoding and long-term window shifting. Extensive experiments demonstrate its state-of-the-art performance on MoT3DVG, validating the effectiveness of motion-aware encoding. Our work reveals open challenges and promising directions for future research in outdoor 3DVG.

Figures & tables

Appendix figures & tables13 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Talk2Sensors: 3D Visual Grounding in Autonomous Driving via Sensor-Adaptive Physical Cue Matching

    Aug 5, 2026Runwei Guan, Di Tian, Ningwei Ouyang +9Autonomous Driving DatasetsVLMs for Autonomous Driving

  2. PruneGround: Plug-and-play Spatial Pruning for 3D Visual Grounding

    Jun 30, 2026Duc Cao Dinh, Khai Le-Duc, Florent Draye +43D Spatial ReasoningVisually Grounded Reasoning