3D Visual Grounding

Follow this topic Ask about this topic

Latest papers 101

23 papers in the last four weeks, up 92% on the four weeks before. 0.2% of all new papers.

All topics

SATURN: Symbolic Spatial Reasoning for Multi-Perspective Grounding
Jun 21, 2026Danial Kamali, Tanawan Premsri, Shreya Rajpal +33D Spatial Reasoning Visually Grounded Reasoning
Michigan State University · Lambda Labs
Scaling Diverse Language Generation for 3D Visual Grounding
Jun 18, 2026Austin T. Wang, Dongchen Yang, Angel X. ChangSynthetic Data Generation Text Generation
Simon Fraser University
See-and-Reach: Precise Vision-Language Navigation for UAVs within the Field of View
Jun 18, 2026Fanfu Xue, En Yu, Yantian Shen +5UAV Navigation Vision-Language Navigation
School of Information Science and Engineering, Shandong University, Qingdao 266237, China · Faculty of Engineering and Information Technology, University of Technology Sydney, Sydney, NSW, Australia · School of Computer Science and Technology, Shandong University, Qingdao 266237, China +3
3D-PLOT-LLM: Part-Level Object Tokens for 3D Large Language Models
Jun 18, 2026Jintang Xue, Xinyu Wang, Yixing Wu +23D Representation Learning Multimodal Foundation Models
University of Southern California Los Angeles, California, USA · Ohio State University Columbus, Ohio, USA
ZeroDex: Zero-Shot Long-Horizon Dexterous Manipulation via Multi-View 3D-Grounded VLM Reasoning
Jun 17, 2026Jisoo Kim, Sangwon Baik, Taeksoo Kim +4Dexterous Manipulation Zero-Shot Robotic Manipulation
Seoul National University · RLWRLD
SPARC: Reliable Spatial Annotations from Robot Demonstrations at Scale
Jun 11, 2026Nils Blank, Paul Mattes, Maximilian Xiling Li +53D Visual Grounding
Karlsruhe Institute of Technology · NVIDIA · Robotics Institute Germany
Segment and Select: Vision-Language Segmentation in 3D Scenarios
Jun 9, 2026Yulin Chen, Zhihang Zhong, Yuenan Hou3D Point Cloud Segmentation Referring Expression Segmentation
Shanghai AI Laboratory · University of Science and Technology of China · Shanghai Jiaotong University
EmbodimentSemantic: A Spatial Scene-Graph Dataset and Benchmark for Vision-Language Models on Embodied Manipulation Trajectories
Jun 6, 2026Hassan Jaber, Refinath S N, Luca Cagliero +2Scene Graph Generation Visual Spatial Reasoning
Politecnico di Torino, Italy · Huawei, Noah’s Ark Lab, United Kingdom · University College London, United Kingdom
Stream3D-VLM: Online 3D Spatial Understanding with Incremental Geometry Priors
Jun 5, 2026Hanxun Yu, Xuan Qu, Lei Ke +43D Spatial Reasoning 3D VQA
1Zhejiang University · 2Tencent Hunyuan · 3HKUST +1
PAR3D: A Unified 3D-MLLM with Part-Aware Representation for Scene Understanding
Jun 4, 2026Shaohui Dai, Yansong Qu, You Shen +23D Part Segmentation 3D Representation Learning
Key Laboratory of Multimedia Trusted Perception and Efficient Computing, Ministry of Education of China, Xiamen University
T-FunS3D: Task-Driven Hierarchical Open-Vocabulary 3D Functionality Segmentation
Jun 4, 2026Jingkun Feng, Reza SabzevariOpen-Vocabulary 3D Segmentation 3D Part Segmentation
P4MARS Lab at the Faculty of Aerospace Engineering, Delft University of Technology
Grounded 3D-Aware Spatial Vision-Language Modeling
May 28, 2026An-Chieh Cheng, Yang Fu, Yatai Ji +123D Spatial Reasoning Visually Grounded Reasoning
UCSD · NVIDIA · MIT
DGSG-Mind: Dynamic 3D Gaussian Scene Graphs for Long-Term Scene Understanding and Grounding
May 28, 2026Luzhou Ge, Xiangyu Zhu, Jinyan Liu +13D Gaussian Splatting Open-Vocabulary 3D Segmentation
School of Computer Science, Beijing Institute of Technology, Beijing 100081, China.
Embodied3DBench: Benchmarking Low-Level Embodied Spatial Intelligence of Vision Language Models
May 27, 2026Jiyao Zhang, Mingxu Zhang, Yitong Peng +8VLM Evaluation Spatial Reasoning Benchmarks
SSR3D-LLM: Structured Spatial Reasoning via Latent Steps for Fine-Grained Grounding in Unified 3D-LLMs
May 27, 2026Jiawei Li, Ziyi Liu, Weijie Shi +33D Spatial Reasoning Latent Visual Reasoning
The Hong Kong University of Science and Technology · Soochow University
AgentGrounder: Zero-Shot 3D Visual Pointcloud Grounding using Multimodal Language Models
May 25, 2026Cuong Huynh, Maxim Popov, Denis Gridusov +13D Visual Grounding
Biomechatronics and Energy-Efficient Robotics (BE2R) Lab, ITMO University, Saint Petersburg, Russia
FOUND-IT: Foundation-model-first Task-driven 3D Scene Graphs with Granularity on Demand
May 25, 2026Dominic Maggio, Nicolas Gorlo, Kris Hauser +13D Foundation Models Scene Graph Generation
Laboratory for Information & Decision Systems, Massachusetts Institute of Technology Cambridge, MA, USA · Samsung Research America
PoseRefer: Pathway-Local Parameters for Semantically Grounded Reference Resolution
May 23, 2026Anna DeichlerMultimodal Grounding Multimodal Fusion
KTH Royal Institute of Technology, Stockholm, Sweden
D2-V2X: Depth-Driven Cooperative V2X Reasoning for Autonomous Driving
May 22, 2026Kevin Richard, Alphin Varghese, Colin Pham +2VLMs for Autonomous Driving Cross-Modal Alignment
University of North Carolina at Charlotte
MM-Conv: A Multimodal Dataset and Benchmark for Context-Aware Grounding in 3D Dialogue
May 20, 2026Anna Deichler, Jim O'Regan, Fethiye Irmak Dogan +4Query Reformulation Visually Grounded Reasoning
KTH Royal Institute of Technology, Stockholm, Sweden
SceneGraphGrounder: Zero-Shot 3D Visual Grounding via Structured Scene Graph Matching
May 20, 2026Xuefei Sun, Xujia Zhang, Brendan Crowe +23D SGG Visually Grounded Reasoning
University of Colorado Boulder
Towards Camera-Robust 3D Localization: Equation-Anchored Tool-Use for MLLMs
May 19, 2026Xueying Jiang, Wenhao Li, Quanhao Qian +43D Object Detection 3D VLMs
1Nanyang Technological University · 2DAMO Academy, Alibaba Group · 3HuPan Lab +1
3D Segmentation Using Viewpoint-Dependent Spatial Relationships
May 15, 2026Ayaka Nanri, Klara Reichard, Mert Kiray +33D Spatial Reasoning 3D Scene Understanding
Institute of Science Tokyo · Technical University of Munich · BMW Group +12
Grounding by Remembering: Cross-Scene and In-Scene Memory for 3D Functional Affordances
May 12, 2026Qirui Wang, Jingyi He, Yining Pan +2Visually Grounded Reasoning Memory-Augmented Agents
TUM · A*STAR
Curvature-Aware Captioning:Leveraging Geodesic Attention for 3D Scene Understanding
May 9, 2026Ziyao He, Yingjie Liu, ZhangYangRui +3Attention Mechanisms Hyperbolic Representation Learning
East China Normal University
Proxy3D: Efficient 3D Representations for Vision-Language Models via Semantic Clustering and Alignment
May 8, 2026Jerry Jiang, Haowen Sun, Denis Gudovskiy +43D Spatial Reasoning 3D Representation Learning
Tsinghua University · Panasonic AI Lab · Panasonic DX-CPS +1
Ilov3Splat: Instance-Level Open-Vocabulary 3D Scene Understanding in Gaussian Splatting
May 6, 2026Binh Long Nguyen, Kien Nguyen, Sridha Sridharan +23D Gaussian Splatting Language-Embedded 3DGS
School of Electrical Engineering and Robotics, Queensland University of Technology (QUT), Brisbane, QLD 4000, Australia · CSIRO Robotics, CSIRO, Brisbane, QLD 4069, Australia
Towards Visual Query Localization in the 3D World
May 2, 2026Liang Peng, Bohan Tan, Zhipeng Zhang +4Multimodal Fusion 3D Visual Grounding
Wuhan University · AutoLab, SAI, Shanghai Jiao Tong University · Anyverse Dynamics +2
Multiple Consistent 2D-3D Mappings for Robust Zero-Shot 3D Visual Grounding
Apr 29, 2026Yufei Yin, Jie Zheng, Qianke Meng +73D VLMs 3D Visual Grounding
Hangzhou Dianzi University Hangzhou, Zhejiang, China · Zhejiang University Hangzhou, Zhejiang, China · Alibaba Group Hangzhou, Zhejiang, China
RADIO-ViPE: Online Tightly Coupled Multi-Modal Fusion for Open-Vocabulary Semantic SLAM in Dynamic Environments
Apr 28, 2026Zaid Nasser, Mikhail Iumanov, Tianhao Li +3Simultaneous Localization and Mapping Visual SLAM
Biomechatronics and Energy-Efficient Robotics (BE2R) Lab, ITMO University, Saint Petersburg, Russia

Jun 21, 2026, cs.CVJ/K move · Enter open · S save

SATURN: Symbolic Spatial Reasoning for Multi-Perspective Grounding

Danial Kamali, Tanawan Premsri, Shreya Rajpal, Amir Zadeh+2

Michigan State University · Lambda Labs

3D Spatial Reasoning Visually Grounded Reasoning Neuro-Symbolic Reasoning Spatial Reasoning 3D Visual Grounding

Open paper AskPDF arXiv

Vision-Language Models (VLMs) remain unreliable when spatial reasoning requires composing relations whose meanings depend on frames of reference. Existing neuro-symbolic methods make reasoning more explicit, but often depend on brittle geometric procedures and hard decisions over noisy perception. We propose SATURN, a neuro-symbolic framework for perspective-aware compositional spatial reasoning. SATURN reconstructs an approximate 3D scene, derives soft perspective-aware spatial predicates, and composes them with a training-free Pythonic symbolic executor, separating perception from reasoning while preserving uncertainty through multi-hop inference. We also introduce 3D FORCE, a diagnostic benchmark that controls reasoning depth, view, and perspective composition across spatial arrangement grounding (SAG) and referring expression grounding (REF). On 3D FORCE, VLMs and spatially trained models degrade sharply as depth and perspective complexity increase, whereas SATURN remains stable and outperforms strong baselines. On the real-world MindCube benchmark, SATURN achieves 78.57% overall accuracy, outperforming the strongest baseline by 14 pp.