3D VQA

VQA: Visual Question Answering

Overview

Three-dimensional visual question answering (VQA) asks models to answer questions that require understanding objects, layouts, distances, viewpoints, or events in 3D scenes and volumes. Systems combine language models with point clouds, RGB-D images, multiview video, or reconstructed scene representations such as occupancy maps and scene graphs; some also use geometric tools to measure or retrieve relevant evidence. Benchmarks such as ScanQA and SQA3D test scene understanding and spatial reasoning, while medical VQA evaluates reasoning over volumetric scans. A central challenge is ensuring answers are grounded in 3D evidence rather than language or visual shortcuts, while making reasoning over many views accurate and efficient.

Latest papers

CardsList

51 papers9 papers in the last four weeks, up 50% on the four weeks before. 0.1% of all new papers.

  1. NeuroQA: A Large-Scale Image-Grounded Benchmark for 3D Brain MRI Understanding

    May 19, 2026Mohammad H. Abbasi, Favour Nerrise, Shaurnav Ghosh +12Healthcare3D Medical Imaging

  2. SPATIOROUTE: Dynamic Prompt Routing for Zero-Shot Spatial Reasoning

    May 18, 2026Pawat Chunhachatrachai, Gueter Josmy Faure, Hung-Ting Su +1Geospatial QAVisual Spatial Reasoning

  3. Proxy3D: Efficient 3D Representations for Vision-Language Models via Semantic Clustering and Alignment

    May 8, 2026Jerry Jiang, Haowen Sun, Denis Gudovskiy +43D Spatial Reasoning3D Representation Learning

  4. SpatialEvo: Self-Evolving Spatial Intelligence via Deterministic Geometric Environments

    Apr 15, 2026Dinging Li, Yingxiu Zhao, Xinrui Cheng +163D Spatial ReasoningSelf-Training

  5. GeoAlign: Geometric Feature Realignment for MLLM Spatial Reasoning

    Apr 14, 2026Zhaochen Liu, Limeng Qiao, Guanglu Wan +13D Spatial Reasoning3D VLMs

  6. SeGPruner: Semantic-Geometric Visual Token Pruner for 3D Question Answering

    Mar 31, 2026Wenli Li, Kai Zhao, Haoran Jiang +33D VQAVisual Token Pruning

  7. Chat-Scene++: Exploiting Context-Rich Object Identification for 3D LLM

    Mar 29, 2026Haifeng Huang, Yilun Chen, Zehan Wang +23D VLMs3D Scene Understanding

  8. HiSpatial: Taming Hierarchical 3D Spatial Understanding in Vision-Language Models

    Mar 26, 2026Huizhi Liang, Yichao Shen, Yu Deng +53D Spatial Reasoning3D VLMs

  9. 3DCity-LLM: Empowering Multi-modality Large Language Models for 3D City-scale Perception and Understanding

    Mar 24, 2026Yiping Chen, Jinpeng Li, Wenyu Ke +63D VLMs3D Scene Understanding

  10. Loc3R-VLM: Language-based Localization and 3D Reasoning with Vision-Language Models

    Mar 18, 2026Kevin Qu, Haozhe Qi, Mihai Dusmanu +33D VLMs3D Spatial Reasoning

  11. IOSVLM: A 3D Vision-Language Model for Unified Dental Diagnosis from Intraoral Scans

    Mar 17, 2026Huimin Xiong, Zijie Meng, Tianxiang Hu +33D VLMsMedical VLMs

  12. Point Cloud as a Foreign Language for Multi-modal Large Language Model

    Mar 10, 2026Sneha Paul, Zachary Patterson, Nizar Bouguila3D VLMsPoint Cloud Learning

  13. Holi-Spatial: Evolving Video Streams into Holistic 3D Spatial Intelligence

    Mar 8, 2026Yuanyuan Gao, Hao Li, Yifei Liu +143D Scene Understanding3D Spatial Reasoning

  14. Do 3D Large Language Models Really Understand 3D Spatial Relationships?

    Mar 6, 2026Xianzheng Ma, Tao Sun, Shuai Chen +73D Spatial Reasoning3D VQA

  15. DeepSight: Bridging Depth Maps and Language with a Depth-Driven Multimodal Model

    Mar 6, 2026Hao Yang, Hongbo Zhang, Yanyan Zhao +13D VLMsVision-Language Models

  16. Thinking with Spatial Code for Physical-World Video Reasoning

    Mar 5, 2026Jieneng Chen, Wenxin Ma, Ruisheng Yuan +3Visual Spatial ReasoningPhysical Reasoning in Video

  17. CT-Flow: Orchestrating CT Interpretation Workflow with Model Context Protocol Servers

    Feb 23, 2026Yannian Gu, Xizhuo Zhang, Linjie Mu +4Medical Image AnalysisMedical VLMs

  18. 3DMedAgent: Unified Perception-to-Understanding for 3D Medical Analysis

    Feb 20, 2026Ziyue Wang, Linghan Cai, Chang Han Low +83D Medical ImagingMedical VLMs

  19. Scene-R1: Video-Grounded Large Language Models for 3D Scene Reasoning with Lightweight Annotations

    Jun 21, 2025Junjie Wang, Zhihao Yuan, Shuyi Jiang +53D Scene Understanding3D VLMs