Visual Grounding for Robotics

Follow this topic Ask about this topic

Latest papers

25 papers7 papers in the last four weeks, up 133% on the four weeks before. 0.0% of all new papers.

StopWatch: Goal Grounding for Object-goal Navigation
Oct 16, 2026Xinhao Liu, Yunsheng Tian, Yuheng Qiu +4Object-Goal Navigation Visual Grounding for Robotics
Amazon FAR · New York University · UC Berkeley +1
Spa-Bench: A Real-Robot Benchmark for Spatial Grounding in Vision-Language-Action Models
Oct 8, 2026Justin Tien-Smith, Matthew Pidden, Rolandos Alexandros PotamiasSpatial Grounding for VLA Models Visual Grounding for Robotics
Imperial College London
Instance-anchored interaction evidence: Grounding robot plans in human pointing and handling
Oct 8, 2026Xinliang Xiao, Bowen Yang, Wenjing Zhang +2Visual Grounding for Robotics Robot Task Planning
Nanjing University of Science and Technology, Nanjing, 210094, China
GroundingPI: A Grounding Foundation Model towards Physical Intelligence with Visual Primitives
Sep 30, 2026Qize Yu, Lianrui Fan, Boyu Chen +23Vision-Language Grounding VLMs for Robotics
XPeng Inc. · Peking University · The University of Hong Kong +5
Pro-Bench: Prompt-Robust Open-Vocabulary Visual Grounding Across Real-World Heterogeneous Environments
Sep 22, 2026Linus Nwankwo, Muslim Alaran, Christian Rauch +2Vision-Language Grounding Visual Grounding
Chair of Cyber-Physical Systems, Montanuniversität Leoben, Austria. · Department of Design Engineering and Mathematics, Middlesex University, London, UK.
MIGU: Multimodal Instruction Grounding under Uncertainty for Manipulation Planning
Sep 21, 2026Mingke Lu, Anxing Xiao, David HsuMultimodal Grounding Robot Task Planning
School of Computing and Smart Systems Institute, National University of Singapore, Singapore · Department of Electrical and Computer Engineering, University of California, Los Angeles, Los Angeles, CA, USA
Grounded Action Model: 3D Grounding as a Foundation for Robotics
Sep 20, 2026Gehao Zhang, Weikai Huang, Shailesh Shailesh +3Long-Horizon Robotic Manipulation Language-Conditioned Robot Manipulation
Northwestern University · University of Washington · National University of Singapore +1
AR-WAM: A Visual-Conditioned Agent-Ready World Action Model for Robotic Manipulation
Sep 20, 2026Yicheng Jiang, Zesen Gan, Xiaobo Wang +8Robotic Control Long-Horizon Robotic Manipulation
The Hong Kong University of Science and Technology · Shenzhen University of Advanced Technology · Sangfor Technologies Inc. +4
RefGuard: Identity-Aware Language-Guided Robot Manipulation via Joint Target-Anchor-Frame Grounding
Sep 5, 2026Lan Wei, Kangyi Lu, Yongchen Wang +5Language-Conditioned Robot Manipulation Vision-Language Grounding
Imperial College London, UK · RACE, United Kingdom Atomic Energy Authority, UK · Oxford Robotics Institute, University of Oxford, UK +1
GRAFT: Grounded and Efficient Online Reinforcement Adaptation for Fine-Grained Robot Manipulation
Aug 27, 2026Yibo Qiu, Haoliang Ye, Shu'ang Sun +3Visual Grounding for Robotics RL for Robotics
Suzhou Institute for Advanced Research, University of Science and Technology of China, Suzhou, Jiangsu, China, and also with the School of Biomedical Engineering, Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei, Anhui, China
Pointing-VLA: Typed Spatial Grounding Interfaces for Vision-Language-Action Manipulation
Aug 24, 2026Xiwen Chen, Zelin Li, Zhiruo Zhou +3Spatial Grounding for VLA Models Vision-Language-Action Models
SIGS, Tsinghua University, China · Shanghai Jiao Tong University, China · Wuhan University of Technology, China +2
Artificial Foveated Perception for Mitigating Shortcut Learning in Robotic Foundation Models
Jul 12, 2026Xiatao Sun, Yuan Zhuang, Mateo Sanchez Lopez Negrete +9Robot Foundation Models Visual Grounding
Yale University · University of Connecticut · Peking University +2
GeoProp: Grounding Robot State in Vision for Generalist Manipulation
Jul 8, 2026Guoyang Zhao, Quanhao Qian, Gongjie Zhang +5Generalization in Robotic Manipulation Visuomotor Policy Learning
Tongji University · DAMO Academy, Alibaba Group · HuPan Lab +2
Where Am I? Semantic Map Grounding via Vision-Language Models for Multi-Modal Localization
Jul 1, 2026Suraj Borate, Aarav Shah, Madhu VadaliMap-Based Localization Robot Localization
IIT Gandhinagar, Gandhinagar, Gujarat, India
GROW $^2$ : Grounding Which and Where for Robot Tool Use
Jun 29, 2026Yuhong Deng, Yuyao Liu, David Hsu3D Visual Grounding Robotic Tool Use
1National University of Singapore · 2Massachusetts Institute of Technology
SPARC: Reliable Spatial Annotations from Robot Demonstrations at Scale
Jun 11, 2026Nils Blank, Paul Mattes, Maximilian Xiling Li +53D Visual Grounding Visual Grounding for Robotics
Karlsruhe Institute of Technology · NVIDIA · Robotics Institute Germany
RGB-S: Image-Aligned Tactile Saliency for Robust Dexterous Manipulation
Jun 7, 2026Shengcheng Luo, Kefei Wu, Xiaoying Zhou +3Contact-Rich Robotic Manipulation Visuo-Tactile Representation Learning
ShanghaiTech University · Beijing Institute for General Artificial Intelligence
EmbodimentSemantic: A Spatial Scene-Graph Dataset and Benchmark for Vision-Language Models on Embodied Manipulation Trajectories
Jun 6, 2026Hassan Jaber, Refinath S N, Luca Cagliero +2Visually Grounded Reasoning Visual Spatial Reasoning
Politecnico di Torino, Italy · Huawei, Noah’s Ark Lab, United Kingdom · University College London, United Kingdom
Goal2Pixel: Grounding Goals to Pixels for Vision-Language Navigation
Jun 1, 2026Muyi Bao, Yuxin Cai, Hang Xu +7Embodied Navigation VLM Adaptation
Carnegie Mellon University · Nanyang Technological University
RobotEQ: Transitioning from Passive Intelligence to Active Intelligence in Embodied AI
May 7, 2026Kuofei Fang, Xinyi Che, Haomin Ouyang +12Human-Robot Interaction Embodied AI
State Key Laboratory of Autonomous Intelligent Unmanned Systems, Tongji University · Tsinghua University · The Chinese University of Hong Kong +1
HiVLA: A Visual-Grounded-Centric Hierarchical Embodied Manipulation System
Apr 15, 2026Tianshuo Yang, Guanyu Chen, Yutian Chen +8Hierarchical Robot Control Visual Grounding for Robotics
The University of Hong Kong · Shanghai AI Laboratory · Shanghai Jiao Tong University +1
Meanings and Measurements: Multi-Agent Probabilistic Grounding for Vision-Language Navigation
Mar 19, 2026Swagat Padhan, Lakshya Jain, Bhavya Minesh Shah +3Visual Grounding for Robotics Spatial Grounding for VLA Models
Arizona State University · Haverford College
SVLL: Staged Vision-Language Learning for Physically Grounded Embodied Task Planning
Mar 12, 2026Yuyuan Yang, Junkun Hong, Hongrong Wang +11Visual Grounding for Robotics Large Language Model-Based Robot Planning
FNii-Shenzhen, CUHKSZ · Shenzhen University · SAI, CUHKSZ +4
OpenFrontier: General Navigation with Visual-Language Grounded Frontiers
Mar 5, 2026Esteban Padilla-Cerdio, Boyang Sun, Marc Pollefeys +1Robot Navigation Vision-Language Navigation
1ETH Zurich · 2Microsoft Spatial AI Lab · University of Bonn
Gondola: Grounded Vision Language Planning for Robotic Manipulation
Jun 12, 2025Shizhe Chen, Ricardo Garcia, Paul Pacaud +1Long-Horizon Robotic Manipulation Robot Task Planning
Inria, École normale supérieure, CNRS, PSL Research University

Oct 16, 2026J/K move · Enter open · S save

StopWatch: Goal Grounding for Object-goal Navigation

Xinhao Liu, Yunsheng Tian, Yuheng Qiu, Pieter Abbeel+3

Amazon FAR · New York University · UC Berkeley+1

Object-Goal Navigation Visual Grounding for Robotics VLMs for Robotics Robot Navigation Benchmarks

Open paper AskPDF arXiv

Pretrained VLMs bring rich world knowledge and semantic priors to object-goal navigation, and fine-tuning a VLM into a navigation policy has become a common recipe. Despite this progress, success rates remain low, and it is unclear which capability these fine-tuned policies lack. Our diagnosis identifies goal grounding as the dominant failure. These policies explore well, yet often fail to notice that the goal is already in view or to estimate how far away it is. To address this failure, we ground the goal explicitly. Explicit grounding substantially improves success and reaches state-of-the-art results on six benchmarks across three scene collections. We also correct annotation defects in these benchmarks, so that future methods are evaluated more faithfully. Our analysis on the clean benchmarks shows that, with ground-truth grounding, our policy nearly matches the expert that generated its demonstrations, leaving the headroom in perception rather than policy learning. Our work points to goal grounding as a missing piece of object-goal navigation and offers a simple and effective solution to the task.