VLMs for Robotics

VLM: Vision-Language Model

Ask about this topic

Momentum

92 papers in the last four weeks, up 608% on the four weeks before. 0.9% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 392

All topics
CardsList

  1. Characterizing Vision-Language-Action Models across XPUs: Constraints and Acceleration for On-Robot Deployment

    Apr 27, 2026Kaijun Zhou, Qiwei Chen, Da Peng +3AI Accelerator InferenceEdge Inference

    School of Computer Science, Shanghai Jiao Tong University

  2. AsyncShield: A Plug-and-Play Edge Adapter for Asynchronous Cloud-based VLA Navigation

    Apr 27, 2026Kai Yang, Zedong Chu, Yingnan Guo +6Robot NavigationVLMs for Robotics

    1Amap, Alibaba Group, Beijing, China. · 2Beijing Jiaotong University, Beijing, China.

  3. A Deployable Embodied Vision-Language Navigation System with Hierarchical Cognition and Context-Aware Exploration

    Apr 23, 2026Kuan Xu, Ruimeng Liu, Yizhuo Yang +5Robot NavigationVision-Language Navigation

    Center for Advanced Robotics Technology Innovation (CARTIN), School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore 639798 · Spatial AI & Robotics Lab, Department of Computer Science and Engineering, University at Buffalo, Buffalo, NY 14260

  4. CorridorVLA: Explicit Spatial Constraints for Generative Action Heads via Sparse Anchors

    Apr 23, 2026Dachong Li, ZhuangZhuang Chen, Jin Zhang +1Vision-Language-Action ModelsVLMs for Robotics

    College of Computer Science and Software Engineering, Shenzhen University · Hong Kong University of Science and Technology · School of Artificial Intelligence, Shenzhen University

  5. ReCAPA: Hierarchical Predictive Correction to Mitigate Cascading Failures

    Apr 23, 2026Xiyin Zeng, Yuyu Sun, Haoyang Li +2Vision-Language-Action ModelsVision-Language Alignment

    1Hong Kong University of Science and Technology (Guangzhou) · 2South China Normal University

  6. Open-H-Embodiment: A Large-Scale Dataset for Enabling Foundation Models in Medical Robotics

    Apr 22, 2026Open-H-Embodiment Consortium, :, Nigel Nelson +213World Models for RoboticsHealthcare

  7. Temporal Difference Calibration in Sequential Tasks: Application to Vision-Language-Action Models

    Apr 22, 2026Shelly Francis-Meretzki, Mirco Mutti, Yaniv Romano +1Uncertainty Estimation for VLA ModelsVision-Language-Action Models

    1Technion - Israel Institute of Technology.

  8. A Vision-Language-Action Model for Adaptive Ultrasound-Guided Needle Insertion and Needle Tracking

    Apr 22, 2026Yuelin Zhang, Qingpeng Ding, Longxiang Tang +2Robotic InsertionRobotic Ultrasound

    Department of Mechanical and Automation Engineering, The Chinese University of Hong Kong, Hong Kong · Department of Computer Science and Engineering, The Hong Kong University of Science and Technology, Hong Kong · Shenzhen International Graduate School, Tsinghua University, China +1

  9. JoyAI-RA 0.1: A Foundation Model for Robotic Autonomy

    Apr 22, 2026Tianle Zhang, Zhihao Yuan, Dafeng Chi +59Robot Skill LearningRobot Foundation Models

  10. EmbodiedMidtrain: Bridging the Gap between Vision-Language Models and Vision-Language-Action Models via Mid-training

    Apr 21, 2026Yiyang Du, Zhanqiu Guo, Xin Ye +2VLM AdaptationVision-Language-Action Models

    Language Technologies Institute, Carnegie Mellon University · Bosch Research North America & Bosch Center for Artificial Intelligence (BCAI)

  11. VLA Foundry: A Unified Framework for Training Vision-Language-Action Models

    Apr 21, 2026Jean Mercat, Sedrick Keh, Kushal Arora +5Robotic ManipulationVision-Language-Action Models

    Toyota Research Institute

  12. LiveVLN: Breaking the Stop-and-Go Loop in Vision-Language Navigation

    Apr 21, 2026Xiangchen Wang, Weiye Zhu, Teng Wang +5Vision-Language NavigationAction Chunking

    Southern University of Science and Technology · Harbin Institute of Technology, Shenzhen · Spatialtemporal AI

  13. GenerativeMPC: VLM-RAG-guided Whole-Body MPC with Virtual Impedance for Bimanual Mobile Manipulation

    Apr 21, 2026Marcelino Julio Fernando, Miguel Altamirano Cabrera, Jeffrin Sam +3Mobile ManipulationBimanual Robotic Manipulation

    Intelligent Space Robotics Laboratory, Skolkovo Institute of Science and Technology, Moscow, Russia

  14. Assessing VLM-Driven Semantic-Affordance Inference for Non-Humanoid Robot Morphologies

    Apr 21, 2026Jess Jones, Raul Santos-Rodriguez, Sabine HauertVLM EvaluationCross-Embodiment Robot Learning

    Bristol Robotics Laboratory, University of Bristol Bristol, United Kingdom · University of Bristol Bristol, United Kingdom

  15. Environmental Understanding Vision-Language Model for Embodied Agent

    Apr 21, 2026Jinsik Bang, Jaeyeon Bae, Donggyu Lee +2Embodied AIVLMs for Robotics

    UNIST

  16. SYMBOLIZER: Symbolic Model-free Task Planning with VLMs

    Apr 20, 2026Sami Azirar, Zlatan Ajanovic, Hermann BlumSymbolic PlanningRobot Task Planning

    RWTH Aachen · Robot Perception and Learning Lab, University of Bonn · Lamarr Institute for Machine Learning and Artificial Intelligence

  17. GaLa: Hypergraph-Guided Visual Language Models for Procedural Planning

    Apr 19, 2026Kun Wang, Yiming Li, Mingcheng Qu +3Visual Spatial ReasoningRobot Task Planning

    Harbin Institute of Technology, Harbin, China · Chongqing Research Institute of HIT, Chongqing, China · Guangdong Laboratory of Artificial Intelligence and Digital Economy (SZ), Shenzhen, China

  18. Rule-VLN: Bridging Perception and Compliance via Semantic Reasoning and Geometric Rectification

    Apr 18, 2026Jiawen Wen, Penglei Sun, Wenjie Zhang +4Safe Robot NavigationVision-Language Navigation

    The Hong Kong University of Science and Technology (Guangzhou), Guangzhou, China · Beijing Normal University, Beijing, China · 3Jul Guangzhou University, Guangzhou, China

  19. Chain Of Interaction Benchmark (COIN): When Reasoning meets Embodied Interaction

    Apr 18, 2026Xianhao Wang, Xiaojian Ma, Haozhe Hu +7Long-Horizon Robotic ManipulationRobotics

    University of Science and Technology of China · Beijing Institute for General Artificial Intelligence (BIGAI) · Xidian University +2

  20. Long-Term Memory for VLA-based Agents in Open-World Task Execution

    Apr 17, 2026Xu Huang, Weixin Mao, Yinhao Li +2Agent MemoryLong-Horizon Robotic Manipulation

    Nanjing University · LimX Dynamics

  21. ADAPT: Benchmarking Commonsense Planning under Unspecified Affordance Constraints

    Apr 16, 2026Pei-An Chen, Yong-Ching Liang, Jia-Fong Yeh +4Robot Task PlanningRobot Manipulation Benchmarks

    National Taiwan University · National Yang Ming Chiao Tung University · National Tsing Hua University

  22. Foundation Models in Robotics: A Comprehensive Review of Methods, Models, Datasets, Challenges and Future Research Directions

    Apr 16, 2026Aggelos Psiris, Vasileios Argyriou, Evangelos K. Markakis +4Large Language Model-Based Robot PlanningRobot Foundation Models

    Department of Informatics and Telematics, Harokopio University of Athens, Athens, Greece · Department of Networks and Digital Media, Kingston University, London, United Kingdom · Department of Electrical and Computer Engineering, Hellenic Mediterranean University, Heraklion, Greece +4

  23. World-Value-Action Model: Implicit Planning for Vision-Language-Action Systems

    Apr 16, 2026Runze Li, Hongyin Zhang, Junxi Jin +5Vision-Language-Action ModelsModel-Based Planning

    Westlake University Hangzhou, China · Nanjing University Suzhou Campus, 1520 Taihu Avenue, Suzhou, China

  24. Text-Guided 6D Object Pose Rearrangement via Closed-Loop VLM Agents

    Apr 10, 2026Sangwon Baik, Gunhee Kim, Mingi Choi +1Language-Conditioned Robot ManipulationObject Pose Estimation

    Seoul National University · RLWRLD

  25. DRIVE-Nav: Directional Reasoning, Inspection, and Verification for Efficient Open-Vocabulary Navigation

    Mar 30, 2026Maoguo Gao, Zejun Zhu, Zhiming Sun +6Embodied NavigationVLMs for Robotics

    1Beijing Institute of Technology · 2DeepBlue College · 3The National Key Laboratory of Autonomous Intelligent Unmanned Systems (KAIUS), School of Automation

  26. ManipArena: Comprehensive Real-world Evaluation of Reasoning-Oriented Generalist Robot Manipulation

    Mar 30, 2026Yu Sun, Meng Cao, Yang Ping +24Generalization in Robotic ManipulationRobotic Manipulation

    Sun Yat-sen University · X Square Robot · MBZUAI +2

  27. Grounding Sim-to-Real Generalization in Robotic Manipulation: An Empirical Study with Vision-Language-Action Models

    Mar 24, 2026Ruixing Jin, Zicheng Zhu, Ruixiang Ouyang +4Domain RandomizationRobotics Simulation

    School of Data Science, The Chinese University of Hong Kong, Shenzhen · Shenzhen Loop Area Institute

  28. Scaling Sim-to-Real VLA Reinforcement Learning with Generative 3D Worlds

    Mar 19, 2026Andrew Choi, Xinjie Wang, Zhizhong Su +1Sim-to-Real TransferVision-Language-Action Models

    Horizon Robotics

  29. ExecVLA: Following Fine-Grained Execution Constraints in Vision-Language-Action Models with Bi-Level Action Representation

    Mar 18, 2026Gaoge Han, Zhengqing Gao, Ziwen Li +5Vision-Language-Action ModelsVLMs for Robotics

    MBZUAI.

  30. Large Reward Models: Generalizable Online Robot Reward Generation with Vision-Language Models

    Mar 17, 2026Yanru Wu, Weiduo Yuan, Esteban Martinez Licon +4Long-Horizon Robotic ManipulationRobot Skill Learning

    USC Physical Superintelligence Lab