VLMs for Robotics

VLM: Vision-Language Model

Ask about this topic

Momentum

92 papers in the last four weeks, up 608% on the four weeks before. 0.9% of all new papers.

Jul 13Week of Sep 28
View on map

Latest papers 392

All topics
CardsList

  1. Capability-Aware Arbitration for Semantic Intent-Based Shared Control

    Sep 21, 2026Zhaoda Du, Michael Bowman, Xiaoli ZhangUncertainty Estimation for VLA ModelsHuman-Robot Collaboration

    Colorado School of Mines, Golden, CO 80401, USA. · University of Pennsylvania, Philadelphia, PA 19104, USA.

  2. X-Planner: Event-Structured Task Planning for Embodied Intelligence

    Sep 21, 2026Howard Lu, Shalfun Li, Porter Pan +30Robot Task PlanningVLM Reasoning

    X Square Robot Team

  3. Think Like a World Model, Act Like a VLA: Distilling World-Model Representations into Compact Robot Policies

    Sep 21, 2026Trung Dao, Sankalp Yamsani, Jaden Park +2World ModelsRobotic Manipulation

    University of Wisconsin–Madison, USA · University of Illinois Urbana-Champaign, USA

  4. ME-VLM: A Unified VLM for Embodied Cognition and Agent Coordination

    Sep 21, 2026Foundation Model, Li Auto IncMultimodal AgentsEmbodied AI

    Li Auto Inc.

  5. FoldQuantVLA: Native Low-Bit Quantization of Vision-Language-Action Models via Consistent Folding

    Sep 21, 2026Hung T. Ho, Khanh D. Nguyen, Quang D. Nguyen +5VLM QuantizationEfficient VLA Model Inference

    VinRobotics, Vietnam · AICV Lab, EECS Department, University of Arkansas · School of Advanced Manufacturing and Robotics, Peking University, China +2

  6. StenoVLA-3D: 3D-Aware Reasoning VLA for Navigation Through Gastrointestinal Stenoses

    Sep 21, 2026Tamima Tabassum, Yiming Huang, Tianchun Wu +7EndoscopyRobotics

    *Equal contributor · †Corresponding author

  7. ActiveArena: Benchmarking and Understanding Active Perception in Robotic Manipulation

    Sep 21, 2026Yibo Li, Enshen Zhou, Rui Chen +7Memory-Augmented VLMsActive Perception

    Beihang University · Beijing Academy of Artificial Intelligence · Peking University +1

  8. RoboTalk: Learning Multi-Robot Communication and Coordination from Multimodal Demonstrations

    Sep 21, 2026Dorian Benhamou Goldfajn, Mason Nakamura, Saaduddin Mahmud +3Multi-Robot SystemsLanguage-Conditioned Robot Manipulation

    University of Massachusetts, Amherst, MA, USA. · University of California, Berkeley, CA, USA. · Northeastern University, Boston, MA, USA.

  9. Topology-Informed Visual Prompting For Vision Language Action Policies

    Sep 20, 2026Haoyang Wu, Abhinav Kumar, Dmitry BerensonLanguage-Conditioned Robot ManipulationVision-Language-Action Models

    Robotics Department, University of Michigan, Ann Arbor, MI, USA.

  10. ReVeal: A Reconstruction-Aware Real-to-Sim Framework for VLA Policy Evaluation

    Sep 20, 2026Xinyi Wang, Heng Hao, Wenjun Hu +53D ReconstructionRobotic Manipulation

    Purdue University · Samsung SDS Research America

  11. PackLab: A Comprehensive Framework for Developing, Training, and Evaluating MLLMs in Robotic Bin Packing

    Sep 20, 2026Donghao Zhou, Jia-Hui Pan, Fan Zhang +6Long-Horizon Robotic ManipulationRobotics

    Department of Computer Science and Engineering, The Chinese University of Hong Kong · M-A-P · Department of Mechanical and Automation Engineering, The Chinese University of Hong Kong

  12. Which Terrain Is Better? Preference Learning with VLM Prototypes for Off-Road Traversability Ranking

    Sep 20, 2026Ji-Hoon Hwang, Jisung Bae, E-In Son +3Visual NavigationOff-Road Robot Navigation

  13. Beyond Appearance Shifts: Task-Semantic Action Calibration for VLA Models

    Sep 20, 2026Shuaijun Liu, Feiyang You, Chengyu Wu +5Vision-Language-Action ModelsVLMs for Robotics

    The Hong Kong University of Science and Technology (Guangzhou) · National Centre for Computer Animation, Bournemouth University · Shanghai Jiao Tong University +1

  14. An Empirical Study and Open Testbed for Federated Fine-Tuning of Vision-Language-Action Models

    Sep 19, 2026Zhekai Duan, Kevin Ziyang Xie, Xinyu Tan +5Vision-Language-Action ModelsVLMs for Robotics

    Department of Computer Science, University College London, U.K. · Cisco Research, San Jose, CA, USA.

  15. SeeQ: Training Generalist Value Functions for Long-Horizon Robotic Manipulation

    Sep 18, 2026Saksham Singh, Zheyuan Hu, Max Sobol Mark +3Robot Policy LearningLong-Horizon Robotic Manipulation

    Carnegie Mellon University

  16. StageGuard: Learning Stage Transitions for Long-Horizon Robot Tasks via Agentic Distillation

    Sep 17, 2026Jinbang Huang, Yuanzhao Hu, Zhiyuan Li +6Long-Horizon Robotic ManipulationRobot Task Planning

    Huawei Noah’s Ark Lab · University of British Columbia · University of Toronto +1

  17. V2-STRep: VLM-Grounded Structured Task Representations for Reusable Robot Skills Acquired from Generated Videos

    Sep 17, 2026Yexin Hu, Dongheui LeeZero-Shot Robotic ManipulationGeneralization in Robotic Manipulation

    Autonomous Systems Lab, Technische Universität Wien (TU Wien), Austria · Institute of Robotics and Mechatronics, German Aerospace Center (DLR), Germany

  18. Spatial-Semantic Uncertainty in VLM-Based Target Search: Balancing Exploration and Identification

    Sep 17, 2026Alkesh K. Srivastava, Jonathan Diller, Vijay Kumar +1Belief-Space PlanningVision-Language Models

    Temple University, Philadelphia, PA, 19122 USA · University of Pennsylvania, Philadelphia, PA, 19104 USA

  19. Compliance for Free: Learning Identifiable Impedance via Bilateral Teleoperation

    Sep 17, 2026Harsha Guda, Adrià Colomé, Carme TorrasRobotic ControlContact-Rich Robotic Manipulation

    Institut de Rob`otica i Inform`atica Industrial, CSIC-UPC Barcelona, Spain

  20. Recovering Aggressively Pruned Vision-Language-Action Models with Offline Hidden-State Distillation

    Sep 17, 2026Chiyoung Kim, Sanghyuk Roy Choi, Minhyeok LeeEfficient VLA ModelsVision-Language-Action Models

    Chung-Ang University, Seoul, Republic of Korea

  21. VABench: Measuring Embodied Spatial Intelligence through Visual Demonstrations, Active Perception, and Metric Control

    Sep 17, 2026Zhongbo Zhang, Jiayi Jin, Yifan Wang +4Active PerceptionSpatial Reasoning Benchmarks

    Dalian University of Technology · Nanyang Technological University

  22. FASA: Feedback-Aware Sampling Adaptation for Efficient Diffusion-Based VLA Models

    Sep 16, 2026Yuchen Han, Jianhan Wu, Xiaoyang Qu +3Diffusion SamplingEfficient VLA Model Inference

    South China University of Technology Guangzhou, China · Ping An Technology (Shenzhen) Co., Ltd. Shenzhen, China · Harbin Institute of Technology Shenzhen, China

  23. In-Context Robot Learning with VLM Agents

    Sep 16, 2026Dongzhou Cheng, Taoran Yi, Ye Fang +12Robot Policy LearningICL for Robotics

    Morphi Robot · Shanghai Innovation Institute · Huazhong University of Science and Technology +7

  24. KINO: A Keyframe Interface for VLM Planning and Whole-Body Control in Humanoid Loco-Manipulation

    Sep 16, 2026Sitong Chen, Fatemeh Zargarbashi, Jin Cheng +2Robotic ControlRL for Robotics

    ETH Zürich, Switzerland

  25. Calibrated Probabilistic Obstruction Reasoning with Vision-Language Models for Grasping in Clutter

    Sep 16, 2026Thanh-Tuan Tran, Ngoc-Chien Chu, Thanh Nguyen Canh +3Robotic GraspingRobotic Manipulation

    University of Engineering and Technology, Vietnam National University, Hanoi, 10000, Vietnam · School of Information Science, Japan Advanced Institute of Science and Technology, Ishikawa, 923-1211, Japan · Department of Robotics, Hanyang University, Gyeonggi-do, 15588, Korea

  26. VLA-ULAP: Interleaving Cloud VLA Calls with Ultra-Lightweight Local Action Prediction at the Edge

    Sep 16, 2026Deyu Cao, Ryuji Oi, Kosuke Matsushima +4Efficient VLA Model InferenceVision-Language-Action Models

    The University of Tokyo · Institute of Science Tokyo

  27. ActiveScale: Scaling Active Perception for Robots across Model, Data, and Hardware

    Sep 16, 2026Shuai Zhou, Kaisheng Pang, Wenxuan Song +3Active Vision for Robot ManipulationRobotic Manipulation

    Robotics Institute, Carnegie Mellon University · The Hong Kong University of Science and Technology (Guangzhou)

  28. ForceDelta-VLA: Distilling Force-Conditioned ActionCorrections for Contact-Rich Manipulation

    Sep 16, 2026Ju Dong, Yu Fu, Jian Chen +9Contact-Rich Robotic ManipulationForce-Controlled Robotic Manipulation

    TAMS (Technical Aspects of Multimodal Systems), Department of Informatics, University of Hamburg, Hamburg, Germany. · University of Science and Technology of China, Hefei, China. · Technical University of Munich, Germany.

  29. A Comprehensive Review of Generative Physical Artificial Intelligence

    Sep 16, 2026Satyam Gaba, Krutiksinh Rana, Siva Sai +2Robot Foundation ModelsDiffusion Policy

    Qualcomm Research, San Diego, USA · University of the Cumberlands, KY, USA · Department of Electronics and Instrumentation, BITS-Pilani, Goa Campus, India +3

  30. Intrinsic Robot Rewarding: Reusing VLA Representations for Autonomous Evaluation and Policy Improvement

    Sep 15, 2026Tobias Schaffer, Mohab Elkhayat, Daniela Nicklas +2RL for RoboticsIntrinsic Reward Methods

    Technology Campus Cham - Intelligent Robotics, Deggendorf Institute of Technology, Cham, Germany