Language-Conditioned Robot Manipulation

Overview

The field studies how robots can interpret instructions such as which object to move and how, then carry them out through visual perception and motor control. Common approaches include vision-language-action policies trained on demonstrations, language-model planners paired with reusable skills, and methods that add geometric grounding, affordances, or predictive world models. Researchers evaluate these systems in simulation benchmarks such as LIBERO and RoboTwin as well as on physical robots, including long-horizon and cluttered tasks. A central challenge is ensuring that success reflects genuine instruction grounding and transfers reliably to new objects, scenes, and robot bodies while remaining safe under uncertainty.

Latest papers

CardsList

239 papers41 papers in the last four weeks, up 5% on the four weeks before. 0.2% of all new papers.

  1. Adapt as You Say: Online Interactive Bimanual Skill Adaptation via Human Language Feedback

    Mar 27, 2026Zhuo Li, Dianxi Li, Tao Teng +5Robot Skill LearningBimanual Robotic Manipulation

  2. LaMP: Learning Vision-Language-Action Policy with 3D Scene Flow as Latent Motion Prior

    Mar 26, 2026Xinkai Wang, Chenyi Wang, Yifu Xu +7Scene Flow EstimationLanguage-Conditioned Robot Manipulation

  3. Gaze-Regularized Vision-Language-Action Models for Robotic Manipulation

    Mar 24, 2026Anupam Pani, Yanchao YangVLMs for RoboticsRobotic Manipulation

  4. Cortical Policy: A Dual-Stream View Transformer for Robotic Manipulation

    Mar 22, 2026Xuening Zhang, Qi Lv, Xiang Deng +3Vision-Based Robot ControlRobotic Manipulation

  5. DreamPlan: Efficient Reinforcement Fine-Tuning of Vision-Language Planners via Video World Models

    Mar 17, 2026Emily Yue-Ting Jia, Weiduo Yuan, Tianheng Shi +3VLMs for RoboticsRL for VLMs

  6. Confusion-Aware In-Context-Learning for Vision-Language Models in Robotic Manipulation

    Mar 16, 2026Yayun He, Zuheng Kang, Botao Zhao +3VLM RobustnessVision-Language Models

  7. AnolisVLA: Lightweight Vision-Language-Action Model with Deep State Space Models for Mobile Manipulation

    Mar 16, 2026Yusuke Takagi, Motonari Kambara, Daichi Yashima +3Language-Conditioned Robot ManipulationVision-Language-Action Models

  8. Language-Grounded Decoupled Action Representation for Robotic Manipulation

    Mar 13, 2026Wuding Weng, Tongshu Wu, Liucheng Chen +5Robotic ManipulationLanguage-Conditioned Robot Manipulation

  9. Altered Thoughts, Altered Actions: Reasoning Chain as Control Surface for a Vision-Language-Action Policy

    Mar 13, 2026Tuan Duong Trinh, Basim Azam, Mohammed Ishaq Ansari +2Language-Conditioned Robot ManipulationVision-Language-Action Models

  10. Overcoming Visual Clutter in Vision Language Action Models via Concept-Gated Visual Distillation

    Mar 11, 2026Sangmim Song, Sarath Kodagoda, Marc Carmichael +1Vision-Language-Action ModelsRobustness of VLA Models

  11. Cross-Hand Latent Representation for Vision-Language-Action Models

    Mar 10, 2026Guangqi Jiang, Yutong Liang, Jianglong Ye +6Robotic ManipulationCross-Embodiment Robot Learning

  12. See, Plan, Rewind: Progress-Aware Vision-Language-Action Models for Robust Robotic Manipulation

    Mar 10, 2026Tingjun Dai, Mingfei Han, Tingwen Du +6Vision-Language-Action ModelsLanguage-Conditioned Robot Manipulation

  13. AffordGrasp: Cross-Modal Diffusion for Affordance-Aware Grasp Synthesis

    Mar 9, 2026Xiaofei Wu, Yi Zhang, Yumeng Liu +3HOI GenerationRobotic Grasping

  14. Language-Guided Grasping under Partial Observation for Mobile Manipulation in Field Inspection and Maintenance

    Mar 9, 2026Dilermando Almeida, Juliano Negri, Guilherme Lazzarini +5Robotic GraspingLanguage-Conditioned Robot Manipulation

  15. AeroPlace-Flow: Language-Grounded Object Placement for Aerial Manipulators via Visual Foresight and Object Flow

    Mar 8, 2026Sarthak Mishra, Rishabh Dev Yadav, Naveen Nair +2Aerial RoboticsLanguage-Conditioned Robot Manipulation

  16. PRISM: Personalized Refinement of Imitation Skills for Manipulation via Human Instructions

    Mar 5, 2026Arnau Boix-Granell, Alberto San-Miguel-Tello, Magí Dalmau-Moreno +1Robot Imitation LearningInteractive Imitation Learning

  17. Lifelong Language-Conditioned Robotic Manipulation Learning

    Mar 5, 2026Xudong Wang, Zebin Han, Zhiyu Liu +5Language-Conditioned Robot ManipulationContinual Robot Learning

  18. From Local Corrections to Generalized Skills: Improving Neuro-Symbolic Policies with MEMO

    Mar 4, 2026Benjamin A. Christie, Yinlong Dai, Mohammad Bararjanianbahnamiri +2Robot Skill LearningLanguage-Conditioned Robot Manipulation

  19. UniHM: Unified Dexterous Hand Manipulation with Vision Language Model

    Feb 28, 2026Zhenhao Zhang, Jiaxin Liu, Ye Shi +1Robotic ManipulationLanguage-Conditioned Robot Manipulation

  20. An Approach to Combining Video and Speech with Large Language Models in Human-Robot Interaction

    Feb 23, 2026Guanting Shen, Zi TianHuman-Robot InteractionLanguage-Conditioned Robot Manipulation

  21. Replanning Human-Robot Collaborative Tasks with Vision-Language Models via Semantic and Physical Dual-Correction

    Feb 16, 2026Taichi Kato, Takuya Kiyokawa, Namiko Saito +1Language-Conditioned Robot ManipulationLarge Language Model-Based Robot Planning

  22. AERMANI-VLM: Structured Prompting and Reasoning for Aerial Manipulation with Vision Language Models

    Nov 3, 2025Sarthak Mishra, Rishabh Dev Yadav, Avirup Das +3Aerial RoboticsStructured Prompting

  23. Imagine2Act: Leveraging Object-Action Motion Consistency from Imagined Goals for Robotic Manipulation

    Sep 21, 2025Liang Heng, Jiadong Xu, Yiwen Wang +6Robot Skill LearningLanguage-Conditioned Robot Manipulation

  24. Ask-to-Clarify: Resolving Instruction Ambiguity through Multi-turn Dialogue

    Sep 18, 2025Xingyao Lin, Xinghao Zhu, Tianyi Lu +6Language-Conditioned Robot ManipulationVision-Language-Action Models

  25. AntiGrounding: Executable Robot Trajectories as Visual Prompts for VLM-Guided Manipulation

    Jun 14, 2025Wenbo Li, Yiteng Chen, Wenhao Li +1Trajectory GenerationLanguage-Conditioned Robot Manipulation

  26. Bridging Language and Action: A Survey of Language-Conditioned Robot Manipulation

    Dec 17, 2023Xiangtong Yao, Hongkuan Zhou, Oier Mees +12Language-Conditioned Robot ManipulationVLMs for Robotics