Language-Conditioned Robot Manipulation

Overview

The field studies how robots can interpret instructions such as which object to move and how, then carry them out through visual perception and motor control. Common approaches include vision-language-action policies trained on demonstrations, language-model planners paired with reusable skills, and methods that add geometric grounding, affordances, or predictive world models. Researchers evaluate these systems in simulation benchmarks such as LIBERO and RoboTwin as well as on physical robots, including long-horizon and cluttered tasks. A central challenge is ensuring that success reflects genuine instruction grounding and transfers reliably to new objects, scenes, and robot bodies while remaining safe under uncertainty.

Latest papers

CardsList

253 papers21 papers in the last four weeks, down 53% on the four weeks before. 0.2% of all new papers.

  1. AeroPlace-Flow: Language-Grounded Object Placement for Aerial Manipulators via Visual Foresight and Object Flow

    Mar 8, 2026Sarthak Mishra, Rishabh Dev Yadav, Naveen Nair +2Aerial RoboticsLanguage-Conditioned Robot Manipulation

  2. PRISM: Personalized Refinement of Imitation Skills for Manipulation via Human Instructions

    Mar 5, 2026Arnau Boix-Granell, Alberto San-Miguel-Tello, Magí Dalmau-Moreno +1Robot Imitation LearningInteractive Imitation Learning

  3. Lifelong Language-Conditioned Robotic Manipulation Learning

    Mar 5, 2026Xudong Wang, Zebin Han, Zhiyu Liu +5Language-Conditioned Robot ManipulationContinual Robot Learning

  4. From Local Corrections to Generalized Skills: Improving Neuro-Symbolic Policies with MEMO

    Mar 4, 2026Benjamin A. Christie, Yinlong Dai, Mohammad Bararjanianbahnamiri +2Robot Skill LearningLanguage-Conditioned Robot Manipulation

  5. UniHM: Unified Dexterous Hand Manipulation with Vision Language Model

    Feb 28, 2026Zhenhao Zhang, Jiaxin Liu, Ye Shi +1Robotic ManipulationLanguage-Conditioned Robot Manipulation

  6. An Approach to Combining Video and Speech with Large Language Models in Human-Robot Interaction

    Feb 23, 2026Guanting Shen, Zi TianHuman-Robot InteractionLanguage-Conditioned Robot Manipulation

  7. Replanning Human-Robot Collaborative Tasks with Vision-Language Models via Semantic and Physical Dual-Correction

    Feb 16, 2026Taichi Kato, Takuya Kiyokawa, Namiko Saito +1Language-Conditioned Robot ManipulationLarge Language Model-Based Robot Planning

  8. AERMANI-VLM: Structured Prompting and Reasoning for Aerial Manipulation with Vision Language Models

    Nov 3, 2025Sarthak Mishra, Rishabh Dev Yadav, Avirup Das +3Aerial RoboticsStructured Prompting

  9. Learning Latent Volumetric Dynamics for Multimodal Goal-Conditioned Robot Manipulation of Hair

    Oct 7, 2025Chengyang Zhao, Uksang Yoo, Arkadeep Narayan Chaudhury +6Deformable Object ManipulationRobot Dynamics Learning

  10. Imagine2Act: Leveraging Object-Action Motion Consistency from Imagined Goals for Robotic Manipulation

    Sep 21, 2025Liang Heng, Jiadong Xu, Yiwen Wang +6Robot Skill LearningLanguage-Conditioned Robot Manipulation

  11. Ask-to-Clarify: Resolving Instruction Ambiguity through Multi-turn Dialogue

    Sep 18, 2025Xingyao Lin, Xinghao Zhu, Tianyi Lu +6Language-Conditioned Robot ManipulationVision-Language-Action Models

  12. AntiGrounding: Executable Robot Trajectories as Visual Prompts for VLM-Guided Manipulation

    Jun 14, 2025Wenbo Li, Yiteng Chen, Wenhao Li +1Trajectory GenerationLanguage-Conditioned Robot Manipulation

  13. Bridging Language and Action: A Survey of Language-Conditioned Robot Manipulation

    Dec 17, 2023Xiangtong Yao, Hongkuan Zhou, Oier Mees +12Language-Conditioned Robot ManipulationVLMs for Robotics