Language-Conditioned Robot Manipulation

Overview

The field studies how robots can interpret instructions such as which object to move and how, then carry them out through visual perception and motor control. Common approaches include vision-language-action policies trained on demonstrations, language-model planners paired with reusable skills, and methods that add geometric grounding, affordances, or predictive world models. Researchers evaluate these systems in simulation benchmarks such as LIBERO and RoboTwin as well as on physical robots, including long-horizon and cluttered tasks. A central challenge is ensuring that success reflects genuine instruction grounding and transfers reliably to new objects, scenes, and robot bodies while remaining safe under uncertainty.

Latest papers

CardsList

239 papers41 papers in the last four weeks, up 5% on the four weeks before. 0.2% of all new papers.

  1. AdaDexTrack: Dynamic Modulation for Adaptive and Generalizable Dexterous Manipulation Tracking

    Oct 24, 2026Jianibieke Adalibieke, Qianwei Han, Xueyi Liu +2Language-Conditioned Robot ManipulationRobotic Manipulation

  2. CausGround: Causal Interaction Grounding for Adaptive Embodied Planning

    Oct 21, 2026Yijun Shen, Diqi He, Jinbang Guo +6Large Language Model-Based Robot PlanningLanguage-Conditioned Robot Planning

  3. FlowVLA: Learning Flow-Aware Physical Completion for Quantitative Robotic Pouring

    Oct 21, 2026Liwen Yang, Yutian Zhang, Jiaqi Zhai +10Robotic ManipulationVLMs for Robotics

  4. Plan First, Act Later: Streaming Reasoning for Executable Memory in Robot Control

    Oct 21, 2026Qinghang Liu, Conglin Wang, Zongsheng Li +6Memory-Augmented VLMsLong-Horizon Robotic Manipulation

  5. Flexible Language-Guided Representation Editing for Adaptive Robot Behavior

    Oct 20, 2026Audrey Lee, Nathaniel Dennler, Ilia Sucholutsky +1Robot Policy AdaptationLanguage-Conditioned Robot Control

  6. Atomic-WAM: Execution-Grounded Atomic-Motion Reasoning for World Action Models

    Oct 14, 2026Shijun Shi, Zhe Liu, Zhi Hou +5World Action ModelsLanguage-Conditioned Robot Manipulation

  7. Instruction-Conditioned Motion Control for Robotic Arms: Language-to-Code Decomposition and Reinforcement Learning

    Oct 14, 2026Fan Huang, Dezhong Tong, Changyu Chen +2Language-Conditioned Robot ManipulationLanguage-Conditioned Robot Control

  8. Let the Mind Conceive, Let the Hand Achieve: Following Multimodal Instructions for Long-Horizon Robotic Manipulation

    Oct 13, 2026Youpeng Wen, Gang Wang, Tianyu Huang +5Long-Horizon Robotic ManipulationRobot Task Planning

  9. Breaking the Average: Overcoming Convergent Defaults in Robotic Manipulation via Diagnostic Chain-of-Thought and Structured Guidance

    Oct 13, 2026Mohammed Daba, Waleed Abdulrahman Saleh AlAkwaVision-Language-Action ModelsLanguage-Conditioned Robot Manipulation

  10. Look Before You Move: Agent-Interface-Aligned Supervision for Open-World Mobile Manipulation

    Oct 11, 2026Ronghe Qiu, Teli Ma, Jiaming Zhou +4Mobile ManipulationLanguage-Conditioned Robot Manipulation

  11. PRISM: Precision Forcing for Generalist Vision-Language-Action Policies

    Oct 10, 2026Chenghao Yue, Peiyan Li, Hao Wang +5Vision-Language-Action ModelsLanguage-Conditioned Robot Manipulation

  12. VLMs are Native Action Models: Unleashing the Manipulation Capabilities of VLMs with Explicit Action-Space Grounding

    Oct 9, 2026Jingkun Yi, Shujie Zhang, Zirui Zhou +8VLMs for RoboticsZero-Shot Robotic Manipulation

  13. From Language to Motion: Task-Conditioned Focal-Stack Trajectory Integration for Microscopic Robots

    Oct 8, 2026Junjie Xie, Chuxuan He, Junkai Huang +6RoboticsVision-Based Robot Control

  14. UNITAS: A 3D-Native World Action Model for Embodied Manipulation

    Oct 8, 2026Ruixiang Wang, Yongyi Su, Wenlve Zhou +14World Action ModelsEmbodied World Models

  15. YUBI-STAG: Contact and Semantic-Rich Alignment for VLAs via Automated Video-Language Grounding

    Oct 7, 2026Masatoshi Tateno, Takehiko Ohkawa, Yueh-Hua Wu +4Vision-Language GroundingVLMs for Robotics

  16. TempoBridge: Language-Guided Tempo Control for Vision-Language-Action Policies

    Oct 7, 2026Yeonseo Lee, Hyosup Shin, Guebin Hwang +1Language-Conditioned Robot ControlVision-Language-Action Models

  17. RMMBench: A Comprehensive Benchmark for Robotic Mobile Manipulation

    Oct 4, 2026Huapeng Li, Fuxiang Feng, Jinqiu Fan +5VLM EvaluationLong-Horizon Robotic Manipulation

  18. ForeAct3D: Policy-Grounded Future World Modeling for VLA Policies

    Oct 3, 2026Zhe Tao, Feiran Wang, Gaowen Liu +2World Models for RoboticsVision-Language-Action Models

  19. DreamFormer: Dream Imitation with a Transformer World Model for Language-Conditioned Robotic Manipulation

    Oct 3, 2026Mostafa Kotb, Cornelius Weber, Muhammad Burhan Hafez +1Language-Conditioned Robot ManipulationRobot Imitation Learning

  20. MIKASA-Robo-VLA: Benchmarking Memory in VLA Models for Long-Horizon Manipulation

    Sep 30, 2026Egor Cherepanov, Nikita Kachaev, Aleksandr I. Panov +1Memory-Augmented VLMsLong-Horizon Robotic Manipulation

  21. DynaHarness: A Dynamic Physical Harness for Self-Evolving Robot Agents

    Sep 30, 2026Haoyuan Deng, Jiebin Liu, Tengxiao Zhang +3Long-Horizon Robotic ManipulationContinual Robot Learning

  22. From Local Whole-Body VLA Behaviors to Scene-Scale Aerial Manipulation

    Sep 30, 2026Weixiang Guo, Rui Jin, Haotian Jin +7Robotic ControlLanguage-Conditioned Robot Manipulation