Large Language Model-Based Robot Planning

Overview

This field studies how robots can use large language models to interpret instructions, reason about their surroundings, and plan tasks such as navigation, manipulation, and team coordination. Common approaches combine language or vision-language models with symbolic methods such as PDDL, behavior trees, scene graphs, and temporal logic, then use robot controllers to carry out the resulting plans. Systems also use visual feedback, memory, verification, and replanning to respond to changing environments and execution failures. A central challenge is making plans reliably feasible and safe in the physical world while keeping reasoning fast and affordable.

Latest papers

CardsList

254 papers33 papers in the last four weeks, down 33% on the four weeks before. 0.3% of all new papers.

  1. MALLVI: A Multi-Agent Framework for Integrated Generalized Robotics Manipulation

    Feb 18, 2026Mehrshad Taji, Arad Mahdinezhad Kashani, Iman Ahmadi +3Large Language Model-Based Robot PlanningRobotic Manipulation

  2. Replanning Human-Robot Collaborative Tasks with Vision-Language Models via Semantic and Physical Dual-Correction

    Feb 16, 2026Taichi Kato, Takuya Kiyokawa, Namiko Saito +1Language-Conditioned Robot ManipulationLarge Language Model-Based Robot Planning

  3. TGPO: Trace-Guided Policy Optimization for Robot Task Planning via Verifiable Subgoal Generation

    Feb 12, 2026Zhihong Liu, Yang Li, Renming Huang +3Classical PlanningRobot Task Planning

  4. Demonstration-Free Robotic Control via LLM Agents

    Jan 28, 2026Brian Y. Tsui, Alan Y. Fang, Tiffany J. HwuRobotic ControlLanguage Model-Based Control

  5. Visual-Language-Guided Task Planning for Horticultural Robots

    Jan 17, 2026Jose Cuaran, Kendall Koe, Aditya Potnis +2Large Language Model-Based Robot PlanningVision-Language Grounding

  6. EmboTeam: Asymmetric State Grounding for Heterogeneous Multi-Robot Collaboration

    Jan 16, 2026Haishan Zeng, Mengna Wang, Peng LiMulti-Robot CoordinationLarge Language Model-Based Robot Planning

  7. Prompting Robot Teams with Natural Language

    Sep 29, 2025Eduardo Sebastián, Nicolas Pfitzer, Ajay Shankar +1Large Language Model-Based Robot PlanningMulti-Robot Coordination

  8. Self-CriTeach: LLM Self-Teaching and Self-Critiquing for Improving Robotic Planning via Automated Domain Generation

    Sep 25, 2025Jinbang Huang, Zhiyuan Li, Yuanzhao Hu +4Large Language Model-Based Robot PlanningSynthetic Data Generation for Robotics

  9. IDfRA: Self-Verification for Iterative Design in Robotic Assembly

    Sep 21, 2025Nishka Khendry, Christos Margadji, Sebastian W. PattinsonRobotic AssemblyRobot Task Planning

  10. ViPlan: A Benchmark for Visual Planning with Symbolic Predicates and Vision-Language Models

    May 19, 2025Matteo Merler, Nicola Dainese, Minttu Alakuijala +5Large Language Model-Based Robot PlanningSymbolic Planning

  11. MuTRAP: Multi-trigger Trojans Attacking Robot Task Planning Systems

    Apr 23, 2025Mohaiminul Al Nahian, Zainab Altaweel, David Reitano +3LLM Backdoor AttacksLarge Language Model-Based Robot Planning

  12. MARLIN: Multi-Agent Reinforcement Learning Guided by Language-Based Inter-Robot Negotiation

    Oct 18, 2024Toby Godfrey, William Hunt, Mohammad D. SooratiMulti-Agent Reinforcement LearningLLM-Guided RL

  13. CLMASP: Coupling Large Language Models with Answer Set Programming for Robotic Task Planning

    Jun 5, 2024Xinrui Lin, Yangfan Wu, Huanyu Yang +3Large Language Model-Based Robot PlanningRobot Task Planning