Large Language Model-Based Robot Planning

Overview

This field studies how robots can use large language models to interpret instructions, reason about their surroundings, and plan tasks such as navigation, manipulation, and team coordination. Common approaches combine language or vision-language models with symbolic methods such as PDDL, behavior trees, scene graphs, and temporal logic, then use robot controllers to carry out the resulting plans. Systems also use visual feedback, memory, verification, and replanning to respond to changing environments and execution failures. A central challenge is making plans reliably feasible and safe in the physical world while keeping reasoning fast and affordable.

Latest papers

CardsList

235 papers48 papers in the last four weeks, up 78% on the four weeks before. 0.3% of all new papers.

  1. VersualRL: Closed-Loop Verbal Reinforcement Learning with Visual Execution Feedback for Task-Level Robot Planning

    Mar 23, 2026Dmitrii Plotnikov, Iaroslav Kolomiets, Dmitrii Maliukov +9Robot Policy LearningLarge Language Model-Based Robot Planning

  2. Can a Robot Walk the Robotic Dog: Triple-Zero Collaborative Navigation for Heterogeneous Multi-Agent Systems

    Mar 23, 2026Yaxuan Wang, Yifan Xiang, Ke Li +5Robot NavigationMulti-Robot Systems

  3. IndoorR2X: Indoor Robot-to-Everything Coordination with LLM-Driven Planning

    Mar 20, 2026Fan Yang, Soumya Teotia, Shaunak A. Mehta +8World Models for RoboticsLarge Language Model-Based Robot Planning

  4. Why Cognitive Robotics Matters: Lessons from OntoAgent and LLM Deployment in HARMONIC for Safety-Critical Robot Teaming

    Mar 20, 2026Sanjay Oruganti, Sergei Nirenburg, Marjorie McShane +5Cognitive Architectures for AI AgentsLarge Language Model-Based Robot Planning

  5. REST: Receding Horizon Explorative Steiner Tree for Zero-Shot Object-Goal Navigation

    Mar 19, 2026Shuqi Xiao, Maani Ghaffari, Chengzhong Xu +1Zero-Shot LearningLarge Language Model-Based Robot Planning

  6. SG-CoT: An Ambiguity-Aware Robotic Planning Framework using Scene Graph Representations

    Mar 18, 2026Akshat Rana, Peeyush Agarwal, K. P. S. Rana +1Large Language Model-Based Robot PlanningRobot Task Planning

  7. RPMS: Enhancing LLM-Based Embodied Planning through Rule-Augmented Memory Synergy

    Mar 18, 2026Zhenhang Yuan, Shenghai Yuan, Lihua XieLarge Language Model-Based Robot PlanningLLM Agent Memory

  8. OmniVLN: Omnidirectional 3D Perception and Token-Efficient LLM Reasoning for Visual-Language Navigation across Air and Ground Platforms

    Mar 18, 2026Zhongyuang Liu, Min He, Shaonan Yu +5Vision-Language NavigationRobot Navigation

  9. From Scanning Guidelines to Action: A Robotic Ultrasound Agent with LLM-Based Reasoning

    Mar 15, 2026Yuan Bi, Yiping Zhou, Pei Liu +3Robotic UltrasoundLarge Language Model-Based Robot Planning

  10. SAATT Nav: a Socially Aware Autonomous Transparent Transportation Navigation Framework for Wheelchairs

    Mar 14, 2026Yutong Zhang, Shaiv Y. Mehra, Bradley S. Duerstock +1Robot NavigationSocial Robot Navigation

  11. From Woofs to Words: Towards Intelligent Robotic Guide Dogs with Verbal Communication

    Mar 13, 2026Yohei Hayamizu, David DeFazio, Hrudayangam Mehta +7Human-Robot InteractionAssistive Robotics

  12. BrainMem: Brain-Inspired Evolving Memory for Embodied Agent Task Planning

    Mar 12, 2026Xiaoyu Ma, Lianyu Hu, Wenbing Tang +4Long-Term Memory for Embodied AgentsMemory-Augmented Language Model Agents

  13. SVLL: Staged Vision-Language Learning for Physically Grounded Embodied Task Planning

    Mar 12, 2026Yuyuan Yang, Junkun Hong, Hongrong Wang +11Visual Grounding for RoboticsLarge Language Model-Based Robot Planning

  14. CoViLLM: An Adaptive Human-Robot Collaborative Assembly Framework Using Large Language Models

    Mar 12, 2026Jiabao Zhao, Jonghan Lim, Hongliang Li +1Human-Robot CollaborationRobotic Assembly

  15. PM-Nav: Priori-Map Guided Embodied Navigation in Functional Buildings

    Mar 10, 2026Jiang Gao, Xiangyu Dong, Haozhou Li +3Indoor Robot NavigationEmbodied Navigation

  16. Scale-Plan: Scalable Language-Enabled Task Planning for Heterogeneous Multi-Robot Teams

    Mar 9, 2026Piyush Gupta, Sangjae Bae, Jiachen Li +1Large Language Model-Based Robot PlanningSymbolic Planning

  17. From Reactive to Map-Based AI: Tuned Local LLMs for Semantic Zone Inference in Object-Goal Navigation

    Mar 9, 2026Yudai Noda, Kanji TanakaRobot NavigationObject-Goal Navigation

  18. Reasoning Knowledge-Gap in Drone Planning via LLM-based Active Elicitation

    Mar 8, 2026Zeyu Fang, Beomyeol Yu, Cheng Liu +5Human-Robot CollaborationLarge Language Model-Based Robot Planning

  19. SwiftBot: A Decentralized Platform for LLM-Powered Federated Robotic Task Execution

    Mar 7, 2026YueMing Zhang, Shuai Xu, Zhengxiong Li +3Multi-Robot CoordinationEdge Computing

  20. Multimodal Behavior Tree Generation: A Small Vision-Language Model for Robot Task Planning

    Mar 6, 2026Riccardo Andrea Izzo, Cristiano Battistini, Gianluca Bardaro +1Large Language Model-Based Robot PlanningSynthetic Data Generation for Robotics

  21. Agentic LLM Planning via Step-Wise PDDL Simulation: An Empirical Characterisation

    Mar 6, 2026Kai Göbel, Pierrick Lorang, Patrik Zips +1LLM PlanningLLM Agent Planning

  22. LLM-Guided Decentralized Exploration with Self-Organizing Robot Teams

    Mar 5, 2026Hiroaki Kawashima, Shun Ikejima, Takeshi Takai +2Multi-Robot ExplorationAutonomous Robot Exploration

  23. Large-Language-Model-Guided State Estimation for Partially Observable Task and Motion Planning

    Mar 4, 2026Yoonwoo Kim, Raghav Arora, Roberto Martín-Martín +3Motion PlanningRobot State Estimation

  24. MistyPilot: An Agentic Fast-Slow Thinking LLM Framework for Misty Social Robots

    Mar 4, 2026Xiao Wang, Lu Dong, Jingchen Sun +3Agentic AI for RoboticsLLM Agent Orchestration

  25. From Language to Action: Can LLM-Based Agents Be Used for Embodied Robot Cognition?

    Mar 3, 2026Shinas Shaji, Fabian Huppertz, Alex Mitrevski +1Large Language Model-Based Robot PlanningLanguage Model-Based Control

  26. IMR-LLM: Industrial Multi-Robot Task Planning and Program Generation using Large Language Models

    Mar 3, 2026Xiangyu Su, Juzhan Xu, Oliver van Kaick +2Robot Task PlanningLarge Language Model-Based Robot Planning

  27. Uni-Skill: Building Self-Evolving Skill Repository for Generalizable Robotic Manipulation

    Mar 3, 2026Senwei Xie, Yuntian Zhang, Ruiping Wang +1Robot Skill LearningRobot Learning