Large Language Model-Based Robot Planning

Overview

This field studies how robots can use large language models to interpret instructions, reason about their surroundings, and plan tasks such as navigation, manipulation, and team coordination. Common approaches combine language or vision-language models with symbolic methods such as PDDL, behavior trees, scene graphs, and temporal logic, then use robot controllers to carry out the resulting plans. Systems also use visual feedback, memory, verification, and replanning to respond to changing environments and execution failures. A central challenge is making plans reliably feasible and safe in the physical world while keeping reasoning fast and affordable.

Latest papers

CardsList

235 papers48 papers in the last four weeks, up 78% on the four weeks before. 0.3% of all new papers.

  1. AtomTree: A Hierarchical Framework for State-Aware Embodied Instruction Following with LLMs

    Oct 28, 2026Haotian Zhai, Tianming Sha, Junnan LiLarge Language Model-Based Robot PlanningLLM Agent Planning

  2. TrySee: Modular Perception-Enhanced VLM Grounding for Closed-Loop Robot Task Planning in Specialized Domains

    Oct 26, 2026Elias Hofele, Thomas Trapp, David Timmermann +3Robot Task PlanningVLMs for Robotics

  3. FISRF: Flexible Instructional Scaffolding Reflection Framework for Robotics Task Planning with Large Language Model

    Oct 26, 2026Qingmiao Liang, Jiatao Zhang, Runxin Zou +3Robot Task PlanningLarge Language Model-Based Robot Planning

  4. From Language to Drives: A Multimodal Framework for Aligning Autonomous Robots with Human Purposes

    Oct 26, 2026Diana Cerdas-Vargas, Alejandro Romero, Richard J. DuroAI AlignmentHuman-Robot Interaction

  5. Natural-Language to Nav2: Operational Policies for Costmap-Based Navigation

    Oct 23, 2026Jiyeong Chae, Hyunkyo Seo, Heonjae Lee +1Robot NavigationLanguage-Conditioned Robot Planning

  6. LogLook: Execution-Grounded Memory for Frontier-Model Robot Planners

    Oct 23, 2026Tianyi Jiang, Tianyao Tong, Zhenshan BingMemory-Augmented VLMsLarge Language Model-Based Robot Planning

  7. SCOPE: Scene-graph Construction Optimized by Plan Error-correction for Robot Long-term Planning Datasets

    Oct 22, 2026Chaoyue Li, Zeyu Gao, Yanfeng Lu +1Synthetic Data Generation for RoboticsRobot Task Planning

  8. CausGround: Causal Interaction Grounding for Adaptive Embodied Planning

    Oct 21, 2026Yijun Shen, Diqi He, Jinbang Guo +6Large Language Model-Based Robot PlanningLanguage-Conditioned Robot Planning

  9. SLoSa: Small, Low-Power, and Safe Foundation Models for Robotic Task Planning

    Oct 20, 2026Weizhe Xu, Jialiang Fan, Essien Taylor +3Robot Task PlanningLarge Language Model-Based Robot Planning

  10. AgenticRoboRL: Bringing Coding-Agent Post-Training to Agentic Robotics

    Oct 20, 2026Xinxin Liu, Bingxin Xu, Wenrui Bao +4Large Language Model-Based Robot PlanningRL for Robotics

  11. Visual Task Modeling and Automated Planning for Humanoid Robots in Education of Individuals with Autism Spectrum Disorder

    Oct 19, 2026Lada KudláčkováRobot Task PlanningAssistive Robotics

  12. Discovery-Probability Graph Planning for Embodied Agents in Tasks with Hidden Cooperation Requirements

    Oct 19, 2026Zihuang Cai, Changjian Chen, Zhuo Tang +2Multi-Agent PlanningGraph-Based Planning

  13. Refuse the Harm, Complete the Task via Graph-of-Rules Planning for LLM-Enabled Robots

    Oct 17, 2026Ali Taheri, Alireza Taban, Qizhou Wang +1LLM Agent SafetyLarge Language Model-Based Robot Planning

  14. Onboard Lightweight LLM Reasoning for Human-Aware Safe UAV Navigation

    Oct 15, 2026Siwei Cai, Yuwei Wu, Vijay Kumar +1UAV NavigationSafe Robot Navigation

  15. Progress Reward Model for Reinforcement Learning via Large Language Models

    Oct 15, 2026Xiuhui Zhang, Ning Gao, Xingyu Jiang +4Reward Design for RLLLM-Guided RL

  16. ChunkAct: Action Chunking for Agentic Robotics

    Oct 13, 2026Bingxin Xu, Wenrui Bao, Xinxin Liu +3Agentic AI for RoboticsRobotics

  17. Evaluating Long-Horizon Robot Planning under Uncertainty

    Oct 12, 2026Harsh Muriki, Gayathri Aravindan, Yuchen Zheng +1Robot Task PlanningLong-Horizon Agent Evaluation

  18. Observe, Share, or Predict? Disentangling Partner Information in Embodied Multi-Agent Collaboration

    Oct 12, 2026Adrián Szlatincsán, Filippo Ziliotto, Bruno Lepri +3Multi-Agent CollaborationMulti-Agent Reasoning

  19. SurgiCLAW: An Interpretable Atomic-Skill Agent for Precision Robotic Micromanipulation

    Oct 11, 2026Angen Ye, junjie xie, Yujia Song +2Robotic ManipulationSurgical Robotics

  20. LERR-Nav: Learning to Coordinate Exploration, Recovery, and Reminiscing for Object Navigation

    Oct 11, 2026Jingzhi Huang, Junkai Huang, Yuhang Peng +6Object-Goal NavigationEmbodied Navigation

  21. Words to World: Benchmarking LLMs in Interactive Physical Environments

    Oct 10, 2026Xinnan Dai, Kaiqi Yang, Yaxin Li +9LLM Agent EvaluationAI Agent Benchmarks

  22. Persistent LLM Orchestration of Heterogeneous Robot Teams via Partial Delegation to Multi-Agent Protocols

    Oct 10, 2026Maria G. Mendoza, Victoria M. Tuck, Zachary Ravichandran +2LLM Agent OrchestrationLarge Language Model-Based Robot Planning

  23. BT-Agent: Deploying Onboard Robot Agents with Behavior Trees and Multi-Fidelity Evaluation

    Oct 9, 2026Fabio Hübel, Adam Lilja, Yue Yin +5Large Language Model-Based Robot PlanningMobile Robotics

  24. Embodied Zero-Shot Task Planning via Hardware-Aware LLM-VLM Integration for Grounded Robotic Manipulation

    Oct 8, 2026Lonnie Tankersley, Noorbakhsh Amiri Golilarz, Soroush KorivandRobotic ManipulationRobot Task Planning

  25. Verifier-Mediated Multi-LLM Coordination for Multi-Robot Path Planning

    Oct 8, 2026Vivek Khatana, Zijian Song, Naira Hovakimyan +1Multi-Robot CoordinationLarge Language Model-Based Robot Planning