Large Language Model-Based Robot Planning

Overview

This field studies how robots can use large language models to interpret instructions, reason about their surroundings, and plan tasks such as navigation, manipulation, and team coordination. Common approaches combine language or vision-language models with symbolic methods such as PDDL, behavior trees, scene graphs, and temporal logic, then use robot controllers to carry out the resulting plans. Systems also use visual feedback, memory, verification, and replanning to respond to changing environments and execution failures. A central challenge is making plans reliably feasible and safe in the physical world while keeping reasoning fast and affordable.

Latest papers

CardsList

254 papers33 papers in the last four weeks, down 33% on the four weeks before. 0.3% of all new papers.

  1. Lost Between Mind, Model Collaboration, and Motion: Understanding and Measuring Cross-Model Action Misalignment in Commercial Robots

    Nov 18, 2026Yuhang Huang, Junchao Li, Boyang Ma +5RoboticsLarge Language Model-Based Robot Planning

  2. Objectives as Policies: Vision-Language Model Cost Programs for Contact-Rich Manipulation

    Nov 13, 2026Zihao Lu, Trong Gia Hung Nguyen, Fuquan Wang +1Robotic ManipulationContact-Rich Robotic Manipulation

  3. Talk to Act: A Synthetic Multi-Turn Dialogue Benchmark for Human Intent Extraction and Action Planning in Robotics

    Nov 12, 2026Deepu Krishnareddy, Mohammad Haziq Khan, Michael Danner +1Human-Robot InteractionLarge Language Model-Based Robot Planning

  4. A Joint LLM and Optimization Agent Solution for Drone Scheduling in Victim Search Missions

    Nov 12, 2026Yinghao Zhang, Yalin Liu, Hong-Ning Dai +4Search-and-Rescue RoboticsLarge Language Model-Based Robot Planning

  5. BiPOP: Partial-Order Planning for Long-Horizon Bimanual Robotic Manipulation

    Nov 11, 2026Kun Chu, Xufeng Zhao, Jan-Gerrit Habekost +2Bimanual Robotic ManipulationRobot Task Planning

  6. Large Language Model Explainability for Planning Lunar Rover Trajectories under Uncertainty

    Nov 9, 2026Michelle Ho, Maximilian Adang, Zachary Booth +4Explainable Motion PlanningFaithfulness of Language Model Explanations

  7. CAFE: Closed-Loop Autonomous Task Formulation and Execution without Instance-Specific Instructions

    Nov 8, 2026Mingjia Chen, Xuewen Zhao, Philip Dames +3Robot Task PlanningLarge Language Model-Based Robot Planning

  8. A Layered View of LLM Support in Underwater Robotics

    Nov 4, 2026Federico Celi, Leonardo Zacchini, Gabriele FerriUnderwater RoboticsLarge Language Model-Based Robot Planning

  9. Do Agentic Policies Need to Look at Every Step? Geometric Abstraction for Reasoning and Action

    Nov 3, 2026Yihang Liu, Yiming Chen, Mingzhe ZhengAgentic AI for RoboticsLarge Language Model-Based Robot Planning

  10. ActOR: Ambient AI-Based Agentic Orchestration for Humanoid Autonomy in Operating Rooms

    Nov 3, 2026Han Zhang, Sicheng Lu, Aleks Santari +3Agentic AI for RoboticsHumanoid Robotics

  11. TAMPAgent: Agentic Belief-Space Planning for Mobile Manipulation

    Nov 2, 2026Utkarsh A. Mishra, Alperen Degirmenci, Yongxin Chen +3Robot Task PlanningMobile Manipulation

  12. Learning from Physical Experience:Context-Space Adaptation for Robotic Manipulation

    Oct 30, 2026Yihan Zeng, Yisu Li, Kaixin Huang +9Robotic ManipulationRobot Learning

  13. LLM-guided Planar Loco-Manipulation for Quadruped Robots

    Oct 29, 2026Georges Jetti, Michael Khayyat, Jean-Pierre Sleiman +2robot obstacle traversalRobotic Loco-Manipulation

  14. AtomTree: A Hierarchical Framework for State-Aware Embodied Instruction Following with LLMs

    Oct 28, 2026Haotian Zhai, Tianming Sha, Junnan LiLarge Language Model-Based Robot PlanningLLM Agent Planning

  15. TrySee: Modular Perception-Enhanced VLM Grounding for Closed-Loop Robot Task Planning in Specialized Domains

    Oct 26, 2026Elias Hofele, Thomas Trapp, David Timmermann +3Robot Task PlanningVLMs for Robotics

  16. FISRF: Flexible Instructional Scaffolding Reflection Framework for Robotics Task Planning with Large Language Model

    Oct 26, 2026Qingmiao Liang, Jiatao Zhang, Runxin Zou +3Robot Task PlanningLarge Language Model-Based Robot Planning

  17. From Language to Drives: A Multimodal Framework for Aligning Autonomous Robots with Human Purposes

    Oct 26, 2026Diana Cerdas-Vargas, Alejandro Romero, Richard J. DuroAI AlignmentHuman-Robot Interaction

  18. Natural-Language to Nav2: Operational Policies for Costmap-Based Navigation

    Oct 23, 2026Jiyeong Chae, Hyunkyo Seo, Heonjae Lee +1Robot NavigationLanguage-Conditioned Robot Planning

  19. LogLook: Execution-Grounded Memory for Frontier-Model Robot Planners

    Oct 23, 2026Tianyi Jiang, Tianyao Tong, Zhenshan BingMemory-Augmented VLMsLarge Language Model-Based Robot Planning

  20. SCOPE: Scene-graph Construction Optimized by Plan Error-correction for Robot Long-term Planning Datasets

    Oct 22, 2026Chaoyue Li, Zeyu Gao, Yanfeng Lu +1Synthetic Data Generation for RoboticsRobot Task Planning

  21. CausGround: Causal Interaction Grounding for Adaptive Embodied Planning

    Oct 21, 2026Yijun Shen, Diqi He, Jinbang Guo +6Large Language Model-Based Robot PlanningLanguage-Conditioned Robot Planning