cs.ROJul 14, 2025

Foundation Model Driven Robotics: A Comprehensive Review

Authors: Muhammad Tayyab Khan, Ammar Waheed, Seung Ki Moon

Organizations: School of Mechanical and Aerospace Engineering, Nanyang Technological University, 639798, Singapore. · J. Mike Walker ’66 Department of Mechanical Engineering, Texas A&M University, College Station, TX 77801, USA.

Abstract

The rapid emergence of foundation models, particularly large language models and vision-language models, has introduced a transformative paradigm in robotics. The models offer powerful capabilities in semantic understanding, high-level reasoning, and cross-modal generalization, enabling significant advances in perception, planning, control, and human-robot interaction. This critical review provides a structured synthesis of recent developments and organizes applications into four directions: simulation-driven robotics, open-world operation, sim-to-real transfer, and adaptable robotic systems. Unlike existing surveys that emphasize isolated capabilities, this work highlights integrated, system-level strategies and evaluates their practical feasibility in real-world environments. Key enabling trends such as procedural scene generation, policy generalization, and multimodal reasoning are discussed alongside core bottlenecks, including limited embodiment, lack of multimodal data, safety risks, and computational constraints. Through this lens, this paper identifies both the architectural strengths and critical limitations of foundation model-based robotics, highlighting open challenges in real-time operation, grounding, resilience, and trust. The review concludes with a roadmap of proposed future research directions for bridging semantic reasoning and physical intelligence through more robust, interpretable, and embodied models.

Figures & tables

Explore similar work

CardsList
  1. Foundation Models in Robotics: A Comprehensive Review of Methods, Models, Datasets, Challenges and Future Research Directions

    Apr 16, 2026Aggelos Psiris, Vasileios Argyriou, Evangelos K. Markakis +4Large Language Model-Based Robot PlanningRobot Foundation Models

  2. The Embodiment Gap in Robot Foundation Models

    Aug 19, 2026Yukiyasu Domae, Keisuke Shirai, Hanbit Oh +7RoboticsRobot Foundation Models

  3. Are Foundation Models the Route to Full-Stack Transfer in Robotics?

    Feb 25, 2026Freek Stulp, Samuel Bustamante, João Silvério +3Transfer LearningRobot Foundation Models