Overview

Robot foundation models aim to transfer capabilities across tasks, environments, and robot bodies by learning from large collections of robot demonstrations, human videos, and other multimodal data. Common approaches include vision-language-action policies, world-action models that predict how actions change scenes, and motion or tactile models, trained with imitation and self-supervision and often adapted through reinforcement learning or human feedback. Researchers evaluate them on manipulation and navigation benchmarks such as LIBERO and RoboTwin, as well as on real robots and humanoids, with growing attention to long-horizon behavior and cross-embodiment transfer. Broad generalization remains difficult: data must align with each robot’s actions and sensors, while robustness, safety, latency, and the work needed for deployment are not yet resolved by strong benchmark results alone.

Latest papers

151 papers23 papers in the last four weeks, down 38% on the four weeks before. 0.2% of all new papers.

Jul 14, 2025

Foundation Model Driven Robotics: A Comprehensive Review

The rapid emergence of foundation models, particularly large language models and vision-language models, has introduced a transformative paradigm in robotics. The models offer powerful capabilities in semantic understanding, high-level reasoning, and cross-modal generalization, enabling significant advances in perception, planning, control, and human-robot interaction. This critical review provides a structured synthesis of recent developments and organizes applications into four directions: simulation-driven robotics, open-world operation, sim-to-real transfer, and adaptable robotic systems. Unlike existing surveys that emphasize isolated capabilities, this work highlights integrated, system-level strategies and evaluates their practical feasibility in real-world environments. Key enabling trends such as procedural scene generation, policy generalization, and multimodal reasoning are discussed alongside core bottlenecks, including limited embodiment, lack of multimodal data, safety risks, and computational constraints. Through this lens, this paper identifies both the architectural strengths and critical limitations of foundation model-based robotics, highlighting open challenges in real-time operation, grounding, resilience, and trust. The review concludes with a roadmap of proposed future research directions for bridging semantic reasoning and physical intelligence through more robust, interpretable, and embodied models.