Robot Manipulation Benchmarks

Overview

They range from simulated tabletop grasping and placement suites such as LIBERO and RoboCasa to real-robot tests of insertion, dexterous hands, bimanual work, mobile manipulation, and deformable or industrial objects. Common designs pair standardized task protocols and demonstrations with controlled shifts in objects, scenes, cameras, dynamics, or instructions; evaluation increasingly adds stage-level progress, recovery, motion quality, force and tactile interaction, and temporal safety to task success. Researchers use simulation, real-world rollouts, and matched sim-to-real protocols to compare imitation- and reinforcement-learning policies, vision-language-action models, and planning or memory systems. The central challenge is making scores both reproducible and diagnostic: success on fixed tasks may hide shortcuts, unsafe behavior, weak generalization, and gaps between simulated and physical performance.

Latest papers

CardsList

369 papers67 papers in the last four weeks, down 17% on the four weeks before. 0.5% of all new papers.

  1. ResponsibleRobotBench: Benchmarking Risk-Aware Task-Level Decision Making for Robotic Manipulation with Large Multimodal Models

    Dec 3, 2025Lei Zhang, Ju Dong, Kaixin Bai +5Safe Robot ManipulationRobot Manipulation Benchmarks

  2. SlotVLA: Towards Modeling of Object-Relation Representations in Robotic Manipulation

    Nov 10, 2025Taisei Hanyu, Nhat Chung, Huy Le +10Representation LearningObject-Centric Representation Learning

  3. Robobench: A Comprehensive Evaluation Benchmark for Multimodal Large Language Models as Embodied Brain

    Oct 20, 2025Yulin Luo, Chun-Kai Fan, Menghang Dong +19Long-Horizon Robotic ManipulationMultimodal Large Language Models

  4. Humanoid Everyday: A Comprehensive Robotic Dataset for Open-World Humanoid Manipulation

    Oct 9, 2025Zhenyu Zhao, Hongyi Jing, Xiawei Liu +7Robot Manipulation DatasetsRobotic Data Collection

  5. BuilderBench: The Building Blocks of Intelligent Agents

    Oct 7, 2025Raj Ghugare, Roger Creus Castanyer, Catherine Ji +4Long-Horizon Agent EvaluationRobot Manipulation Benchmarks

  6. RoboPilot: Generalizable Dynamic Robotic Manipulation with Dual-thinking Modes

    Sep 30, 2025Xinyi Liu, Mohammadreza Fani Sani, Zewei Zhou +3Robotic ManipulationDynamic Robotic Manipulation

  7. XYZ-IBD: Benchmarking Robust 6D Object Pose Estimation under Real-World Industrial Complexity

    May 31, 2025Junwen Huang, Jiaqi Hu, Peter KT Yu +3Object Pose EstimationRobotic Manipulation

  8. TARGO and TARGO-Net: Benchmarking Target-driven Object Grasping under Occlusions

    Jul 8, 2024Yan Xia, Ran Ding, Ziyuan Qin +5Robotic Grasping6-DOF Grasp Pose Estimation