Robot Manipulation Benchmarks

Overview

They range from simulated tabletop grasping and placement suites such as LIBERO and RoboCasa to real-robot tests of insertion, dexterous hands, bimanual work, mobile manipulation, and deformable or industrial objects. Common designs pair standardized task protocols and demonstrations with controlled shifts in objects, scenes, cameras, dynamics, or instructions; evaluation increasingly adds stage-level progress, recovery, motion quality, force and tactile interaction, and temporal safety to task success. Researchers use simulation, real-world rollouts, and matched sim-to-real protocols to compare imitation- and reinforcement-learning policies, vision-language-action models, and planning or memory systems. The central challenge is making scores both reproducible and diagnostic: success on fixed tasks may hide shortcuts, unsafe behavior, weak generalization, and gaps between simulated and physical performance.

Latest papers

CardsList

369 papers67 papers in the last four weeks, down 17% on the four weeks before. 0.5% of all new papers.

  1. AgentRoboCritic: Understanding the Capability of Frontier Agents on Direct Robot Control

    Nov 19, 2026Yiyang Du, Yuxuan Kuang, Qitao Zhao +7Robotic ControlRobotic Policy Evaluation

  2. PhyDEX: A Benchmark for Physical Reasoning in Vision-Language-Action Models via Dynamic Extrinsic Dexterity

    Nov 19, 2026Hao Vo, Taisei Hanyu, Yuki Ikebe +8Robot Manipulation BenchmarksReasoning for VLAs

  3. Agentic Scaling of Embodied Tasks in Simulation for Synthetic Data Collection and Policy Evaluation

    Nov 19, 2026Kang Wang, Xiaolei Zhou, Xiaoyu Wu +1Synthetic Data Generation for RoboticsAgentic AI for Robotics

  4. Phantom Success, Silent Failure: Auditing the Success Checkers of Simulated Manipulation Benchmarks

    Nov 18, 2026Zirui Song, Jiadong Zhang, Zheng Lu +3Automated EvaluationRobot Manipulation Benchmarks

  5. RoboMorpher: Scaling Robot Morphology Representations for Cross-Embodiment Action Prediction

    Nov 18, 2026Wenwei Lin, Yan Qin, Weiliang Deng +12Cross-Embodiment Robot LearningAction Representation Learning

  6. PAIR: Bringing Household Robots into the Smart Home

    Nov 17, 2026Junseong Pyo, Hyeongjin Kim, Jongwook Han +3RoboticsRobotics Simulation

  7. Seeing What Still Holds: How Waiting Control Changes Cooperative Recovery

    Nov 17, 2026Kangjie Huang, Yucheng Xin, Xinchun Wang +3Robotic ManipulationRobot Manipulation Benchmarks

  8. RoboTeam: Benchmarking Vision-Based Multi-Agent Control of Many Robot Arms in Real Time

    Nov 17, 2026Changxuan Fan, Zhongwei Xie, Boyi Zhang +18Robot Manipulation BenchmarksMulti-Agent Control

  9. ForceHarness: Turning Force into Action and Physics for Frozen Frontier Models

    Nov 16, 2026Ke Sun, Kevin Yuchen Ma, Yike Zhang +2Robotic ManipulationForce-Controlled Robotic Manipulation

  10. ManiLadder: Benchmarking Robot Manipulation Through a Categorized and Multi-Difficulty Level Task Ladder

    Nov 12, 2026Chongkai Gao, Jieao Shi, Zhaoyu Mu +14Robot Manipulation BenchmarksMulti-Task Robotic Manipulation

  11. JustRUA: A Controlled Study of GPT-6 Robot-Use Agents

    Nov 11, 2026Zefan Wang, Yufan Dang, Xuanwei Shi +9Robotic ControlRobotic Manipulation

  12. DexRemo: A Force-Sensing Hand Platform and Task Suite for Contact-Rich Removal Manipulation

    Nov 11, 2026Liman Wang, Hanyang Zhong, Sun Zhaole +5Contact-Rich Robotic ManipulationRobot Manipulation Benchmarks

  13. Video-Action Models for Data-Efficient Industrial Manipulation

    Nov 11, 2026Eugenio Chisari, Stefanos Charalambous, Oliver Sanchez +23Data-Efficient Robot LearningRobot Learning from Video

  14. Low-Cost Mobile Bimanual Manipulation for Long-Horizon Toilet Cleaning

    Nov 11, 2026Sven Schreiber, Bernard Burdiek, Lasse Huber-Saffer +4RoboticsLong-Horizon Robotic Manipulation

  15. Benchmarking Real-World Robotic Manipulation through Stochastic Challenges

    Nov 9, 2026Elias Gläßer, Gülhan Şikaroğlu, Pavlo Kupyn +3Robot Manipulation BenchmarksScientific Reproducibility

  16. GeoMind: A Benchmark for Spatial Understanding in Robotic Manipulation

    Nov 9, 2026Jinghe Wang, Xinrui Cao, Duo Wu +5Spatial Reasoning BenchmarksRobot Manipulation Benchmarks

  17. Grasp-Taxonomy Conditioning as a Mode Switch for Dexterous Grasping of Climbing Holds

    Nov 9, 2026Rumi Loghmani, Abraham George, Amir Barati FarimaniRobotic GraspingDiffusion Policy

  18. HARP-Bench: Benchmarking Robot Manipulation Around Active Humans

    Nov 8, 2026Qinhong Zhou, Riley Zong, Chunru Lin +6Robotic ManipulationRobot Manipulation Benchmarks

  19. Seeing What Execution Needs: Benchmarking Task-Conditioned Actionable Spatial Belief for Manipulation

    Nov 6, 2026Yina Jian, Mingkun XuRobot Manipulation BenchmarksActive Vision for Robot Manipulation

  20. ToolDex: An Ego-Exo Human Demonstration Dataset for Creative Physical Tool Use

    Nov 6, 2026Mohamed Elmoghany, Kehan Li, Ruoqu Chen +11Multimodal DatasetRobotic Tool Use

  21. RoboARCade: Benchmarking Agentic Robot Control

    Nov 5, 2026Satvik Sharma, Hengyuan Hu, Mihika Kamat +2Embodied Agent BenchmarksRobot Manipulation Benchmarks

  22. GraspBench: Execution-Aware Cross-Robot Evaluation of 6-DoF Grasp Generation in MuJoCo

    Nov 5, 2026Abdul Basit, Bibek Poudel, Muhammad ShafiqueRobotic GraspingRobotic Manipulation

  23. Spatial-UMI-Dream: Scaling World Action Models with Metric Geometry for UMI Manipulation

    Nov 4, 2026Weiduo Yuan, Ze Yuan, Sihan Liu +4World Models for RoboticsWorld Action Models

  24. VABAR: A Variational Automation Benchmark for Agentic Robotics

    Nov 4, 2026Shuangyu Xie, Kaiyuan Chen, Uksang Yoo +16Robot Manipulation BenchmarksAgentic AI for Robotics