Robotic Data Collection

Ask about this topic

Overview

Robotic data collection studies how to obtain useful observations and actions for training and evaluating robots in settings such as manipulation, navigation, and human-robot interaction. Common approaches include teleoperation, wearable and egocentric human capture, autonomous collection guided by policy failures, and simulation or synthetic-data generation. Datasets increasingly combine video, robot state, force, and tactile signals, while quality checks and benchmarks test whether trajectories are feasible and useful on real hardware. The central tension is scaling data efficiently without losing the physical, sensor, and embodiment alignment needed for reliable transfer.

Latest papers

CardsList

178 papers28 papers in the last four weeks, up 12% on the four weeks before. 0.2% of all new papers.

  1. RADAR: Closed-Loop Robotic Data Generation via Semantic Planning and Autonomous Causal Environment Reset

    Mar 12, 2026Yongzhong Wang, Keyu Zhu, Yong Zhong +3Robotic Data CollectionSynthetic Data Generation for Robotics

    Department of Computer Science and Engineering, Southern University of Science and Technology. · Harbin Institute of Technology, Shenzhen. · Spatialtemporal AI.

  2. RoboClaw: An Agentic Framework for Scalable Long-Horizon Robotic Tasks

    Mar 12, 2026Ruiying Li, Yunlang Zhou, YuYao Zhu +15Long-Horizon Robotic ManipulationVLMs for Robotics

    AgiBot, China · National University of Singapore · Shanghai Jiao Tong University, Shanghai 200240, China +1

  3. TRIP-Bag: A Portable Teleoperation System for Plug-and-Play Robotic Arms and Leaders

    Mar 10, 2026Noboru Myers, Sankalp Yamsani, Obin Kwon +1Robotic Data CollectionRobot Teleoperation

    KIMLAB (Kinetic Intelligent Machine LAB), University of Illinois Urbana-Champaign, IL 61801, USA

  4. FoMo: A Multi-Season Dataset for Robot Navigation in Forêt Montmorency

    Mar 9, 2026Matěj Boxan, Gabriel Jeanson, Alexander Krawciw +5Simultaneous Localization and MappingRobotic Data Collection

    Norlab, Universit´e Laval, Quebec City, Canada · University of Toronto Robotics Institute, Toronto, Canada

  5. FeasibleCap: Real-Time Embodiment Constraint Guidance for In-the-Wild Robot Demonstration Collection

    Mar 8, 2026Zi Yin, Fanhong Li, Yun Gui +1Robotic Data CollectionRobotic Manipulation

    Tsinghua University, Beijing, China

  6. SurgSync: Time-Synchronized Multi-Modal Data Collection Framework and Dataset for Surgical Robotics

    Mar 6, 2026Haoying Zhou, Chang Liu, Yimeng Wu +7Robotic Data CollectionSurgical Robotics

    Department of Robotics Engineering, Worcester Polytechnic Institute, Worcester, MA, USA. · Laboratory for Computational Sensing and Robotics, Johns Hopkins University, Baltimore, MD, USA. · Department of Computer Science, Johns Hopkins University, Baltimore, MD, USA. +2

  7. SuperSuit: An Isomorphic Bimodal Interface for Scalable Mobile Manipulation

    Mar 6, 2026Tongqing Chen, Hang Wu, Jiasen Wang +1Mobile ManipulationRobotic Data Collection

    Tsinghua University, Beijing, China. · TARS Robotics, Shanghai, China.

  8. Moving Through Clutter: Scaling Data Collection and Benchmarking for 3D Scene-Aware Humanoid Locomotion via Virtual Reality

    Mar 6, 2026Beichen Wang, Yuanjie Lu, Linji Wang +2Humanoid Robot LocomotionRobotic Data Collection

    George Mason University, 4400 University Dr, Fairfax, VA 22030, USA

  9. RFM-HRI : A Multimodal Dataset of Medical Robot Failure, User Reaction and Recovery Preferences for Item Retrieval Tasks

    Mar 5, 2026Yashika Batra, Giuliano Pioldi, Promise Ekpo +5Human-Robot InteractionRobot Failure Recovery

    Cornell University, Cornell Tech, United States of America · Weill Cornell Medicine, United States of America

  10. RoboPocket: Improve Robot Policies Instantly with Your Phone

    Mar 5, 2026Junjie Fang, Wendi Chen, Han Xue +7Data-Efficient Robot LearningRobot Learning

    Shanghai Jiao Tong University · Noematrix Ltd. · Shanghai Innovation Institute

  11. RoboLight: A Dataset with Linearly Composable Illumination for Robotic Manipulation

    Mar 4, 2026Shutong Jin, Jin Yang, Muhammad Zahid +1Robot Manipulation DatasetsRobotic Data Collection

    School of Electrical Engineering and Computer Science, KTH Royal Institute of Technology

  12. AMP2026: A Multi-Platform Marine Robotics Dataset for Tracking and Mapping

    Mar 4, 2026Edwin Meriaux, Shuo Wen, David Widhalm +11Robotic Data CollectionRobotic Perception

    McGill University, Montreal, Canada. · MILA - Quebec AI Institute. · Universit´e Paris-Saclay, CentraleSup´elec. +4

  13. HoMMI: Learning Whole-Body Mobile Manipulation from Human Demonstrations

    Mar 3, 2026Xiaomeng Xu, Jisang Park, Han Zhang +6Mobile ManipulationWhole-Body Robotic Manipulation

    Stanford University · Toyota Research Institute

  14. EmbodMocap: In-the-Wild 4D Human-Scene Reconstruction for Embodied Agents

    Feb 26, 2026Wenjia Wang, Liang Pan, Huaijin Pi +83D Human ReconstructionEmbodied AI

    The University of Hong Kong · Tampere University · The Chinese University of Hong Kong +1

  15. A Robotic Testing Platform for Pipelined Discovery of Resilient Soft Actuators

    Feb 24, 2026Ang Li, Alexander Yin, Alexander White +6Soft RoboticsAutonomous Experimentation

    Department of Mechanical and Industrial Engineering, University of Toronto, Toronto, ON, M5S 3G8 Canada · Institute of Materials Science, University of Connecticut, Storrs, CT, 06269 U.S.A. · School of Mechanical, Aerospace, and Manufacturing Engineering, University of Connecticut, Storrs, CT, 06269 U.S.A. +2

  16. Visual Cooperative Drone Tracking for Open-Path Gas Measurements

    Feb 24, 2026Marius Schaab, Alisha Kiefer, Thomas Wiedemann +2Robotic Data Collection

    Technical University of Munich (TUM), Munich, Germany · German Aerospace Center (DLR), Weßling, Germany

  17. GrandTour: A Legged Robotics Dataset in the Wild for Multi-Modal Perception and State Estimation

    Feb 20, 2026Turcan Tuna, Jonas Frey, Frank Fu +5Legged RoboticsSimultaneous Localization and Mapping

    Robotic Systems Lab, ETH Zurich, Zurich 8092, Switzerland · 1ETH Zurich, Switzerland · 2Stanford University, USA +1

  18. FR-GESTURE: An RGBD Dataset For Gesture-based Human-Robot Interaction In First Responder Operations

    Feb 19, 2026Konstantinos Foteinos, Georgios Angelidis, Aggelos Psiris +3Human-Robot InteractionRobotic Data Collection

    ∗Department of Informatics and Telematics, Harokopio University of Athens, Athens, Greece · † Department of Networks and Digital Media, Kingston University, Kingston upon Thames, Surrey, United Kingdom · ‡ Department of Electrical and Computer Engineering, University of Western Macedonia, Kozani, Greece +1

  19. RoboGene: Diversity-Driven Agentic Task Generation Framework for VLA Pre-training

    Feb 18, 2026Yixue Zhang, Kun Wu, Zhi Gao +12Synthetic Data Generation for RoboticsRobotic Data Collection

    Beijing Innovation Center of Humanoid Robotics · The School of Advanced Manufacturing and Robotics, Peking University · Beijing Institute of Technology +2

  20. Schur-MI: Fast Mutual Information for Robotic Information Gathering

    Feb 12, 2026Kalvik Jakkala, Jason O'Kane, Srinivas AkellaRobotic Data CollectionInformative Path Planning

    Texas A&M University · University of North Carolina at Charlotte

  21. Genie Sim 3.0 : A High-Fidelity Comprehensive Simulation Platform for Humanoid Robot

    Jan 5, 2026Chenghao Yin, Da Huang, Di Yang +16Robotic Data CollectionRobotics Simulation

  22. World In Your Hands: A Large-Scale and Open-Source Ecosystem for Learning Human-Centric Manipulation in the Wild

    Dec 30, 2025Yupeng Zheng, Jichao Peng, Weize Li +22Human-Object InteractionRobot Skill Learning

    TARS Robotics

  23. TabletopGen: Tabletop Scene Generation and Interactive Simulation for Robotic Manipulation

    Dec 1, 2025Ziqian Wang, Yonghao He, Licheng Yang +6Robotic Data CollectionRobotics Simulation

    School of Artificial Intelligence, University of Chinese Academy of Sciences, Beijing, China · State Key Laboratory of Multimodal Artificial Intelligence Systems (MAIS), Institute of Automation, Chinese Academy of Sciences, Beijing, China · D-Robotics, Beijing, China +2

  24. MILE: A Mechanically Isomorphic Hand Exoskeleton and Visuotactile Robotic Hand for Data Collection in Dexterous Manipulation

    Nov 29, 2025Jinda Du, Jieji Ren, Qiaojun Yu +6Robotic Hand DesignDexterous Manipulation

    State Key Laboratory of Mechanical System and Vibration, School of Mechanical Engineering, Shanghai Jiao Tong University, Shanghai 200240, China. · Shanghai Key Laboratory of Intelligent Robotics, Shanghai Jiao Tong University, Shanghai 200240, China. · Shanghai Artificial Intelligence Laboratory, Shanghai, China. +1

  25. A Survey on Efficient Vision-Language-Action Models

    Oct 27, 2025Zhaoshu Yu, Bo Wang, Pengpeng Zeng +7Model CompressionRobotic Data Collection

    School of Computer Science and Technology, Tongji University, China · School of Computing and Artificial Intelligence, Southwest Jiaotong University, China · School of Computer Science and Engineering, University of Electronic Science and Technology of China, China +1

  26. Humanoid Everyday: A Comprehensive Robotic Dataset for Open-World Humanoid Manipulation

    Oct 9, 2025Zhenyu Zhao, Hongyi Jing, Xiawei Liu +7Robot Manipulation DatasetsRobotic Data Collection

    University of Southern California · Toyota Research Institute

  27. An Real-Sim-Real (RSR) Loop Framework for Generalizable Robotic Policy Transfer

    Mar 13, 2025Yuxuan Xu, Shiyu Wang, Jinhao Huang +6Robotic Data CollectionSim-to-Real Transfer

    Institute for AI Industry Research (AIR), Tsinghua University · Beijing Jiaotong University · The Hong Kong University of Science and Technology (Guangzhou)

  28. AgiBot World Colosseo: A Large-scale Manipulation Platform for Scalable and Intelligent Embodied Systems

    Mar 9, 2025AgiBot World Contributors, Qingwen Bu, Jisong Cai +49Robot Manipulation DatasetsGeneralization in Robotic Manipulation