Robotic Data Collection

Ask about this topic

Overview

Robotic data collection studies how to obtain useful observations and actions for training and evaluating robots in settings such as manipulation, navigation, and human-robot interaction. Common approaches include teleoperation, wearable and egocentric human capture, autonomous collection guided by policy failures, and simulation or synthetic-data generation. Datasets increasingly combine video, robot state, force, and tactile signals, while quality checks and benchmarks test whether trajectories are feasible and useful on real hardware. The central tension is scaling data efficiently without losing the physical, sensor, and embodiment alignment needed for reliable transfer.

Latest papers

CardsList

178 papers28 papers in the last four weeks, up 12% on the four weeks before. 0.2% of all new papers.

  1. EgoLive: A Large-Scale Egocentric Dataset from Real-World Human Tasks

    Apr 26, 2026Yihang Li, Xuelong Wei, Jingzhou Luo +26Robotic Data CollectionRobotic Manipulation

    Joy Future Academy, JD

  2. Open-H-Embodiment: A Large-Scale Dataset for Enabling Foundation Models in Medical Robotics

    Apr 22, 2026Open-H-Embodiment Consortium, :, Nigel Nelson +213Surgical RoboticsWorld Models for Robotics

  3. COFFAIL: A Dataset of Successful and Anomalous Robot Skill Executions in the Context of Coffee Preparation

    Apr 20, 2026Alex Mitrevski, Ayush SalunkeRobot Skill LearningRobotic Data Collection

    Division of Systems and Control, Chalmers University of Technology, Gothenburg, Sweden · Autonomous Systems Group, Bonn-Rhein-Sieg University of Applied Sciences, Sankt Augustin, Germany

  4. Leveraging VR Robot Games to Facilitate Data Collection for Embodied Intelligence Tasks

    Apr 18, 2026Yihan Zhang, Ziyun Huang, Linqi YeRobotic Data Collection

    School of Computer Engineering and Science, Shanghai University, Shanghai, 200444, China · School of Future Technology, Shanghai University, Shanghai, 200444, China

  5. ShapeGen: Robotic Data Generation for Category-Level Manipulation

    Apr 16, 2026Yirui Wang, Xiuwei Xu, Angyuan Ma +3Robotic Data CollectionGeneralization in Robotic Manipulation

    Tsinghua University

  6. DEX-Mouse: A Low-cost Portable and Universal Interface with Force Feedback for Data Collection of Dexterous Robotic Hands

    Apr 16, 2026Joonho Koh, Haechan Jung, Nayoung Kim +2Dexterous ManipulationRobotic Data Collection

    Dept. of Artificial Intelligence, Sogang University, Korea · Dept. of Electronic Engineering, Sogang University, Korea · Dept. of Mechanical Engineering, Sogang University, Korea +1

  7. HRDexDB: A 4D Dexterous Grasping Dataset Across Human and Multiple Robot Embodiments

    Apr 16, 2026Jongbin Lim, Taeyun Ha, Seongho Cha +6Robotic Data CollectionDexterous Manipulation

    Seoul National University · RLWRLD

  8. UMI-3D: Extending Universal Manipulation Interface from Vision-Limited to 3D Spatial Perception

    Apr 15, 2026Ziming WangRobotic Data CollectionRobotic Manipulation

    HKU · USTC

  9. XRZero-G0: Pushing the Frontier of Dexterous Robotic Manipulation with Interfaces, Quality and Ratios

    Apr 14, 2026James Wang, Primo Pu, Zephyr Fung +19Robotic Data CollectionRobotic Manipulation

    X SQUARE ROBOT

  10. OmniUMI: Towards Physically Grounded Robot Learning via Human-Aligned Multimodal Interaction

    Apr 12, 2026Shaqi Luo, Yuanyuan Li, Youhao Hu +7Robot LearningContact-Rich Robotic Manipulation

    Beijing Academy of Artificial Intelligence · MAIS & NLPR, Institute of Automation, Chinese Academy of Sciences · School of Artificial Intelligence, University of Chinese Academy of Sciences +3

  11. ActiveGlasses: Learning Manipulation with Active Vision from Ego-centric Human Demonstration

    Apr 9, 2026Yanwen Zou, Chenyang Shi, Wenye Yu +5Active Vision for Robot ManipulationRobot Imitation Learning

    Shanghai Jiao Tong University · Shanghai Innovation Institute · Noematrix Ltd.

  12. EgoVerse: An Egocentric Human Dataset for Robot Learning from Around the World

    Apr 8, 2026Ryan Punamiya, Simar Kareer, Zeyi Liu +37Cross-Embodiment Robot LearningRobot Learning

    Georgia Institute of Technology · Stanford University · University of California San Diego +5

  13. TAMEn: Tactile-Aware Manipulation Engine for Closed-Loop Data Collection in Contact-Rich Tasks

    Apr 8, 2026Longyan Wu, Jieji Ren, Chenghang Jiang +6Robotic Data CollectionContact-Rich Robotic Manipulation

    Fudan University · Shanghai Innovation Institute · OpenDriveLab at The University of Hong Kong +2

  14. RoSHI: A Versatile Robot-oriented Suit for Human Data In-the-Wild

    Apr 8, 2026Wenjing Margaret Mao, Jefferson Ng, Luyang Hu +2Human Pose Estimation3D Human Pose Estimation

    Department of Electrical and Systems Engineering, University of Pennsylvania.

  15. COMB: Common Open Modular robotic platform for Bees

    Apr 4, 2026Pranav Kedia, Marie Messerich, Tim LandgrafRoboticsModular Robotics

    Department of Computer and Information Science, University of Konstanz, Germany · Centre for the Advanced Study of Collective Behaviour, University of Konstanz, Konstanz, Germany · Dahlem Center for Machine Learning and Robotics, Freie Universität Berlin, Berlin, Germany

  16. OpenRC: An Open-Source Robotic Colonoscopy Framework for Multimodal Data Acquisition and Autonomy Research

    Apr 4, 2026Siddhartha Kapuria, Mohammad Rafiee Javazm, Naruhiko Ikoma +4Robotic EndoscopySurgical Robotics

    Walker Department of Mechanical Engineering, The University of Texas at Austin, Austin, 78712, TX, USA · Department of Surgical Oncology, Division of Surgery, The University of Texas MD Anderson Cancer Center, Houston, 77030, TX, USA · Department of Surgery & Perioperative Care, Dell Medical School, The University of Texas at Austin, Austin, 78712, TX, USA +1

  17. Towards Edge Intelligence via Autonomous Navigation: A Robot-Assisted Data Collection Approach

    Apr 4, 2026Tingting Huang, Yingyang Chen, Sixian Qin +3Robotic Data CollectionRobot Navigation

    College of Information Science and Technology, Jinan University, Guangzhou 510632, China · College of Physics and Information Engineering, Fuzhou University, Fuzhou 350108, China · School of Electronics and Communication Engineering, Guangzhou University, Guangzhou 510006, China +1

  18. VRUD: A Drone Dataset for Complex Vehicle-VRU Interactions within Mixed Traffic

    Apr 1, 2026Ziyu Wang, Hongrui Kou, Cheng Wang +4Autonomous Driving DatasetsAutonomous Driving

    National Key Laboratory of Automotive Chassis Integration and Bionics, Jilin University, Changchun 130025, China · DRIVEResearch, Changchun, China · School of Engineering and Physical Sciences, Heriot-Watt University, Edinburgh EH1 4AS, U.K. +1

  19. Vision-Based Robotic Disassembly Combined with Real-Time MFA Data Acquisition

    Mar 30, 2026Federico Zocco, Maria Pozzi, Monica MalvezziRobotic ManipulationRobotic Data Collection

    Department of Information Engineering and Mathematics, University of Siena, Italy, Via Roma, 56, 53100.

  20. Feel Robot Feels: Tactile Feedback Array Glove for Dexterous Manipulation

    Mar 30, 2026Feiyu Jia, Xiaojie Niu, Sizhe Yang +5Haptic Feedback for Robot TeleoperationRobot Teleoperation

    University of Science and Technology of China · Shanghai AI Laboratory · The Chinese University of Hong Kong +1

  21. T-800: An 800 Hz Data Glove for Precise Hand Gesture Tracking

    Mar 27, 2026Haoyang Luo, Zihang Zhao, Leiyao Cui +5Robotic Data Collection3D Hand Pose Estimation

    Institute for Artificial Intelligence, Peking University, Beijing 100871, China · School of Integrated Circuits, Peking University, Beijing 100871, China · School of Psychological and Cognitive Sciences, Peking University, Beijing 100871, China +5

  22. Towards Generalizable Robotic Data Flywheel: High-Dimensional Factorization and Composition

    Mar 26, 2026Yuyang Xiao, Yifei Zhou, Haoran Wang +2Data-Efficient Robot LearningRobotic Data Collection

    ByteDance Seed

  23. UniDex: A Robot Foundation Suite for Universal Dexterous Hand Control from Egocentric Human Videos

    Mar 23, 2026Gu Zhang, Qicheng Xu, Haozhe Zhang +16Robotic ManipulationCross-Embodiment Robot Learning

    Tsinghua University · Shanghai Qizhi Institute · Sun Yat-sen University +1

  24. Sense4HRI: A ROS 2 HRI Framework for Physiological Sensor Integration and Synchronized Logging

    Mar 20, 2026Manuel Scheibl, Julian Leichert, Sinem Görmez +1Human-Robot InteractionRobotics

    Medical Assistance Systems, Medical School OWL, Bielefeld University, 33501 Bielefeld, Germany · Center for Cognitive Interaction Technology, CITEC from Bielefeld University, Germany

  25. Legged Autonomous Surface Science In Analogue Environments (LASSIE): Making Every Robotic Step Count in Planetary Exploration

    Mar 20, 2026Cristina G. Wilson, Marion Nachon, Shipeng Liu +20Planetary Rover RoboticsRobotic Data Collection

    Collaborative Robotics and Intelligent Systems Institute, Oregon State University, Corvallis, 97331, USA · Department of Geology and Geophysics, Texas A&M University, College Station, 77843, USA · Department of Electrical and Computer Engineering, University of Southern California, Los Angeles, 90089, USA +7

  26. DexViTac: Collecting Human Visuo-Tactile-Kinematic Demonstrations for Contact-Rich Dexterous Manipulation

    Mar 18, 2026Xitong Chen, Yifeng Pan, Min Li +1Robotic Data CollectionContact-Rich Robotic Manipulation

    State Key Laboratory of Intelligent Manufacturing Equipment and Technology, Huazhong University of Science and Technology, Wuhan, China · Wuhan Huaweike Intelligent Technology Co., Ltd., Wuhan, China

  27. TeleDex: Accessible Dexterous Teleoperation

    Mar 17, 2026Omar Rayyan, Maximilian Gilles, Yuchen CuiRobot TeleoperationRobotic Data Collection

    University of California, Los Angeles

  28. Dexterous grasp data augmentation based on grasp synthesis with fingertip workspace cloud and contact-aware sampling

    Mar 17, 2026Liqi Wu, Haoyu Jia, Kento Kawaharazuka +2Robotic GraspingSynthetic Data Generation for Robotics

    The Department of Mechano-Informatics, Graduate School of Information Science and Technology, The University of Tokyo, Bunkyo-ku, Tokyo, Japan

  29. A Domain-Specific Language for LLM-Driven Trigger Generation in Multimodal Data Collection

    Mar 13, 2026Philipp Reis, Philipp Rigoll, Martin Zehetner +3Robotic Data Collection

    FZI Research Center for Information Technology, Karlsruhe, Germany

  30. HumDex: Humanoid Dexterous Manipulation Made Easy

    Mar 12, 2026Liang Heng, Yihe Tang, Jiajun Xu +3Robotic ManipulationWhole-Body Robotic Manipulation

    USC Physical Superintelligence (PSI) Lab · WorldEngine AI