Robotic Data Collection

Follow this topic Ask about this topic

Momentum

22 papers in the last four weeks, up 214% on the four weeks before. 0.2% of all new papers.

Jul 13Week of Sep 28

Latest papers 113

All topics

RoboTok: An Internet-Scale Data Engine for Human Demonstration Retrieval and Dexterous Manipulation Learning
Sep 2, 2026Howard Qian, Yiting Chen, Yunfei Xie +6Robot Skill Learning Robotic Data Collection
Rice University · NVIDIA
DARP: A Calibrated Dual-Arm RGB-D-IR Dataset for Multi-View Robotic Perception
Aug 31, 2026Manish Kansana, Mohammed Yusuf Mujawar, Sudip Mittal +2Robotic Data Collection Multi-View 3D Reconstruction
Department of Computer Science, The University of Alabama, Tuscaloosa, AL, USA
$N_0$ -Foundation: Towards the Age of Tactile Intelligence
Aug 30, 2026NeoteAI Team, Fudan TEAI TeamRobotic Data Collection Visuo-Tactile Representation Learning
NeoteAI Team · Fudan TEAI Team
HUI360: A 360° Egocentric Dataset and Baselines for Human-Robot Interaction Anticipation
Aug 11, 2026Raphael Lorenzo-Louis, Fabio Amadio, Bertrand Luvison +1Robotic Data Collection Human-Robot Interaction
Inria, CNRS, UL, Loria, HUCEBOT, F-54600 Villers-les-Nancy, France · Universit´e Paris-Saclay, CEA, List, F-91120 Palaiseau, France
Seeing above the waves: A modular sensing framework for data acquisition at sea
Aug 11, 2026Jonathan E. Schmidt, Julius Wirbel, P. Nicholas Hansen +4Robotic Data Collection
Technical University of Denmark, Kongens Lyngby, Denmark
High Fidelity Capture, Reconstruction, and Transfer of Human Demonstrations for Robot-Assisted Bathing
Aug 10, 2026Arjun S. Lakshmipathy, Jonathan P. King, Ethan Zuo +6Contact-Rich Robotic Manipulation Robotic Data Collection
School of Computer Science, Carnegie Mellon University · School of Health and Rehabilitation Sciences, University of Pittsburgh
Adaptive Sampling for Automated Post-Disaster Rapid Damage Assessment via Level-Set Cost-Aware Bayesian Optimization
Aug 3, 2026Boyang Xu, Mostafa Reisi Gahrooei, Mohammad Ilbeigi +1Disaster Damage Assessment Building Damage Assessment
School of Computing and Augmented Intelligence, Arizona State University · Department of Industrial and Systems Engineering, University of Florida · Department of Civil, Environmental and Ocean Engineering, Stevens Institute of Technology
Diagnosing Compositional Generalization in Sequential Robot Tasks
Jul 31, 2026Yixiao Wang, Cheng-En Wu, Lingfeng Sun +5Language-Conditioned Robot Manipulation Robotic Data Collection
University of California, Berkeley · Tsinghua University
Bootstrapping Self-Supervised Learning of Binary Classification Using Error Bounds: A Case Study on a Robotic Insertion Task
Jul 31, 2026Zebin Duan, Norbert Krüger, Juan Heredia +2Self-Supervised Learning Robotic Data Collection
Mærsk Mc-Kinney Møller Institute, University of Southern Denmark, 5230 Odense M, Denmark · Danish Institute for Advanced Study (DIAS), University of Southern Denmark, 5230 Odense M, Denmark
ACE-Data-0: Human-Centric Ambient Capture as Embodied Data Engine
Jul 30, 2026Yukang Cao, Haozhe Xie, Beichen Wen +13Robotic Data Collection Embodied AI
S-Lab, Nanyang Technological University · ACE Robotics
DexDirect: Direct Kinesthetic Arm Guidance for Efficient Dexterous Demonstration Collection
Jul 30, 2026Beom Jun Kim, Shiu-Jen Wang, Jonathan Liu +7Dexterous Manipulation Robot Skill Learning
Department of Mechanical and Aerospace Engineering · Department of Electrical and Computer Engineering · Department of Computer Science
Practice Makes Policies: Bootstrapping and Consolidating Robotic Capabilities from Zero Human Demonstrations
Jul 29, 2026Jialiang Li, Yuhan Wang, Haojun Li +5Continual Robot Learning Robotic Data Collection
Shanghai Jiao Tong University · University of Sussex
HiFi-UMI: Learning Deployable Manipulation Policies from High-Fidelity UMI Data Alone
Jul 28, 2026Simple AI, :, Yuteng Wei +16Robot Policy Learning Robotic Data Collection
Simple AI
When Does Legacy Data Start to Help? Emergent Transfer in Cross-Configuration Robot Learning
Jul 28, 2026Tao Wang, Hudson Hou, Yingdong Hu +7Robot Skill Learning Robotic Data Collection
Huazhong University of Science and Technology · Spirit AI · Peking University +3
Data Pyramid for Embodied Manipulation: A Survey
Jul 27, 2026Yifan Ye, Yankai Fu, Yaoxu Lv +26Robotic Data Collection Robot Foundation Models
PKU · NTU · HKUST +8
ACME: A Multi-Cultural, Multi-Embodiment Social-Navigation Dataset
Jul 24, 2026Shashank Rao Marpally, Allan Wang, Atharva Ghotavadekar +35Pedestrian Trajectory Prediction Robotic Data Collection
School of Computing, National University of Singapore · Miraikan - The National Museum of Emerging Science and Innovation · George Mason University +7
AXIS: A Growable Community-Driven Data Engine for Scalable Robot Manipulation
Jul 23, 2026Mengfei Zhao, Dihong Huang, Yikai Tang +12Robot Skill Learning Robotic Data Collection
1Axis Robotics · University of California, Berkeley · 3Georgia Institute of Technology +6
TableVerse: A Large-scale Tabletop Dataset with Real-world Grounded Layouts for Generalizable Manipulation
Jul 23, 2026Boyuan Wang, Yue Zhang, Xutao Xue +2Robotic Data Collection Robotics Simulation
ByteDance
MEVION: Low-Cost Open-Source Data Collection System for Powerful and High-Speed Dual-Arm Manipulation
Jul 20, 2026Kento Kawaharazuka, Yoshiki Obinata, Hirokazu Ishida +6Bimanual Robotic Manipulation Robotic Data Collection
Department of Mechano-Informatics, Graduate School of Information Science and Technology, The University of Tokyo, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-8656, Japan
Data and Learning Where it Matters for Contact-Rich Manipulation
Jul 17, 2026Oliver Hausdörfer, Linus Schwarz, Gabor Marko +7Robot Skill Learning Contact-Rich Robotic Manipulation
1TU Munich · 2Siemens AG
Zero2Skill: Bootstrapping Robot Skills through Autonomous Data Collection, Training, and Deployment
Jul 15, 2026Boyuan Wang, Zhenyuan Zhang, Zhiqin Yang +16Robot Policy Learning Robotic Data Collection
GigaAI · University of Chinese Academy of Sciences · Hong Kong University of Science and Technology +6
Open-AoE: An Open Egocentric Manipulation Dataset and Toolchain for Embodied Learning
Jul 15, 2026Zishuo Li, Bowen Yang, Changtao Miao +29Robotic Data Collection Egocentric Video Understanding
AoE Team, Ant Group
EgoHTR: Egocentric 4D Demonstrations of Human Terrain Traversal
Jul 15, 2026Alex Brandes, Haig Conti Georges Sajelian, Manthan Patel +11Humanoid Robot Locomotion Markerless Motion Capture
ETH Zurich · TU Munich · Stanford +1
Worlds in One Demo: A Synthetic Data Engine for Learning Open-World Mobile Manipulation
Jul 14, 2026Lingxiao Guo, Huanyu Li, Guanya ShiLong-Horizon Robotic Manipulation Mobile Manipulation
Carnegie Mellon University
GraspIT: A Dataset Bridging the Sim-to-Real gap and back for Validated Grasping SE(3) Pose Generation
Jul 7, 2026Paul Koch. Adem Karakurt, André SersRobotic Grasping Robotic Data Collection
Fraunhofer IPK Pascalstraße 8-9, 10587 Berlin, Germany
PRISM: Personalized Robotic Dataset Generation via Image-based Scene and Motion Synthesis
Jul 6, 2026Dogyu Ko, Haneul Kim, Chanyoung Yeo +3Robot Skill Learning Robotic Data Collection
Kyung Hee University
EVA-Client: A Unified Data Collection, Inference, and Deployment Framework for Embodied Policies on Real Robots
Jul 2, 2026Heqing Yang, Yang Yi, Liyao Wang +8Robotic Data Collection Robotic Policy Evaluation
CoLab, Beihang University
RoboTacDex: A Dexterous Visual-Tactile-Action Dataset for Humanoid Manipulation
Jun 30, 2026Xinyi Wang, Donghan Li, Zi'Ang Chen +5Bimanual Robotic Manipulation Robotic Data Collection
Fudan University · ByteDance Intelligent Creation · Shanghai AI Laboratory
RCT: A Robot-Collected Touch-Vision-Language Dataset for Tactile Generalization
Jun 30, 2026Jingbo He, Michael Färber, Roberto CalandraRobotic Data Collection Visuo-Tactile Representation Learning
ScaDS.AI, TU Dresden · 2LASR Lab, TU Dresden
HABIT: Human-Aware Behavior and Interaction Training Dataset for Robot Manipulation
Jun 30, 2026Jaehwi Song, Suchae Jeong, Byeongguk Jeon +4Robot Policy Learning Robotic Data Collection
Config · Config, KAIST

Sep 2, 2026, cs.CVJ/K move · Enter open · S save

RoboTok: An Internet-Scale Data Engine for Human Demonstration Retrieval and Dexterous Manipulation Learning

Howard Qian, Yiting Chen, Yunfei Xie, Kejia Ren+5

Rice University · NVIDIA

Robot Skill Learning Robotic Data Collection Robotic Manipulation Motion Representation Learning Robot Learning

Open paper AskPDF arXiv

Robot learning increasingly depends on broad and diverse demonstrations, yet collecting robot data remains expensive and poorly suited to covering the long tail of real-world tasks. To address this bottleneck, we introduce RoboTok, an internet-scale data engine that, given a query human manipulation video, retrieves manipulation-relevant human demonstrations from web videos for training dexterous robot policies. Specifically, we learn a latent motion space from 3D hand trajectories expressed in estimated actor-centered reference frames. This representation enables manipulation behaviors to be compared across variations in camera viewpoint, scene appearance, and actor occlusions, while remaining compact enough for efficient search and continual indexing over internet-scale video collections. We evaluate RoboTok against existing robot-data retrieval approaches on retrieval benchmarks and downstream robot policy performance. Our results show that RoboTok retrieves more relevant manipulation demonstrations and improves downstream task success, establishing hand-pose trajectory-aware retrieval as a way to make web video a scalable and continuously growing source of supervision for robot learning.

Momentum

Related topics

Latest papers 113