Robotic Datasets

Follow this topic Ask about this topic

Recent momentum

+140%

12 papers in the last 28 days · 0.2% of indexed attention

Twelve weeks of publication activity for this topic as it is defined today.

Weekly history

Recent digests

What was published in this topic, kept on the site without email delivery.

Period ending 2026-09-21

4 new papers

A weekly snapshot of new work published in Robotic Datasets.

Period ending 2026-09-14

3 new papers

A weekly snapshot of new work published in Robotic Datasets.

Period ending 2026-09-07

4 new papers

A weekly snapshot of new work published in Robotic Datasets.

85 papers

Latest in Robotic Datasets

Open your feed →

RoboTalk: Learning Multi-Robot Communication and Coordination from Multimodal Demonstrations
Sep 21, 2026Dorian Benhamou Goldfajn, Mason Nakamura, Saaduddin Mahmud +3Robotic Datasets
HumynexSurg-1: A Curated Expert Liposuction Dataset
Sep 20, 2026Rhea Huang, David L. Matlock, Laurence ReichRobotic Datasets Robot-Assisted Minimally Invasive Surgery
HEARTH: An Object-Centric RGB-Thermal-3D Dataset for Temperature-Aware Robot Manipulation
Sep 20, 2026Yuning Su, Borui Li, Yonghao Shi +2Robotic Datasets
PointZero: 3D Point Track Completion for Learning Transferable 3D Dynamics
Sep 16, 2026Bardienus P. Duisterhof, Kaifeng Zhang, Adam Hung +53D Single Object Tracking Robotic Datasets
FoldNet++: a Large-Scale Synthetic Dataset for Robotic T-Shirt Folding and Unfolding
Sep 14, 2026Yuxing Chen, Zhiyuan Wei, Bowen Xiao +2Robotic Datasets Synthetic Dataset
DATAFARM: Distribution-Aligned Task and Motion Planning for Fine-Tuning Vision-Language-Action Models
Sep 14, 2026Samrat Sahoo, Yixuan Huang, Tom SilverRobotic Datasets Vision-Language-Action Models
Improving Imitation Learning Efficiency for Manipulation through Geometric Prior Pretraining
Sep 14, 2026Shogo Iwakata, Tomohiro Motoda, Ryosuke Yamada +8Imitation Learning Robotic Datasets
HuRo: Robotizing Human Videos for Scalable VLA Pretraining
Sep 9, 2026Jinho Jeong, Se June Joo, Jaehyun Kang +4Robotic Datasets Video Pretraining
Semigroup-JEPA: Latent Dynamics Consistency for Zero-Shot Physics Generalization
Sep 9, 2026Andy Zeyi Liu, Haoran Sun, Lucas Baker +2Joint-Embedding Predictive Architectures Latent World Models
RoboDrop: Curating VLA Post-Training Data via Local Gradient Compatibility
Sep 9, 2026Runze Xu, Yuanfan Xu, Cuijie Xu +4Robotic Datasets Robocasa
Measuring Language Transfer in Robot Policies: Adding Greek to a Cosmos3 Vision-Language-Action Policy
Sep 7, 2026Ayoub Kirouane, Georgios Giaples, Christos PetrocheilosRobot Policies Robotic Datasets
IRWOZ 2.0: A Large Language Model-driven Dialogue Dataset for Industrial Robot Conversations
Sep 3, 2026Chen Li, Dimitrios ChrysostomouConversational Datasets Robotic Datasets
DropClick: Semi-Automated One-Click Segmentation for Agricultural Robotic Data
Sep 3, 2026Patrick Zimmer, Michael Halstead, Chris McCoolAgricultural Robots Segmentation Model
ARGUS: Aligning Robot Scene Geometry Under Shifting Views with Large 3D Vision Models
Aug 6, 2026Rishik Sathua, Haonan Chen, Katherine Driggs-CampbellVisuomotor Policy Robotic Datasets
Ego2Robot: Scalable Robot Data Synthesis from Egocentric Human Data
Aug 3, 2026Ye Wang, Pei Lin, Xiong-Hui Chen +12Robotic Datasets Egocentric Dataset
EndoWAM: A Grounded World-Action Model for Generalizable Endoscopic Navigation
Aug 2, 2026Jinsong Lin, Zikang Pan, Wanhao Liu +10Efficient World-Action Model Stable Biliary Cannulation
DLAM: Distributional Latent Actions with Temporal Constraints
Jul 29, 2026Zuojin Tang, Feifan Luo, Haoyun Liu +10Latent Actions Robotic Datasets
CG-World: A Large-Scale World-State Dataset and Protocol for World Models
Jul 29, 2026Yiming Cai, Fangjie Yu, Meiqing Yu +3World Models Robotic Datasets
ACME: A Multi-Cultural, Multi-Embodiment Social-Navigation Dataset
Jul 24, 2026Shashank Rao Marpally, Allan Wang, Atharva Ghotavadekar +35Robotic Datasets Social Robot Navigation
TransBiolab: A Real-World Multi-View Dataset of Cluttered Transparent Biomedical Objects
Jul 23, 2026Ke Ma, Yifei Wang, Meng Wang +1Robotic Datasets Multiple Vision Tasks
RoboInter1.5: A Holistic Intermediate Representation Suite for Embodied World Modeling and Robotic Manipulation
Jul 21, 2026Ziqin Wang, Hao Li, Weijun Wang +5Robotic Datasets Intermediate Representations
Still image and spatial-temporal tomato data enabling detection, segmentation, tracking, and video-instance segmentation using strong and weak labels
Jul 16, 2026Michael Halstead, Esra Guclu, Mohamed Farag +7Fruit Video Dataset
Time-to-Collision Based Dynamic Obstacle Avoidance Using Pretrained Vision Models for Robots in Unstructured Environments
Jul 8, 2026Erik Jagnandan, Mulugeta Haile, Gregory Barber +1Obstacle Avoidance Robotic Perception
SIEVE: Structure-Aware Data Selection for Imitation Learning with VLA Models
Jul 7, 2026Changti Wu, Bin Yu, Zhaolong Shen +6Imitation Learning Vision-Language-Action Models
From Foundation to Application: Improving VLA Models in Practice
Jul 7, 2026Wei Wu, Fangjing Wang, Fan Lu +21Robotic Datasets Vision-Language-Action Models
Deform360: A Massive Multi-view Visuotactile Dataset for Deformable World Models
Jul 6, 2026Hongyu Li, Wanjia Fu, Xiaoyan Cong +11Deformable Objects Robotic Datasets
FlatManifold: Robust Continual Learning under Severe Label Noise and Domain Shifts via Intrinsic Manifold Flattening
Jul 6, 2026Rai Hisada, Kanji TanakaEfficient Continual Learning Noisy Labels
PRISM: Personalized Robotic Dataset Generation via Image-based Scene and Motion Synthesis
Jul 6, 2026Dogyu Ko, Haneul Kim, Chanyoung Yeo +3Robotic Datasets Robot Policies
RoboVista: Evaluating Vision Language Models for Diverse Robot Applications
Jul 6, 2026Shuangyu Xie, Kaiyuan Chen, Ziyang Chen +8Robotic Datasets Robocasa
!Imperio, smolVLA: The Implications of Data Poisoning on Open Source Robotics
Jul 5, 2026Stefan Bühler, Mark SchuteraRobotic Datasets Data Poisoning
The Moving Eye: Enhancing VLA Spatial Generalization via Hybrid Dynamic Data Collection
Jul 2, 2026Jincheng Tang, Yilong Zhu, Zhengyuan Xie +2Vision-Language-Action Models Robotic Datasets
Unleashing More Actions via Action Compositional Training for VLA Models
Jul 1, 2026Kai Peng, Jie Lu, Xiaojiang PengVision-Language-Action Models Robotic Datasets
RoboTacDex: A Dexterous Visual-Tactile-Action Dataset for Humanoid Manipulation
Jun 30, 2026Xinyi Wang, Donghan Li, Zi'Ang Chen +5Robotic Datasets Dexterous Manipulation
RCT: A Robot-Collected Touch-Vision-Language Dataset for Tactile Generalization
Jun 30, 2026Jingbo He, Michael Färber, Roberto CalandraRobotic Datasets Generalisation
HABIT: Human-Aware Behavior and Interaction Training Dataset for Robot Manipulation
Jun 30, 2026Jaehwi Song, Suchae Jeong, Byeongguk Jeon +4Robotic Datasets Robot Policies
Multisensory Continual Learning: Adapting Pretrained Visuomotor Policies to Force
Jun 29, 2026Jaden Clark, Changhao Wang, Yihuai Gao +5Visuomotor Policy Robotic Datasets
Unveiling Transferability in Trajectory Prediction via Latent Scene Embeddings
Jun 29, 2026Theodor Westny, David Axelsson, Björn Olofsson +1Human Motion Prediction Trajectory Prediction
Training Vision-Language-Action Models with Dense Embodied Chain-of-Thought Supervision
Jun 29, 2026Haoyang Li, Guanlin Li, Youhe Feng +9Pretrained Vision-Language-Action Vision-Language-Action Models
Vision-Language-Action Models: Experimental Insights from a Real-World UR5 Platform
Jun 29, 2026Mathilde Hochedel, Marc LalondeVision-Language-Action Models Robotic Datasets
WOLF-VLA: Whole-Body Humanoid Optimal Locomotion Framework for Vision-Language-Action Learning
Jun 24, 2026Melya Boukheddimi, Omar Adjali, Daniel Sontag +1Vision-Language-Action Models Task-Centric Hybrid Whole-Body Controller
Humanoid-OmniOcc: Stereo-Based Full-View Occupancy Dataset for Embodied AI
Jun 22, 2026Xianda Guo, Bohao Zhang, Chenwei Huang +63D Semantic Occupancy Prediction Robotic Datasets
RoboGaze: Evaluating Robot World Models via Structured Vision-Language Analysis
Jun 22, 2026Minh-Loi Nguyen, Nghiem Tuong Diep, Hung Khang Nguyen +10Robotic Datasets Video World Models
Decoupling the Declarative from the Procedural in Vision-Language-Action Models
Jun 19, 2026Nikolaos Tsagkas, Andreas Sochopoulos, Chris Xiaoxuan Lu +2Vision-Language-Action Models Robotic Datasets
ROBOSHACKLES: A Safety Dataset for Human-Injury Prevention in Embodied Foundation Models
Jun 17, 2026Zhuowen Yin, Chongyang Liu, Wenzhang Yang +2Robotic Datasets Safety-Critical Scenarios
Uncertainty Quantification for Flow-Based Vision-Language-Action Models
Jun 16, 2026Ralf Römer, Maximilian Seeliger, Saida Liu +5Flow-Matching Vision-Language-Action Vision-Language-Action Models
MuseVLA: An Adaptive Multimodal Sensing Vision-Language-Action Model for Robotic Manipulation
Jun 16, 2026Xingyuming Liu, Ruichun Ma, Heyu Guo +7Pretrained Vision-Language-Action Vision-Language-Action Models
Self-Improving VLA Policies: Selected Diffusion Noise for Spurious-Robust Action Smoothing
Jun 12, 2026Duc Minh Nguyen, Bao-Ngoc Dao, Tung M. Luu +15Flow-Matching Vision-Language-Action Diffusion Policies
Improving Robotic Generalist Policies via Flow Reversal Steering
Jun 11, 2026Andy Tang, William Chen, Andrew Wagenmaker +2Robot Policies Robotic Datasets
Task Robustness via Re-Labelling Vision-Action Robot Data
Jun 9, 2026Artur Kuramshin, Özgür Aslan, Cyrus Neary +1Robotic Datasets Robot Systems
LARA: Latent Action Representation Alignment for Vision-Language-Action Models
Jun 5, 2026Mengya Liu, Baoxiong Jia, Jiangyong Huang +2Vision-Language-Action Models Latent Actions
VISTA: Vision-Grounded and Physics-Validated Adaptation of UMI data for VLA Training
Jun 3, 2026Siyuan Yang, Linzheng Guo, Ouyang Lu +10Vision-Language-Action Models Robotic Datasets
Scaling Datasets for Multi-Sensor, Multi-Agent, and Multi-Domain Learning in Autonomous Systems
Jun 3, 2026R. Spencer Hallyburton, David Hunt, Miroslav PajicMultimodal Dataset Robotic Datasets
Co-training with Ego-centric Video and Demonstration for Robot Navigation Task
Jun 1, 2026Shoya Kuno, Yumo Ouchi, Kanata SuzukiRobotic Datasets Egocentric Video
Modeling Robotics Dataset Construction as an Artifact-Based Build Process
May 29, 2026Leon Pohl, Lukas Beer, George Sebastian +1Robotic Datasets Robotics
GEM: Generative Supervision Helps Embodied Intelligence
May 27, 2026Ruowen Zhao, Bangguo Li, Zuyan Liu +9Vision-Language-Action Models Robotic Datasets
Colosseum V2: Benchmarking Generalization for Vision Language Action Models
May 26, 2026Jeremy Morgan, Prajwal Vijay, Hyeonho Oh +6Robotic Datasets
RoMo: A Large-Scale, Richly Organized Dataset and Semantic Taxonomy for Human Motion Generation
May 25, 2026Jiahao Zhang, Joseph Liu, Young-Yoon Lee +9Synthetic Motion Datasets Human Motion Generation
Extending Embodied Question Answering from Perception to Decision
May 25, 2026Xicheng Gong, Qiwei Li, Peiran Xu +1Embodied Knowledge-Based Visual Question Answering Benchmarks
TapSampling: Inference-Time Sampling with a Task-Progress-Understanding Verifier for Robotic Manipulation
May 25, 2026Sizhe Zhao, Shengping Zhang, Shuo Yang +3Inference-Time Control Robotic Datasets
stable-worldmodel: A Platform for Reproducible World Modeling Research and Evaluation
May 20, 2026Lucas Maes, Quentin Le Lidec, Luiz Facury +9World Models Real-World Environments

Sep 21, 2026 · cs.ROJ/K move · Enter open · S save

RoboTalk: Learning Multi-Robot Communication and Coordination from Multimodal Demonstrations

Dorian Benhamou Goldfajn, Mason Nakamura, Saaduddin Mahmud, Justin Svegliato+2

Multi-robot collaboration could enable more efficient and scalable solutions to complex robotic tasks, but collaboration under partial observability remains challenging. Natural-language communication offers a promising approach to coordinating robots under partial observability. However, in decentralized manipulation, jointly learning explicit inter-robot communication and skill-level action selection from multimodal demonstrations remains underexplored for small vision-language models (VLMs) intended for on-device deployment. To address this gap, we introduce RoboTalk, a synthetic data-generation pipeline and dataset of 7,950 multimodal trajectories spanning 53 mobile-manipulation kitchen tasks for training small VLMs to communicate and coordinate. The dataset includes a leader-follower planning protocol, tool calls (perception, manipulation, navigation, and communication), rationale traces, and diversified natural-language communication. Fine-tuning open-source models on our dataset can reach 77% success on novel held-out tasks, a significant improvement over the untuned open source models, which had a success rate of around ~2%.

Robotic Datasets

Open paper Ask about it PDF