Robotic Datasets
Robotic datasets are collections of sensory data (images, depth maps, lidar, IMU data, etc.) and corresponding robot actions, crucial for training and evaluating robot learning algorithms. Current research emphasizes creating larger, more diverse datasets encompassing various robot platforms, tasks, and environments, often employing techniques like data augmentation and domain adaptation to address data scarcity and improve generalization. This work is driven by the need for robust, generalizable robot policies, leveraging architectures such as transformers and employing algorithms like distributionally robust optimization to improve data efficiency and downstream performance in applications ranging from manipulation to navigation. The resulting datasets and improved algorithms are vital for advancing the field of robotics and enabling more capable and adaptable robots in real-world scenarios.
Papers
Collecting Larg-Scale Robotic Datasets on a High-Speed Mobile Platform
Yuxin Lin, Jiaxuan Ma, Sizhe Gu, Jipeng Kong, Bowen Xu, Xiting Zhao, Dengji Zhao, Wenhan Cao, Sören Schwertfeger
High-Quality, ROS Compatible Video Encoding and Decoding for High-Definition Datasets
Jian Li, Bowen Xu, Sören Schwertfeger
Octo: An Open-Source Generalist Robot Policy
Octo Model Team, Dibya Ghosh, Homer Walke, Karl Pertsch, Kevin Black, Oier Mees, Sudeep Dasari, Joey Hejna, Tobias Kreiman, Charles Xu, Jianlan Luo, You Liang Tan, Lawrence Yunliang Chen, Pannag Sanketi, Quan Vuong, Ted Xiao, Dorsa Sadigh, Chelsea Finn, Sergey Levine
Using Unsupervised Learning to Explore Robot-Pedestrian Interactions in Urban Environments
Sebastian Zug, Georg Jäger, Norman Seyffer, Martin Plank, Gero Licht, Felix Wilhelm Siebert