Robot Learning
Robot learning aims to enable robots to acquire new skills and adapt to diverse environments through learning, rather than explicit programming. Current research heavily focuses on improving data efficiency and generalization, employing techniques like transformer networks, diffusion models, and reinforcement learning algorithms (e.g., PPO, SAC) often combined with large language models and imitation learning from human demonstrations or simulations. This field is crucial for advancing robotics, enabling robots to perform complex tasks in unstructured settings and potentially revolutionizing various industries, from manufacturing and healthcare to logistics and home assistance.
Papers
Benchmarking Vision, Language, & Action Models on Robotic Learning Tasks
Pranav Guruprasad, Harshvardhan Sikka, Jaewoo Song, Yangyue Wang, Paul Pu Liang
DexHub and DART: Towards Internet Scale Robot Data Collection
Younghyo Park, Jagdeep Singh Bhatia, Lars Ankile, Pulkit Agrawal
So You Think You Can Scale Up Autonomous Robot Data Collection?
Suvir Mirchandani, Suneel Belkhale, Joey Hejna, Evelyn Choi, Md Sazzad Islam, Dorsa Sadigh
SPIRE: Synergistic Planning, Imitation, and Reinforcement Learning for Long-Horizon Manipulation
Zihan Zhou, Animesh Garg, Dieter Fox, Caelan Garrett, Ajay Mandlekar
Scaling Robot Policy Learning via Zero-Shot Labeling with Foundation Models
Nils Blank, Moritz Reuss, Marcel Rühle, Ömer Erdinç Yağmurlu, Fabian Wenzel, Oier Mees, Rudolf Lioutikov
VLM See, Robot Do: Human Demo Video to Robot Action Plan via Vision Language Model
Beichen Wang, Juexiao Zhang, Shuwen Dong, Irving Fang, Chen Feng
ARCap: Collecting High-quality Human Demonstrations for Robot Learning with Augmented Reality Feedback
Sirui Chen, Chen Wang, Kaden Nguyen, Li Fei-Fei, C. Karen Liu
Scaling Proprioceptive-Visual Learning with Heterogeneous Pre-trained Transformers
Lirui Wang, Xinlei Chen, Jialiang Zhao, Kaiming He
GravMAD: Grounded Spatial Value Maps Guided Action Diffusion for Generalized 3D Manipulation
Yangtao Chen, Zixuan Chen, Junhui Yin, Jing Huo, Pinzhuo Tian, Jieqi Shi, Yang Gao