Affordance Learning
Affordance learning focuses on enabling artificial agents, particularly robots, to understand and utilize the potential actions (affordances) offered by objects and environments. Current research emphasizes grounding affordances in 3D space using vision-language models (VLMs), often incorporating techniques like potential fields, Gaussian splatting, and attention mechanisms, to predict interaction regions and generate appropriate actions from natural language instructions. This field is crucial for advancing robotics, particularly in areas like human-robot collaboration and autonomous navigation, by enabling robots to interact more intelligently and flexibly with their surroundings.
Papers
What Makes an Educational Robot Game Fun? Framework Analysis of Children's Design Ideas
Elaheh Sanoubari, John Edison Muñoz, Ali Yamini, Neil Randall, Kerstni Dautenhahn
RT-Affordance: Affordances are Versatile Intermediate Representations for Robot Manipulation
Soroush Nasiriany, Sean Kirmani, Tianli Ding, Laura Smith, Yuke Zhu, Danny Driess, Dorsa Sadigh, Ted Xiao
APRICOT: Active Preference Learning and Constraint-Aware Task Planning with LLMs
Huaxiaoyue Wang, Nathaniel Chin, Gonzalo Gonzalez-Pumariega, Xiangwan Sun, Neha Sunkara, Maximus Adrian Pace, Jeannette Bohg, Sanjiban Choudhury
Semantics in Robotics: Environmental Data Can't Yield Conventions of Human Behaviour
Jamie Milton Freestone
Affordance-Centric Policy Learning: Sample Efficient and Generalisable Robot Policy Learning using Affordance-Centric Task Frames
Krishan Rana, Jad Abou-Chakra, Sourav Garg, Robert Lee, Ian Reid, Niko Suenderhauf
PAVLM: Advancing Point Cloud based Affordance Understanding Via Vision-Language Model
Shang-Ching Liu, Van Nhiem Tran, Wenkai Chen, Wei-Lun Cheng, Yen-Lin Huang, I-Bin Liao, Yung-Hui Li, Jianwei Zhang
Visual-Geometric Collaborative Guidance for Affordance Learning
Hongchen Luo, Wei Zhai, Jiao Wang, Yang Cao, Zheng-Jun Zha
GauTOAO: Gaussian-based Task-Oriented Affordance of Objects
Jiawen Wang, Dingsheng Luo
SpotLight: Robotic Scene Understanding through Interaction and Affordance Detection
Tim Engelbracht, René Zurbrügg, Marc Pollefeys, Hermann Blum, Zuria Bauer
Gradient-Driven 3D Segmentation and Affordance Transfer in Gaussian Splatting Using 2D Masks
Joji Joseph, Bharadwaj Amrutur, Shalabh Bhatnagar