Object Interaction

Object interaction research focuses on understanding and modeling how humans and robots interact with objects, aiming to improve human-computer interaction, robotics, and augmented/virtual reality. Current research emphasizes egocentric perspectives, leveraging advanced machine learning techniques like transformers and contrastive learning to analyze 3D hand-object interactions from video data, often incorporating multimodal information (e.g., eye gaze, depth). This work is driving progress in areas such as action recognition, object manipulation, and human-robot collaboration, with significant implications for the development of more intuitive and capable AI systems.