cs.ROJun 11, 2026

Proprioceptive-visual correspondence enables self-other distinction in humanoid robots

Authors: Yurun ChenTianyuan GaoYizhong GeShikun BanYizhou WangHongkai XiongWenjun ZengWentao Zhu

Organizations: Eastern Institute of Technology, Ningbo · Peking University · Carnegie Mellon University · Shanghai Jiao Tong University · East China Normal University · Ningbo Institute of Digital Twin

Abstract

Distinguishing self from others is a prerequisite for social intelligence, yet humanoid robots that increasingly share workspaces with humans still lack this ability. Here we show that a humanoid robot can learn self-other distinction from proprioceptive-visual correspondence, without any identity labels or kinematic models. Once established, this distinction bootstraps a predictive self-model that maps joint configurations to three-dimensional body occupancy, capturing how the robot's body changes with action. In multi-agent scenes involving humans or morphologically identical robots, the system reliably identifies itself, learns a 3D self-model, and supports downstream tasks including target reaching, collision-aware motion planning, and human-to-robot motion retargeting. Together, these results outline a route toward bodily self-representation in robots that act and coordinate alongside others in shared physical environments. Project page: https://euron-zc.github.io/humanoid-self-model/.

Explore similar work

CardsList