cs.RONov 6, 2026

Who Taught the Robot That? Removing One User's Corrections from a Robot Policy That Learns Online

Authors: Eshika Pathak, Leela Krishna

Organizations: University of Illinois Urbana-Champaign · Centific

Abstract

A robot that keeps learning after deployment is corrected by several people in turn, and one of them may later ask to be removed. We show that whether the robot can forget that person depends on how people correct it. The goal of removal is the robot that would exist if the person had never been there, which we compute exactly in two simulated tasks with scripted users. When users correct the robot by taking over control, an ordered log of training updates is enough: retraining on the remaining sessions in their original order gives a robot as close to the goal as training noise allows. Deleting the person's data and retraining in one pass does not, even when the other users' corrections do not depend on the removed person, because it loses the order of training. When users only nudge the robot's action, the other users' corrections carry the removed person's influence, and no method we tested recovers the goal robot. Continuing to train without the person removes most of their habits, but not what their data in the training buffer keep alive. The log can identify one clearly harmful user, but not rank users by influence better than counting their corrections.

Figures & tables

Explore similar work

CardsList
  1. REDIRECT: A 1% Fix for Bad Robot Habits

    Oct 2, 2026Yu Zhang, Jiazhuo Li, Yancong Wei +3Learning from Suboptimal DemonstrationsRobot Policy Adaptation

  2. Enhancing Goal Inference via Correction Timing

    Feb 20, 2026Anjiabei Wang, Shuangge Wang, Tesca FitzgeraldRobot LearningHuman-Robot Collaboration

  3. Environment Edits as a Corrective Signal for Reward Learning

    Oct 26, 2026Isaac Ngui, Courtney McBeth, Nancy M. AmatoRobot LearningPreference Learning