cs.ROJun 28, 2026

Behavior Uncloning: Distilling Mode Redirection into Policy Weights without Inference-Time Steering

Authors: Hao WangJiuzhou LeiDayou LiBangya LiuMinghui ZhengManling LiRuohan ZhangZhiwen Fan

Organizations: Texas A&M University · University of Wisconsin · Northwestern University · Stanford University

Abstract

Behavior-cloned policies often learn multiple behavior modes from demonstration datasets, including modes that are unsafe or otherwise undesired at deployment. For example, a policy trained on diverse handover demonstrations may learn to pass a knife blade-first. Standard remedies such as data curation and inference-time steering either require access to the original demonstrations for full retraining or add substantial inference-time overhead. To address this gap, we propose MoRE(Mode Redirection), which redirects policy rollouts toward desired behavior modes through a short "uncloning" step. Specifically, MoRE distills the redirection signal from a temporary mode classifier into the policy weights to steer behavior. A retain loss balances this edit by preserving desired-mode competence, allowing the standalone policy to suppress unwanted modes with zero inference-time overhead. Across eight simulated and real-world tasks, MoRE improves the average deployment success rate (SR) by 44 percentage points over the original mixed-mode policy. Among all compared adaptation and steering baselines, MoRE achieves the strongest SR and approaches the filtered-data retraining reference, while preserving task competence and inference speed. MoRE also generalizes across robot policy backbones, including Diffusion Policy and the Pi0.5 VLA, diverse task categories, and real-world deployments.

Explore similar work

CardsList
  1. Proxy Policy Steering

    Sep 8, 2026Chuanruo Ning, Tianrui Wang, Wei-Chiu Ma +1Robot PoliciesRobot Systems

  2. MODIP: Efficient Model-Based Optimization for Diffusion Policies

    Jun 9, 2026Zakariae El Asri, Philippe Gratias-Quiquandon, Nicolas Thome +1Diffusion PoliciesDeep Reinforcement Learning