cs.RONov 18, 2026

Improving While Deployed: Learning Proactive End-to-End Driving from Imperfect Human Takeover Data

Authors: Yangang Ren, Di Zeng, Jun Li, Zirui Li, Chengjiang Zhang, Xiaoqing Ye, Ji Tao, Chen Lv

Organizations: Nanyang Technological University · Changan Automobile · Wuhan University

Abstract

Once deployed on vehicles, end-to-end driving models continuously encounter challenging scenarios, generating valuable human takeover data that capture both model outputs and human behaviors. However, human interventions are often imperfect, as drivers may intervene too late or unnecessarily. Consequently, direct imitation can reinforce late responses or discourage otherwise appropriate maneuvers. To address this challenge, we propose an offline post-training framework that transforms imperfect takeover data into proactive supervision. We first construct diverse trajectory candidates by augmenting the plans of the deployed model and shifting recorded human corrective maneuvers earlier in time. We then train a scene-conditioned trajectory scorer to rank these candidates using expert demonstrations and unpaired preference signals from takeover logs. Using this scorer, we selectively replace pre-takeover training targets with higher-scoring candidates while retaining the original targets in normal driving scenarios. Finally, we distill the resulting targets into the driving model without changing its inference architecture. In closed-loop evaluations using real-world scenarios reconstructed with 4D Gaussian splatting, our method achieves the highest overall success rate, outperforming the deployed model, direct imitation learning and trajectory post-optimization. These results highlight a practical path toward efficient updates of deployed driving models using existing fleet logs.

Figures & tables

Explore similar work

CardsList
  1. Learning from Mistakes: Post-Training for Driving VLA with Takeover Data

    Mar 16, 2026Yinfeng Gao, Deqing Liu, Qichao Zhang +7Autonomous DrivingVLMs for Autonomous Driving

  2. Post-Training in End-to-End Autonomous Driving

    Jul 9, 2026Ruining Yang, Muxing Wang, Yixiao Chen +8End-to-End Autonomous DrivingAutonomous Driving

  3. OPTED: On-Policy Fine-Tuning for End-to-End Driving using a Render-Free Teacher

    Sep 17, 2026Damiano Da Col, Maximilian Igl, Peter Karkus +5End-to-End Autonomous DrivingRL Post-Training