cs.ROSep 25, 2026

Kintsugi-VLA: Turning Failed Robot Rollouts into Recovery Data through Interventional Recoverability

Authors: Ivan Snegirev, Elizaveta Semenyakina, Dmitrii Maliukov, Miguel Altamirano Cabrera, Dzmitry Tsetserukou

Organizations: Intelligent Space Robotics Laboratory, Skolkovo Institute of Science and Technology

Abstract

Simulation enables scalable training of Vision-Language-Action policies by using privileged experts to generate visual demonstrations without requiring every trajectory to be collected through manual teleoperation. However, such pipelines typically retain successful demonstrations while failed rollouts are discarded, even though they expose precisely the off-nominal states from which recovery must be learned. We introduce Kintsugi-VLA, a framework for converting failed rollouts into targeted synthetic recovery data by exploiting exact state restoration and branching in simulation. For a fixed privileged expert, we define interventional recoverability as the probability of completing the original task after the simulator is restored to a given state, estimate it using adaptive Monte Carlo continuations with pointwise Wilson intervals, and characterize its non-monotonic evolution along failed trajectories. These estimates identify an observed terminal low-recoverability frontier-the point after which measured recoverability remains below a threshold-which is then used to select informative recovery starting states. In a simulated Franka manipulation task, targeted recovery data yield aggregate SmolVLA recovery success of 34.6% and 38.4% under difficulty- and frame-budget matching, respectively, 5.8 and 6.7 percentage points above uniform sampling within the same recovery window. The same ordering is observed under disturbed end-to-end execution and shifted clutter and physics conditions, while clean-task success decreases from 76.8% to 74.7%. Kintsugi-VLA demonstrates how failed simulator rollouts can be transformed from discarded experience into structured recovery-training data through direct interventional measurement.

Figures & tables

Explore similar work

CardsList
  1. ReCoVLA: VLM-Guided Reward Compilation for Failure Recovery in Vision-Language-Action Policies

    Jun 8, 2026Haodi Hu, Chung-Ta Huang, Jing Liu +4Robot Failure RecoveryVision-Language-Action Models

  2. RePO-VLA: Recovery-Driven Policy Optimization for Vision-Language-Action Models

    May 10, 2026Weijia Liufu, Xiaoyu Guo, Ruiyi Chen +16VLM RobustnessRobot Failure Recovery

  3. Imagining Recovery: Inference-Time Counterfactual Realignment for Vision-Language-Action Models

    Aug 14, 2026Yanyan Zhang, Disheng Liu, Kai Ye +6Vision-Language-Action ModelsRobustness of VLA Models