cs.LGNov 6, 2026

Probably Safe Sim-to-Real Transfer with Lifetime Validity

Authors: Rohan Tangri, Jan-Peter Calliess

Organizations: Machine Learning Research Group, University of Oxford, Oxford, United Kingdom.

Abstract

We present Dejavu, a method that makes sim-to-real transfer of reinforcement learning policies in constrained Markov decision processes probably safe over an unbounded sequence of policy updates. An anytime valid test using per-decision importance sampling and a betting confidence sequence certifies each candidate trained in simulation before deployment using only trajectories collected by a safe baseline policy operating in production. Simulation quality does not affect the safety guarantee, only the production sample efficiency of the method. Finally, a summable per-test failure probability yields the lifetime valid property. Empirical results across three sim-to-real benchmarks support the theoretical work.

Figures & tables

Appendix figures & tables4 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Provably Safe Sim-to-Real Transfer

    Sep 1, 2026Tingting Ni, Maryam KamgarpourReinforcement LearningSim-to-Real Transfer

  2. LyEvO: Lyapunov-Guided Evolutionary Optimization for Safe and Robust Sim-to-Real Policy Learning

    Aug 6, 2026Riccardo Curcio, Hongpeng Cao, Marco CaccamoRobot Policy LearningEvolutionary Optimization

  3. Abstract Sim2Real through Approximate Information States

    Apr 16, 2026Yunfu Deng, Yuhao Li, Josiah P. HannaSim-to-Real TransferState Abstraction