cs.ROJun 14, 2026

λλ-Reachability: Geometric-Horizon Safety Bellman Equations for Humanoid Safety

Authors: Rui Chen, Shangtao Li, Yifan Sun, Changliu Liu

Abstract

We introduce λλ-Reachability, a scalable approach to Hamilton--Jacobi safety analysis for high-dimensional robotic systems. Unlike prior discounted formulations that rely on fixed one-step Bellman updates, λλ-Reachability employs a stochastic multi-step estimator of the safety value, using a geometrically distributed rollout horizon together with a randomly absorbed terminal. Conceptually analogous to TD(λλ), λλ-Reachability interpolates between local self-consistency updates and long-horizon max-over-trajectory safety targets via an interpretable horizon-control parameter. Unlike TD(λλ), where the terminal value is always incorporated in learning targets, the terminal safety value in λλ-Reachability is only used at a probability controlled by parameter δδ. We formally show that for δ<1δ<1, the update induces a contraction mapping that allows temporal-difference learning; as λ→1λ\to 1, the estimator recovers the undiscounted reachability objective. We apply λλ-Reachability to high-dimensional safety learning problems with both simulated and real humanoid robots under balance and collision avoidance constraints. Experimental results demonstrate that λλ-Reachability significantly improves both safe-set boundary classification and safety margin estimation compared to single-step temporal-difference baselines.

Explore similar work

CardsList