cs.LGMay 25, 2025

Hindsight Relabeling is All You Need for Reach-Avoid Learning

Authors: Kevin Li, Marinka Zitnik

Organizations: Massachusetts Institute of Technology · Harvard Medical School · Kempner Institute at Harvard University

Abstract

Offline goal-conditioned reinforcement learning methods have shown promise for reach-avoid tasks, where an agent must reach a target state while avoiding undesirable regions of the state space. Existing approaches typically encode avoid-region information into an augmented state space and cost function, which prevents flexible, dynamic specification of novel avoid-region information at evaluation time. They also rely heavily on meticulously designed reward and cost functions, limiting transferability to novel environments and specifications. We introduce RADT, a decision transformer approach for offline, reward-free, goal-conditioned, avoid-region-conditioned RL. RADT encodes goals and avoid-regions directly as prompt tokens, allowing any number of avoid-regions of arbitrary size to be specified at evaluation time. Using only suboptimal offline trajectories from a random policy, RADT can learn reach-avoid behavior in a completely data-driven manner using our novel avoid-region hindsight relabeling approach, without the need for reward/cost supervision. We benchmark RADT against existing offline goal-conditioned RL models across 17 tasks, environments, and experimental settings. RADT generalizes in a zero-shot manner to out-of-distribution avoid-region sizes and counts, outperforming baselines that require retraining. In one such zero-shot setting, RADT achieves 35.7% improvement in normalized cost over the best retrained baseline while maintaining high goal-reaching success. We also apply RADT to cell reprogramming in biology, demonstrating its versatility.

Figures & tables

Appendix figures & tables23 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. RAD: Retrieval High-quality Demonstrations to Enhance Decision-making

    Jul 21, 2025Lu Guo, Yixiang Shan, Zhengbang Zhu +5Offline RLGeneralization in RL

  2. Goal Sets, Not Goal States: Queryable Robot Goals through Goal-Set Hindsight Relabeling

    Jun 8, 2026Carlos Vélez García, Miguel Cazorla, Jorge PomaresOffline RLGoal-Conditioned RL

  3. Beyond Hard Constraints: Budget-Conditioned Reachability For Safe Offline Reinforcement Learning

    Mar 8, 2026Janaka Chathuranga Brahmanage, Akshat KumarSafe RLSafe Offline RL