GraSP-STL: A Graph-Based Framework for Zero-Shot Signal Temporal Logic Planning via Offline Goal-Conditioned Reinforcement Learning
Organizations: School of Automation & Intelligent Sensing, Shanghai Jiao Tong University, Shanghai 200240, China.
Abstract
This paper studies offline, zero-shot planning under Signal Temporal Logic (STL) specifications. We assume access only to an offline dataset of state-action-state transitions collected by a task-agnostic behavior policy, with no analytical dynamics model, no further environment interaction, and no task-specific retraining. The objective is to synthesize a control strategy whose resulting trajectory satisfies an arbitrary unseen STL specification. To this end, we propose GraSP-STL, a graph-search-based framework for zero-shot STL planning from offline trajectories. The method learns a goal-conditioned value function from offline data and uses it to induce a finite-horizon reachability metric over the state space. Based on this metric, it constructs a directed graph abstraction whose nodes represent representative states and whose edges encode feasible short-horizon transitions. Planning is then formulated as a graph search over waypoint sequences, evaluated using arithmetic-geometric mean robustness and its interval semantics, and executed by a learned goal-conditioned policy. The proposed framework separates reusable reachability learning from task-conditioned planning, enabling zero-shot generalization to unseen STL tasks and long-horizon planning through the composition of short-horizon behaviors from offline data. Experimental results demonstrate its effectiveness on a range of offline STL planning tasks.
Figures & tables
| ID | STL Formula |
|---|---|
| Basic (Reachability & Disjunction) | |
| T1 | |
| T2 | |
| T3 | |
| Intermediate (Sequential & Safety) | |
| T4 | |
| Template | PSR (%) | ESR (%) | PT (s) |
| Basic (Reachability & Disjunction) | |||
| T1 | 99.50 | 89.50 | |
| T2 | 100.00 | 97.00 | |
| T3 | 100.00 | 88.00 | |
| Basic Subtotal | |||
| Intermediate (Sequential & Safety) | |||