GNN-Based Deep Reinforcement Learning for Coastal Emergency Response under Extreme Water Levels
Organizations: CMCC Foundation – Euro-Mediterranean Center on Climate Change, Venice, Italy · Department of Environmental Sciences, Informatics and Statistics, Ca’ Foscari University of Venice, Italy · Griffith University, Gold Coast, Australia · Apter, Byron Bay, Australia ·
Abstract
When a storm surge approaches a coastal town, the emergency plan must be put into action quickly using water-level forecasts, flood extent, road access, vulnerable residents and shelters. Bringing this information together under time pressure is slow and depends on the duty officer's expertise. This paper is one step in a wider research line from data to safe decisions: machine learning to understand the hazard, reinforcement learning and planning to choose actions, large language models (LLMs) to explain and cross-check them, and an assurance layer that keeps people in charge. Here we address the action step on a real place. We ask whether a policy can learn the timing of emergency actions from decades of real events. Lido di Venezia is represented as a heterogeneous graph built from public elevation, road, building and census data and driven by hourly tide-gauge records from 1983 to 2024, with seven actions taken from the municipal emergency plan. A PPO policy is trained on this graph and compared, on storm windows unseen in training, with a rule-based system simulating the officer's discretionary decisions. On 18 historical test scenarios, PPO achieves a similar reduction in population exposure to the rule. With uncertain forecasts and limited protection it again performs similarly but does not outperform the tuned rule, and removing graph message passing does not substantially reduce performance. PPO therefore learns an effective protective response from an outcome-based reward alone: it is given the plan's actions and when each is allowed, but not the thresholds that tell the comparator when to act. Next steps test harder edge cases, move closer to a digital twin of the territory, and replace the simulated officer with assessment by emergency-management stakeholders, supported by LLM-based interpretation of each recommendation.
Figures & tables
| Action | Plan § | Type | Preconditions | Effect | Lat. | Cost |
|---|---|---|---|---|---|---|
| monitor | 4.1.4.1, 4.1.5.5 | default | always legal (no-op) | — | 0 | 0 |
| issue_alert | 4.1.4.9 | mandate | 1-h forecast cm; not yet alerted | preparedness flag | 0 | 0 |
| deploy_sandbags | 4.1.4.8 | discr. | exposed zone; resources | cm protection | 1 | 1 |
| close_road | 4.1.4.9 | discr. | junction water level flood threshold | junction blocked | 0 | 0 |
| open_shelter | 5.3.2, 4.1.4.8 | discr. | accessible; capacity ; not active; resources | shelter active | 1 | 1 |
| assisted_evacuation | 4.2.3.1, 4.2.3.4 | discr. | zone not evacuated; passable path to a shelter; resources | zone evacuated | 1 | 1 |
| Policy | Exposure (person-h) | Displacement (person-h) | Peak exposed (persons) | Zero-exposure windows |
|---|---|---|---|---|
| Mandates only (literal plan) | 2,424 | 40,920 | 805 | 0.39 |
| Plan-extended | 1,439 | 47,269 | 722 | 0.39 |
| Static trigger (tune-selected) | 308 | 41,721 | 233 | 0.72 |
| No message passing | 285 77 | 42,007 | 210 | 0.74 |
| Learned policy | 262 26 | 42,007 | 187 | 0.77 |
Disaster Response
Disaster response uses data, models, and planning tools to assess hazards and coordinate evacuation, relief, and recovery.
See all 64 papers