Synergizing Drone Delivery Order Pooling and Road Network Monitoring through Monitoring-Task Orderization
Organizations: Department of Civil and Environmental Engineering, The Hong Kong University of Science and Technology, Hong Kong, China · School of Architecture, Civil and Environmental Engineering (ENAC), École Polytechnique Fédérale de Lausanne (EPFL), Lausanne, Switzerland
Abstract
This paper investigates the real-time dispatch of a shared drone fleet for on-demand food delivery and urban road network monitoring. We consider a courier-drone collaborative setting in which couriers transport orders to launchpads and drones complete the final delivery leg to kiosks. Drones may consolidate multiple origin-destination orders within one flight and make monitoring-aware route adjustments to collect real-time traffic information subject to delivery-time constraints. This yields a joint decision problem coupling dynamic order-to-drone matching, multi-order pooling, routing, and time-varying monitoring under fleet-level competition and uncertainty. We propose monitoring-task orderization, which periodically converts road-network nodes with high congestion and stale information into virtual monitoring orders. Pooling these virtual tasks with food-delivery orders creates a unified heterogeneous task set and transforms the coupled matching-and-routing problem into an order-level decision process. Building on this abstraction, we formulate a decentralized graph-interdependent Multi-Agent Markov Decision Process and develop Graph Multi-Agent Q-Learning (Graph-MAQL), which captures localized inter-agent dependencies through bipartite match coordination graphs. Agent-task value estimates are then used as edge weights in a dynamic heterogeneous bipartite matching program for globally feasible execution. Experiments using real-world data reveal strong operational synergy between delivery and monitoring. Monitoring-task orderization improves monitoring performance by 25.1% with less than a 1% reduction in delivery performance, while Graph-MAQL improves the aggregate objective by up to 20.8%, reduces deadline violations by over 40%, and transfers zero-shot to higher demand intensity without retraining.
Figures & tables
| Orders Picked Up | Deadline Violation Rate (%) | Link Coverage Rate (%) | Bottleneck Roads Monitor Frequency | Delivery Score (HKD) | Monitoring Score | Average Occupied Seats | |
| 0 | 4188 12.2 | 5.0 0.90 | 63.9 1.07 | 3.90 0.18 | 79639 657 | 5555 145 | 2.25 0.03 |
| 3 | 4191 12.3 | 4.3 0.80 | 69.7 0.69 | 4.29 0.14 | 80129 557 | 5926 97.3 | 2.31 0.03 |
| 6 | 4189 14.4 | 6.4 1.16 | 71.1 1.04 | 4.59 0.15 | 79057 774 | 6269 132.3 | 2.33 0.04 |
| 8 | 4161 16.2 | 6.6 1.15 | 72.3 0.70 | 4.80 0.13 | 78129 652 | 6550 74.3 | 2.40 0.03 |
| 10 | 4138 13.3 | 9.0 0.84 | 72.7 0.61 | 4.90 0.15 | 75747 1027 | 6558 104.3 | 2.45 0.03 |
| Orders Picked Up | Deadline Violation Rate (%) | Link Coverage Rate (%) | Bottleneck Roads Monitor Frequency | Delivery Score (HKD) | Monitoring Score | Overall Score (HKD) | |
| 0 | 4191 12.3 | 4.3 0.80 | 69.7 0.69 | 4.29 0.14 | 80129 557 | 5926 97 | 97887 710 |
| 25 | 4203 14.4 | 5.6 1.19 | 74.2 0.75 | 5.13 0.20 | 80105 1016 | 6936 111 | 100894 902 |
| 50 | 4197 15.4 | 5.9 0.73 | 75.9 0.63 | 5.68 0.19 | 79834 888 | 7248 78 | 101556 881 |
| 75 | 4194 15.1 | 6.3 1.14 | 75.2 0.53 | 5.94 0.18 | 80099 904 | 7361 70 | 102159 893 |
| 100 | 4168 15.8 | 6.8 0.68 | 75.2 1.00 | 6.09 0.16 | 79362 642 | 7413 78 | 101576 708 |
| Method | Orders Picked Up | Viol. Rate (%) | Link Cov. (%) | Bttlnk. Freq. | Delivery Score | Monitor. Score | Overall Score |
| Greedy | 3702 15.8 | 19.0 1.26 | 76.8 0.79 | 6.27 0.23 | 63238 753 | 7617 81 | 86059 906 |
| Independent-MAQL | 4168 15.8 | 6.8 0.68 | 75.2 1.00 | 6.09 0.16 | 79362 642 | 7413 78 | 101576 708 |
| Graph-MAQL | 4199 6.8 | 3.9 0.39 | 74.0 0.75 | 5.84 0.16 | 82332 225 | 7231 103 | 104000 378 |
Appendix figures & tables1 asset
Supplementary material from the paper’s appendix.