cs.ROOct 31, 2026

Hi-CoLA: High Confidence Lower Bound Approximation Based Reinforcement Learning for Flex-Route Transit Operation Control

Authors: Qi Kang, Haris N. Koutsopoulos, Hongliang Guo, Jinhua Zhao

Organizations: Northeastern University · I2R, A*STAR · MIT

Abstract

This paper studies safe policy improvement for real-time operation control of flex-route transit (FRT) systems, where robustness is critical and any performance decrease is undesirable. While reinforcement learning (RL) has shown strong empirical success, its adoption remains limited in safety and cost critical applications, such as intelligent transportation, since learned policies lack statistically certified performance guarantees before deployment. In this paper, we propose the High Confidence Lower Bound Approximation (Hi-CoLA) RL framework, which combines importance sampling and concentration inequalities with a differentiable surrogate network to efficiently estimate the high-confidence performance lower bound and optimize it via policy gradient for robust performance improvement. On the FRT operation control problem, Hi-CoLA outperforms state-of-the-art offline and safe RL methods in both average and tail-risk performance. A case study on an actual route in Chicago, implemented in the SUMO simulator, serves as a proof of concept. Hi-CoLA enhances real-time FRT control with guaranteed performance and is broadly applicable to other safety critical decision-making scenarios.

Figures & tables

Explore similar work

CardsList
  1. Value-Decomposed Reinforcement Learning Framework for Taxiway Routing with Hierarchical Conflict-Aware Observations

    May 9, 2026Shizhong Zhou, Haifeng Liu, Zheng Zhang +3Collision AvoidanceVehicle Routing

  2. RLFTSim: Realistic and Controllable Multi-Agent Traffic Simulation via Reinforcement Learning Fine-Tuning

    May 18, 2026Ehsan Ahmadi, Hunter Schofield, Behzad Khamidehi +5Multi-Agent SystemsAutonomous Driving Simulation

  3. Off-Policy Safe Reinforcement Learning with Constrained Optimistic Exploration

    Mar 25, 2026Guopeng Li, Matthijs T. J. Spaan, Julian F. P. KooijSafe RLConstrained RL