eess.SYSep 26, 2025

Reinforcement Learning based Traffic Signal Control for Queue Minimization: From Lane-based to Laneless Traffic

Authors: Anirud Nandakumar, Chayan Banerjee, Lelitha Devi Vanajakshi

Organizations: Department of Civil Engineering, IIT Madras · Wadhwani School of Data Science & AI, IIT Madras · School of Electrical Engineering & Robotics, QUT, Brisbane, Australia · Robert Bosch Centre for Data Science & AI, IIT Madras

Abstract

Efficient traffic signal control (TSC) is essential for reducing congestion and delays. Traditional TSC methods struggle to capture the dynamics of laneless, heterogeneous traffic. We propose a reinforcement learning (RL) based adaptive TSC framework whose reward depends only on approach-level queue length, motivated by the difficulty of obtaining per-vehicle measurements in laneless traffic, and evaluate it using SUMO on a conventional lane-based, homogeneous (LBHO) intersection and on a non-orthogonal laneless, heterogeneous (LLHE) intersection. On the LBHO site, the lowest mean configuration has about 23% lower mean queue length than a Dynamic Webster baseline, and the unselected Full-State configuration about 15% lower. On the LLHE site, all RL configurations have 66-73% lower mean queue length than a Dynamic Webster baseline under nominal demand, and 63--74% lower under two higher-demand scenarios evaluated without retraining. Our algorithm also outperforms actuated control and a RESCO-DQN baseline on mean queue length. We additionally release a laneless, heterogeneous-vehicle SUMO framework integrated with RL based signal control, to our knowledge the first such open implementation on a current SUMO version.

Figures & tables

Appendix figures & tables6 assets

Supplementary material from the paper’s appendix.

Appendix

Explore similar work

CardsList
  1. Evaluating the Robustness of Reinforcement Learning based Adaptive Traffic Signal Control

    Mar 16, 2026Dickens Kwesiga, Angshuman Guin, Khaled Abdelghany +1Traffic Signal ControlReinforcement Learning

  2. Unified Optimization of Traffic Signal and Lane Channelization for an Isolated Intersection Using Reinforcement Learning

    Nov 10, 2026Jiwon Kang, Jiyoung Kim, Hyunseok Jun +1Traffic Signal ControlIntelligent Transportation Systems

  3. Reinforcement Learning-Based Traffic Signal Control for IoT-Enabled Intersections

    Jun 20, 2026Yousef AlSaqabiReinforcement LearningIntelligent Transportation Systems