cs.LGNov 12, 2026

HALight: Heterogeneous Multi-Agent Reinforcement Learning for Traffic Signal Control under Lane-Level Missing Observations

Authors: Chenkai Hu, Yingqian Zhang, Ming Xie, Yi Fang, Chengxiang Jin, Chao Li

Organizations: Department of Control Science and Engineering, Zhejiang University, Hangzhou 310027, China · Zhejiang Institute of Communications Co.,LTD., Hangzhou, Zhejiang, 310030, China · College of Control Science and Engineering, Zhejiang University, Hangzhou, Zhejiang, 310027, China · Institute of Cyberspace Security, College of Information Engineering, Zhejiang University of Technology, Hangzhou 310023, China

Abstract

Multi-agent reinforcement learning has shown great promise for traffic signal control. However, most existing methods rely on two key assumptions: (i) agents are assumed to be homogeneous with unified observation/action spaces; (ii) full and reliable lane-level traffic observations are available to all agents. In practice, urban road networks exhibit substantial structural heterogeneity (e.g., lane configurations and phase designs), while sensor failures and incomplete detector coverage often result in missing incoming lane measurements. Such issues can severely impair coordination and destabilize learning. To address these challenges, we propose HALight, a communication-enhanced heterogeneous multi-agent reinforcement learning framework for traffic signal control under lane-level missing observations. HALight supports intersection-specific observation and action modeling to accommodate heterogeneous intersections, and incorporates a lightweight one-hop neighborhood communication module to enrich spatial context when lane-level observations are partially unavailable. Moreover, HALight adopts a sequential policy update scheme to improve coordination among heterogeneous agents. Experimental results on two real-world road networks demonstrate that HALight outperforms representative homogeneous and heterogeneous baselines in terms of traffic efficiency and convergence behavior. The code and datasets used in this work are available at https://github.com/Huchenkaii/HALight.

Figures & tables

Explore similar work

CardsList
  1. CoordLight: Learning Decentralized Coordination for Network-Wide Traffic Signal Control

    Mar 25, 2026Yifeng Zhang, Harsh Goel, Peizhuo Li +3Traffic Signal ControlMulti-Agent Coordination

  2. LATS: Large Language Model Assisted Teacher-Student Framework for Multi-Agent Reinforcement Learning in Traffic Signal Control

    Mar 25, 2026Yifeng Zhang, Peizhuo Li, Tingguang Zhou +2Traffic Signal ControlLLM-Guided RL

  3. ReasonLight: A Multimodal Foundation Model-Enhanced Reinforcement Learning Framework for Zero-Shot Traffic Signal Control

    May 28, 2026Aoyu Pang, Maonan Wang, Yuejiao Xie +3RL ControlIntelligent Transportation Systems