cs.CVNov 8, 2026

NightSteps: A Night-Time Dataset and Benchmark for Pedestrian Crossing Intention Prediction

Authors: Sjoerd Takken, Shaodi You

Organizations: University of Amsterdam

Abstract

Autonomous vehicles use pedestrian crossing intention prediction (PCIP) to participate safely in traffic. Existing models are largely trained under favourable daytime conditions with sufficient daylight. Little is known about the robustness of these models under night-time and low-light conditions, due to the lack of datasets containing night-time footage. This paper investigates how a dataset, named NightSteps, can be constructed and evaluated as a baseline benchmark. The dataset is based on nighttime dashcam footage collected from six different cities around the world, capturing a wide variety of road conditions. The dataset consists of dashcam-recorded point-of-view footage, raw data of pedestrians' locations with corresponding 'track ids' and ground-truth labels containing accurate information about pedestrian crossing behaviour, resulting in a diverse dataset. Gemini, ChatGPT, and human assessment are used to demonstrate the usability of the dataset by predicting crossings in clips from the dataset and comparing the results with the initial ground-truth labels. These results show that human input achieves an accuracy of 88.17% and an F1-score of 80.21%. Predictions from Gemini and ChatGPT perform lower, with accuracies of 60% and 79.13% respectively, and F1-scores of 42.50% and 63.64%. The evaluation demonstrates that the NightSteps dataset can be used for future model evaluation to test the performance of PCIP, with the aim of improving road safety at night.

Figures & tables

Explore similar work

CardsList
  1. TrajFusionNet+: Transformer-Based Prediction of Pedestrian Crossing Intention via Fusion of Trajectory Representations and Scene Graphs

    Sep 9, 2026François G. Landry, Moulay A. AkhloufiPedestrian Intention PredictionMultimodal Fusion

  2. Pedestrian Crossing Intent Prediction via Psychological Features and Transformer Fusion

    Mar 20, 2026Sima Ashayer, Hoang H. Nguyen, Yu Liang +1Pedestrian Intention PredictionPedestrian Behavior Modeling

  3. Adaptive Cross-Modal Fusion with Sparse Attention for Pedestrian Crossing Intention Prediction

    Jul 14, 2026Md Mahfuzur Rahman, Pengzhan Zhou, A F M Abdun Noor +5Pedestrian Intention PredictionAutonomous Driving