cs.CVMar 17, 2026

Behavior-Centric Extraction of Scenarios from Highway Traffic Data and their Domain-Knowledge-Guided Clustering using CVQ-VAE

Authors: Niklas Roßberg, Sinan Hasirlioglu, Mohamed Essayed Bouzouraa, Wolfgang Utschick, Michael Botsch

Organizations: Technische Hochschule Ingolstadt, 85049 Ingolstadt, Germany · AUDI AG, 85045 Ingolstadt, Germany · Technische Universität München, 80333 München, Germany

Abstract

Approval of ADS depends on evaluating its behavior within representative real-world traffic scenarios. A common way to obtain such scenarios is to extract them from real-world data recordings. These can then be grouped and serve as basis on which the ADS is subsequently tested. This poses two central challenges: how scenarios are extracted and how they are grouped. Existing extraction methods rely on heterogeneous definitions, hindering scenario comparability. For the grouping of scenarios, rule-based or ML-based methods can be utilized. However, while modern ML-based approaches can handle the complexity of traffic scenarios, unlike rule-based approaches, they lack interpretability and may not align with domain-knowledge. This work contributes to a standardized scenario extraction based on the Scenario-as-Specification concept, as well as a domain-knowledge-guided scenario clustering process. Experiments on the highD dataset demonstrate that scenarios can be extracted reliably and that domain-knowledge can be effectively integrated into the clustering process. As a result, the proposed methodology supports a more standardized process for deriving scenario categories from highway data recordings and thus enables a more efficient validation process of automated vehicles.

Figures & tables

Explore similar work

CardsList
  1. Scene Graph-based Driving Scenario Extraction for Automotive Egocentric Datasets

    Aug 31, 2026Stefan Ramdhan, Kyanna Dagenais, Vera Pantelic +2Autonomous Driving DatasetsAutonomous Driving

  2. Multimodal Scenario Similarity Search for Autonomous Driving

    Jul 10, 2026Tamás Matuszka, András Tamásy, Balázs SzolárAutonomous Driving DatasetsMultimodal IR

  3. From Driving Videos to Simulatable Scenarios

    Jun 20, 2026Alexandre Levy, Ernest Valveny Llobet, Antonio Manuel LópezAutonomous Driving SimulationAutonomous Driving Scenario Generation