mlsanityData to 7 Oct 2026

Exploring Semantic Clustering and Similarity Search for Heterogeneous Traffic Scenario Graph

arXiv 2507.05086 ↗First posted 7 Jul 2025cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Scenario-based testing is an indispensable instrument for the comprehensive validation and verification of automated vehicles (AVs). However, finding a manageable and finite, yet representative subset of scenarios in a scalable, possibly unsupervised manner is notoriously challenging. Our work is meant to constitute a cornerstone to facilitate sample-efficient testing, while still capturing the diversity of relevant operational design domains (ODDs) and accounting for the "long tail" phenomenon in particular. To this end, we first propose an expressive and flexible heterogeneous, spatio-temporal graph model for representing traffic scenarios. Leveraging recent advances of graph neural networks (GNNs), we then propose a self-supervised method to learn a universal embedding space for scenario graphs that enables clustering and similarity search. In particular, we implement contrastive learning alongside a bootstrapping-based approach and evaluate their suitability for partitioning the scenario space. Experiments on the nuPlan dataset confirm the model's ability to capture semantics and thus group related scenarios in a meaningful way despite the absence of discrete class labels. Different scenario types materialize as distinct clusters. Our results demonstrate how variable-length traffic scenarios can be condensed into single vector representations that enable nearest-neighbor retrieval of representative candidates for distinct scenario categories. Notably, this is achieved without manual labeling or bias towards an explicit objective such as criticality. Ultimately, our approach can serve as a basis for scalable selection of scenarios to further enhance the efficiency and robustness of testing AVs in simulation.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 22 references that are in the map. First posted on arXiv 7 Jul 2025.

Builds on

18 of 22 references.

References · 18

  1. 2020Graph Contrastive Learning with Augmentationscited by 1,203
  2. 2020Deep Graph Contrastive Representation Learningcited by 535
  3. 2017graph2vec: Learning Distributed Representations of Graphscited by 228
  4. 2019Graph Matching Networks for Learning the Similarity of Graph Structured Objectscited by 202
  5. 2021Large-Scale Representation Learning on Graphs via Bootstrappingcited by 184
  6. 2021DriveGAN: Towards a Controllable High-Quality Neural Simulationcited by 125
  7. 2022HDGT: Heterogeneous Driving Graph Transformer for Multi-Agent Trajectory Prediction via Scene Encodingcited by 109
  8. 2023ScenarioNet: Open-Source Platform for Large-Scale Traffic Scenario Simulation and Modelingcited by 60
  9. 2015Generalizing Pooling Functions in Convolutional Neural Networks: Mixed, Gated, and Treecited by 36
  10. 2021Permutation-Invariant Variational Autoencoder for Graph-Level Representation Learningcited by 23
  11. 2021roadscene2vec: A Tool for Extracting and Embedding Road Scene-Graphscited by 15
  12. 2020An Unsupervised Random Forest Clustering Technique for Automatic Traffic Scenario Categorizationcited by 13
6 more
  1. 2021Towards Traffic Scene Description: The Semantic Scene Graphcited by 12
  2. 2023Traffic Scene Similarity: a Graph-based Contrastive Learning Approachcited by 5
  3. 2024VistaScenario: Interaction Scenario Engineering for Vehicles with Intelligent Systems for Transport Automationcited by 5
  4. 2023Geometric Deep Learning for Autonomous Driving: Unlocking the Power of Graph Neural Networks With CommonRoad-Geometriccited by 4
  5. 2023Heterogeneous Graph-based Trajectory Prediction using Local Map Context and Social Interactionscited by 4
  6. 2022Toward Unsupervised Test Scenario Extraction for Automated Driving Systems from Urban Naturalistic Road Traffic Datacited by 1

Built on by

Not cited yet.