RiskBench: A Scenario-based Benchmark for Risk Identification
Not on the map. Why?
Abstract (arXiv)
Intelligent driving systems aim to achieve a zero-collision mobility experience, requiring interdisciplinary efforts to enhance safety performance. This work focuses on risk identification, the process of identifying and analyzing risks stemming from dynamic traffic participants and unexpected events. While significant advances have been made in the community, the current evaluation of different risk identification algorithms uses independent datasets, leading to difficulty in direct comparison and hindering collective progress toward safety performance enhancement. To address this limitation, we introduce RiskBench, a large-scale scenario-based benchmark for risk identification. We design a scenario taxonomy and augmentation pipeline to enable a systematic collection of ground truth risks under diverse scenarios. We assess the ability of ten algorithms to (1) detect and locate risks, (2) anticipate risks, and (3) facilitate decision-making. We conduct extensive experiments and summarize future research on risk identification. Our aim is to encourage collaborative endeavors in achieving a society with zero collisions. We have made our dataset and benchmark toolkit publicly on the project page: https://hcis-lab.github.io/RiskBench/
Key facts. Cited by 12 papers in the map (data through 14 Oct 2026). Builds on 54 of its 84 references that are in the map. First posted on arXiv 4 Dec 2023.
Builds on
54 of 84 references.
References · 54
- 2017Graph Attention Networkscited by 8,923
- 2019nuScenes: A multimodal dataset for autonomous drivingcited by 4,523
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
- 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,288
- 2022Planning-oriented Autonomous Drivingcited by 1,087
- 2019Argoverse: 3D Tracking and Forecasting with Rich Mapscited by 732
- 2023Argoverse 2: Next Generation Datasets for Self-Driving Perception and Forecastingcited by 707
- 2018Social GAN: Socially Acceptable Trajectories with Generative Adversarial Networkscited by 690
- 2021Large Scale Interactive Motion Forecasting for Autonomous Driving : The Waymo Open Motion Datasetcited by 537
- 2021NuPlan: A closed-loop ML-based planning benchmark for autonomous vehiclescited by 493
- 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 485
38 more
- 2019Learning by Cheatingcited by 383
- 2021Multi-Modal Fusion Transformer for End-to-End Autonomous Drivingcited by 377
- 2022V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformercited by 320
- 2023UniSim: A Neural Closed-Loop Sensor Simulatorcited by 297
- 2022Wayformer: Motion Forecasting via Simple & Efficient Attention Networkscited by 280
- 2022Motion Transformer with Global Intention Localization and Local Movement Refinementcited by 270
- 2019INTERACTION Dataset: An INTERnational, Adversarial and Cooperative moTION Dataset in Interactive Driving Scenarios with Semantic Mapscited by 231
- 2022V2X-Sim: Multi-Agent Collaborative Perception Dataset and Benchmark for Autonomous Drivingcited by 157
- 2022SHIFT: A Synthetic Driving Dataset for Continuous Multi-Task Domain Adaptationcited by 146
- 2022DRAMA: Joint Risk Localization and Captioning in Drivingcited by 126
- 2022ViP3D: End-to-end Visual Trajectory Prediction via 3D Agent Queriescited by 117
- 2022PlanT: Explainable Planning Transformers via Object-Level Representationscited by 105
- 2018Toward Driving Scene Understanding: A Dataset for Learning Driver Behavior and Causal Reasoningcited by 102
- 2023ReasonNet: End-to-End Driving with Temporal and Global Reasoningcited by 93
- 2021Constraints Penalized Q-learning for Safe Offline Reinforcement Learningcited by 91
- 2018TraPHic: Trajectory Prediction in Dense and Heterogeneous Traffic Using Weighted Interactionscited by 82
- 2019The H3D Dataset for Full-Surround 3D Multi-Object Detection and Tracking in Crowded Urban Scenescited by 80
- 2020MANTRA: Memory Augmented Networks for Multiple Trajectory Predictioncited by 69
- 2022SafeBench: A Benchmarking Platform for Safety Evaluation of Autonomous Vehiclescited by 66
- 2017Predicting Driver Attention in Critical Situationscited by 61
- 2020TITAN: Future Forecast using Action Priorscited by 58
- 2021LOKI: Long Term and Key Intentions for Trajectory Predictioncited by 57
- 2018Anticipating Traffic Accidents with Adaptive Loss and Large-scale Incident DBcited by 51
- 2020Learning to Evaluate Perception Models Using Planner-Centric Metricscited by 49
- 2018Scenarios for Development, Test and Validation of Automated Vehiclescited by 48
- 2015Recurrent Neural Networks for Driver Activity Anticipation via Sensory-Fusion Architecturecited by 42
- 2020Who Make Drivers Stop? Towards Driver-centric Risk Assessment: Risk Object Identification via Causal Inferencecited by 34
- 2017Agent-Centric Risk Assessment: Accident Anticipation and Risky Region Localizationcited by 33
- 2021Context-Aware Safe Reinforcement Learning for Non-Stationary Environmentscited by 33
- 2019Looking at the right stuff: Guided semantic-gaze for autonomous drivingcited by 32
- 2019MEDIRL: Predicting the Visual Attention of Drivers via Maximum Entropy Deep Inverse Reinforcement Learningcited by 29
- 2021UMBRELLA: Uncertainty-Aware Model-Based Offline Reinforcement Learning Leveraging Planningcited by 23
- 2019Learning 3D-aware Egocentric Spatial-Temporal Interaction via Graph Convolutional Networkscited by 22
- 2021Binary TTC: A Temporal Geofence for Autonomous Navigationcited by 20
- 2019Periphery-Fovea Multi-Resolution Driving Model guided by Human Attentioncited by 19
- 2019Goal-oriented Object Importance Estimation in On-road Driving Videoscited by 19
- 2023Towards Benchmarking and Assessing Visual Naturalness of Physical World Adversarial Attackscited by 18
- 2020Interaction Graphs for Object Importance Estimation in On-road Driving Videoscited by 15
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2024: 2; 2025: 5; 2026: 5.
12 papers.
- 2025What Changed and What Could Have Changed? State-Change Counterfactuals for Procedure-Aware Video Representation Learningcited by 6
- 2025Controllable Collision Scenario Generation via Collision Pattern Predictioncited by 3
- 2024Potential Field as Scene Affordance for Behavior Change-Based Visual Risk Object Identificationcited by 2
- 2025Towards Vision Zero: The TUM Traffic Accid3nD Datasetcited by 2
- 2025ATARS: An Aerial Traffic Atomic Activity Recognition and Temporal Segmentation Datasetcited by 2
- 2025What Demands Attention in Urban Street Scenes? From Scene Understanding towards Road Safety: A Survey of Vision-driven Datasets and Studiescited by 1
- 2024On-Road Object Importance Estimation: A New Dataset and A Model with Multi-Fold Top-Down Guidancecited by 0
- 2026RiskCueBench: Benchmarking Anticipatory Reasoning from Early Risk Cues in Video-Language Modelscited by 0
- 2026Uncertainty-Aware Vision-based Risk Object Identification via Conformal Risk Tube Predictioncited by 0
- 2026SceneMiner: Identity-Preserving Multi-Task Fine-Tuning for Unified BEV Scene Miningcited by 0
- 2026Action-Slot: Structured Action-Centric Representation Learning for Multi-Agent Atomic Activity Understandingcited by 0
- 2026Combining Hierarchical Cognitive Process with Process Supervision for Interpretable Scene Safety Understandingcited by 0
- 2026Combining Hierarchical Cognitive Process with Process Supervision for Interpretable Scene Safety Understanding22 Sep 2026
- 2026Action-Slot: Structured Action-Centric Representation Learning for Multi-Agent Atomic Activity Understanding21 Sep 2026
- 2026SceneMiner: Identity-Preserving Multi-Task Fine-Tuning for Unified BEV Scene Mining9 Jun 2026
- 2026Uncertainty-Aware Vision-based Risk Object Identification via Conformal Risk Tube Prediction25 Mar 2026
- 2026RiskCueBench: Benchmarking Anticipatory Reasoning from Early Risk Cues in Video-Language Models6 Jan 2026
- 2025Controllable Collision Scenario Generation via Collision Pattern Prediction14 Oct 2025
- 2025What Demands Attention in Urban Street Scenes? From Scene Understanding towards Road Safety: A Survey of Vision-driven Datasets and Studies9 Jul 2025
- 2025What Changed and What Could Have Changed? State-Change Counterfactuals for Procedure-Aware Video Representation Learning27 Mar 2025
- 2025ATARS: An Aerial Traffic Atomic Activity Recognition and Temporal Segmentation Dataset24 Mar 2025
- 2025Towards Vision Zero: The TUM Traffic Accid3nD Dataset15 Mar 2025
- 2024On-Road Object Importance Estimation: A New Dataset and A Model with Multi-Fold Top-Down Guidance26 Nov 2024
- 2024Potential Field as Scene Affordance for Behavior Change-Based Visual Risk Object Identification24 Sep 2024