Safe Occlusion-aware Autonomous Driving via Game-Theoretic Active Perception
On the map: End-to-end autonomous driving → End-to-end system architecture
Abstract (arXiv)
Autonomous vehicles interacting with other traffic participants heavily rely on the perception and prediction of other agents' behaviors to plan safe trajectories. However, as occlusions limit the vehicle's perception ability, reasoning about potential hazards beyond the field of view is one of the most challenging issues in developing autonomous driving systems. This paper introduces a novel analytical approach that poses safe trajectory planning under occlusions as a hybrid zero-sum dynamic game between the autonomous vehicle (evader) and an initially hidden traffic participant (pursuer). Due to occlusions, the pursuer's state is initially unknown to the evader and may later be discovered by the vehicle's sensors. The analysis yields optimal strategies for both players as well as the set of initial conditions from which the autonomous vehicle is guaranteed to avoid collisions. We leverage this theoretical result to develop a novel trajectory planning framework for autonomous driving that provides worst-case safety guarantees while minimizing conservativeness by accounting for the vehicle's ability to actively avoid other road users as soon as they are detected in future observations. Our framework is agnostic to the driving environment and suitable for various motion planners. We demonstrate our algorithm on challenging urban and highway driving scenarios using the open-source CARLA simulator.
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Placed in End-to-end system architecture, one of 9 directions in End-to-end autonomous driving. Builds on 12 of its 49 references that are in the map. First posted on arXiv 17 May 2021.
Builds on
12 of 49 references.
References · 12
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
- 2019Control Barrier Functions: Theory and Applicationscited by 332
- 2016Control Barrier Function Based Quadratic Programs for Safety Critical Systemscited by 261
- 2016A Survey of Motion Planning and Control Techniques for Self-driving Urban Vehiclescited by 251
- 2019Human Motion Trajectory Prediction: A Surveycited by 231
- 2016Revisiting Active Perceptioncited by 90
- 2020Learning Control Barrier Functions from Expert Demonstrationscited by 88
- 2014Reach-Avoid Problems with Time-Varying Dynamics, Targets and Constraintscited by 41
- 2018Occlusion-Aware Risk Assessment for Autonomous Driving in Urban Environmentscited by 13
- 2018Tackling Occlusions & Limited Sensor Range with Set-based Safety Verificationcited by 11
- 2018Reach-Avoid Problems via Sum-of-Squares Optimization and Dynamic Programmingcited by 4
- 2019Risk Assessment and Planning with Bidirectional Reachability for Autonomous Drivingcited by 4
Built on by
Citing papers per year: 2021: 3; 2022: 2; 2023: 6; 2024: 5; 2025: 3; 2026: 3.
22 papers.
Sort:
By area:
- 2022V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformercited by 320
- 2023The Safety Filter: A Unified View of Safety-Critical Control in Autonomous Systemscited by 77
- 2023Spatio-Temporal Domain Awareness for Multi-Agent Collaborative Perceptioncited by 52
- 2024DSRC: Learning Density-insensitive and Semantic-aware Collaborative Representation against Corruptionscited by 13
- 2021SHARP: Shielding-Aware Robust Planning for Safe and Efficient Human-Robot Interactioncited by 12
- 2024Gameplay Filters: Robust Zero-Shot Safety through Adversarial Imaginationcited by 12
- 2023Learning Vision-based Pursuit-Evasion Robot Policiescited by 9
- 2023Deception Game: Closing the Safety-Learning Loop in Interactive Robot Autonomycited by 9
- 2025CoDynTrust: Robust Asynchronous Collaborative Perception via Dynamic Feature Trust Moduluscited by 6
- 2022Planning with Occluded Traffic Agents using Bi-Level Variational Occlusion Modelscited by 5
- 2021I Know You Can't See Me: Dynamic Occlusion-Aware Safety Validation of Strategic Planners for Autonomous Vehicles Using Hypergamescited by 3
- 2021An Intelligent Self-driving Truck System For Highway Transportationcited by 3
10 more
- 2024Overcoming Blind Spots: Occlusion Considerations for Improved Autonomous Driving Safetycited by 3
- 2023Data and Knowledge for Overtaking Scenarios in Autonomous Drivingcited by 2
- 2024Self-Localized Collaborative Perceptioncited by 2
- 2024Spatially Visual Perception for End-to-End Robotic Learningcited by 2
- 2025Schr"odinger's Navigator: Imagining an Ensemble of Futures for Zero-Shot Object Navigationcited by 1
- 2026Video Active Perception: Effective Inference-Time Long-Form Video Understanding with Vision-Language Modelscited by 1
- 2023RCP-RF: A Comprehensive Road-car-pedestrian Risk Management Framework based on Driving Risk Potential Fieldcited by 0
- 2025A Survey on Deep Multi-Task Learning in Connected Autonomous Vehiclescited by 0
- 2026Send Less, Perceive More: Masked Quantized Point Cloud Communication for Loss-Tolerant Collaborative Perceptioncited by 0
- 2026G-MARK: Grounded Multi-Agent Reasoning for Cooperative Driving via Knowledge Graphscited by 0
- 2026G-MARK: Grounded Multi-Agent Reasoning for Cooperative Driving via Knowledge Graphs20 Aug 2026
- 2026Video Active Perception: Effective Inference-Time Long-Form Video Understanding with Vision-Language Models3 May 2026
- 2026Send Less, Perceive More: Masked Quantized Point Cloud Communication for Loss-Tolerant Collaborative Perception25 Feb 2026
- 2025Schr"odinger's Navigator: Imagining an Ensemble of Futures for Zero-Shot Object Navigation24 Dec 2025
- 2025A Survey on Deep Multi-Task Learning in Connected Autonomous Vehicles29 Jul 2025
- 2025CoDynTrust: Robust Asynchronous Collaborative Perception via Dynamic Feature Trust Modulus12 Feb 2025
- 2024DSRC: Learning Density-insensitive and Semantic-aware Collaborative Representation against Corruptions14 Dec 2024
- 2024Spatially Visual Perception for End-to-End Robotic Learning26 Nov 2024
- 2024Self-Localized Collaborative Perception18 Jun 2024
- 2024Gameplay Filters: Robust Zero-Shot Safety through Adversarial Imagination1 May 2024
- 2024Overcoming Blind Spots: Occlusion Considerations for Improved Autonomous Driving Safety2 Feb 2024
- 2023The Safety Filter: A Unified View of Safety-Critical Control in Autonomous Systems11 Sep 2023
10 more
- 2023Deception Game: Closing the Safety-Learning Loop in Interactive Robot Autonomy3 Sep 2023
- 2023Learning Vision-based Pursuit-Evasion Robot Policies30 Aug 2023
- 2023Spatio-Temporal Domain Awareness for Multi-Agent Collaborative Perception26 Jul 2023
- 2023Data and Knowledge for Overtaking Scenarios in Autonomous Driving30 May 2023
- 2023RCP-RF: A Comprehensive Road-car-pedestrian Risk Management Framework based on Driving Risk Potential Field4 May 2023
- 2022Planning with Occluded Traffic Agents using Bi-Level Variational Occlusion Models26 Oct 2022
- 2022V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformer20 Mar 2022
- 2021An Intelligent Self-driving Truck System For Highway Transportation31 Dec 2021
- 2021SHARP: Shielding-Aware Robust Planning for Safe and Efficient Human-Robot Interaction2 Oct 2021
- 2021I Know You Can't See Me: Dynamic Occlusion-Aware Safety Validation of Strategic Planners for Autonomous Vehicles Using Hypergames20 Sep 2021
- 2021I Know You Can't See Me: Dynamic Occlusion-Aware Safety Validation of Strategic Planners for Autonomous Vehicles Using Hypergamescited by 3
- 2021An Intelligent Self-driving Truck System For Highway Transportationcited by 3
- 2024Overcoming Blind Spots: Occlusion Considerations for Improved Autonomous Driving Safetycited by 3
- 2024Overcoming Blind Spots: Occlusion Considerations for Improved Autonomous Driving Safety2 Feb 2024
- 2021An Intelligent Self-driving Truck System For Highway Transportation31 Dec 2021
- 2021I Know You Can't See Me: Dynamic Occlusion-Aware Safety Validation of Strategic Planners for Autonomous Vehicles Using Hypergames20 Sep 2021
- 2024Spatially Visual Perception for End-to-End Robotic Learning26 Nov 2024
- 2022V2X-ViT: Vehicle-to-Everything Cooperative Perception with Vision Transformercited by 320
- 2023The Safety Filter: A Unified View of Safety-Critical Control in Autonomous Systemscited by 77
- 2023Spatio-Temporal Domain Awareness for Multi-Agent Collaborative Perceptioncited by 52
- 2024DSRC: Learning Density-insensitive and Semantic-aware Collaborative Representation against Corruptionscited by 13
- 2021SHARP: Shielding-Aware Robust Planning for Safe and Efficient Human-Robot Interactioncited by 12
- 2024Gameplay Filters: Robust Zero-Shot Safety through Adversarial Imaginationcited by 12
- 2023Learning Vision-based Pursuit-Evasion Robot Policiescited by 9
- 2023Deception Game: Closing the Safety-Learning Loop in Interactive Robot Autonomycited by 9
- 2025CoDynTrust: Robust Asynchronous Collaborative Perception via Dynamic Feature Trust Moduluscited by 6
- 2022Planning with Occluded Traffic Agents using Bi-Level Variational Occlusion Modelscited by 5
- 2023Data and Knowledge for Overtaking Scenarios in Autonomous Drivingcited by 2
- 2024Self-Localized Collaborative Perceptioncited by 2
12 most cited of 17 All 17 (JSON)
- 2026G-MARK: Grounded Multi-Agent Reasoning for Cooperative Driving via Knowledge Graphs20 Aug 2026
- 2026Send Less, Perceive More: Masked Quantized Point Cloud Communication for Loss-Tolerant Collaborative Perception25 Feb 2026
- 2025Schr"odinger's Navigator: Imagining an Ensemble of Futures for Zero-Shot Object Navigation24 Dec 2025
- 2025A Survey on Deep Multi-Task Learning in Connected Autonomous Vehicles29 Jul 2025
- 2025CoDynTrust: Robust Asynchronous Collaborative Perception via Dynamic Feature Trust Modulus12 Feb 2025
- 2024DSRC: Learning Density-insensitive and Semantic-aware Collaborative Representation against Corruptions14 Dec 2024
- 2024Self-Localized Collaborative Perception18 Jun 2024
- 2024Gameplay Filters: Robust Zero-Shot Safety through Adversarial Imagination1 May 2024
- 2023The Safety Filter: A Unified View of Safety-Critical Control in Autonomous Systems11 Sep 2023
- 2023Deception Game: Closing the Safety-Learning Loop in Interactive Robot Autonomy3 Sep 2023
- 2023Learning Vision-based Pursuit-Evasion Robot Policies30 Aug 2023
- 2023Spatio-Temporal Domain Awareness for Multi-Agent Collaborative Perception26 Jul 2023
12 newest of 17 All 17 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2026Hope for the Best, Prepare for the Worst: Occlusion-Aware Contingency Planning for Autonomous Vehicles
- 2026Risk-Aware Occupancy for Safety-Oriented End-to-End Autonomous Driving
- 2026Not All Agents Matter: From Global Attention Dilution to Risk-Prioritized Game Planning
- 2022Game-Theoretic Planning for Autonomous Driving among Risk-Aware Human Drivers
- 2021Motion Planning for Autonomous Vehicles in the Presence of Uncertainty Using Reinforcement Learning
- 2022Distribution-aware Goal Prediction and Conformant Model-based Planning for Safe Autonomous Driving
- 2022Safer Autonomous Driving in a Stochastic, Partially-Observable Environment by Hierarchical Contingency Planning
- 2026BeyondSight: Object Permanence for End-to-End Autonomous Driving