Generalizing Decision Making for Automated Driving with an Invariant Environment Representation using Deep Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
Data driven approaches for decision making applied to automated driving require appropriate generalization strategies, to ensure applicability to the world's variability. Current approaches either do not generalize well beyond the training data or are not capable to consider a variable number of traffic participants. Therefore we propose an invariant environment representation from the perspective of the ego vehicle. The representation encodes all necessary information for safe decision making. To assess the generalization capabilities of the novel environment representation, we train our agents on a small subset of scenarios and evaluate on the entire diverse set of scenarios. Here we show that the agents are capable to generalize successfully to unseen scenarios, due to the abstraction. In addition we present a simple occlusion model that enables our agents to navigate intersections with occlusions without a significant change in performance.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 14 of its 24 references that are in the map. First posted on arXiv 12 Feb 2021.
Builds on
14 of 24 references.
References · 14
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,635
- 2013Playing Atari with Deep Reinforcement Learningcited by 3,211
- 2015Deep Reinforcement Learning with Double Q-learningcited by 1,704
- 2019Mastering Atari, Go, Chess and Shogi by Planning with a Learned Modelcited by 1,327
- 2015Prioritized Experience Replaycited by 1,070
- 2017Rainbow: Combining Improvements in Deep Reinforcement Learningcited by 774
- 2017Navigating Occluded Intersections with Autonomous Vehicles using Deep Reinforcement Learningcited by 21
- 2020Risk-Aware High-level Decisions for Automated Driving at Occluded Intersections with Reinforcement Learningcited by 19
- 2019Safe Reinforcement Learning with Scene Decomposition for Navigating Complex Urban Environmentscited by 18
- 2018Learning Negotiating Behavior Between Cars in Intersections using Deep Q-Learningcited by 13
- 2017Belief State Planning for Autonomously Navigating Urban Intersectionscited by 11
- 2018Adaptive Behavior Generation for Autonomous Driving using Deep Reinforcement Learning with Compact Semantic Statescited by 8
Built on by
Citing papers per year: 2022: 1; 2023: 0; 2024: 1; 2025: 0; 2026: 1.
3 papers.
- 2022Learning Reward Models for Cooperative Trajectory Planning with Inverse Reinforcement Learning and Monte Carlo Tree Searchcited by 3
- 2024Enhancing Safety for Autonomous Agents in Partly Concealed Urban Traffic Environments Through Representation-Based Shieldingcited by 0
- 2026Realistic adversarial scenario generation via human-like pedestrian model for autonomous vehicle control parameter optimisationcited by 0
- 2026Realistic adversarial scenario generation via human-like pedestrian model for autonomous vehicle control parameter optimisation5 Jan 2026
- 2024Enhancing Safety for Autonomous Agents in Partly Concealed Urban Traffic Environments Through Representation-Based Shielding5 Jul 2024
- 2022Learning Reward Models for Cooperative Trajectory Planning with Inverse Reinforcement Learning and Monte Carlo Tree Search14 Feb 2022