Reinforcement Learning with Probabilistic Guarantees for Autonomous Driving
Not on the map. Why?
Abstract (arXiv)
Designing reliable decision strategies for autonomous urban driving is challenging. Reinforcement learning (RL) has been used to automatically derive suitable behavior in uncertain environments, but it does not provide any guarantee on the performance of the resulting policy. We propose a generic approach to enforce probabilistic guarantees on an RL agent. An exploration strategy is derived prior to training that constrains the agent to choose among actions that satisfy a desired probabilistic specification expressed with linear temporal logic (LTL). Reducing the search space to policies satisfying the LTL formula helps training and simplifies reward design. This paper outlines a case study of an intersection scenario involving multiple traffic participants. The resulting policy outperforms a rule-based heuristic approach in terms of efficiency while exhibiting strong guarantees on safety.
Key facts. Cited by 28 papers in the map (data through 14 Oct 2026). First posted on arXiv 15 Apr 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 11; 2022: 5; 2023: 2; 2024: 7; 2025: 3.
28 papers.
Sort:
By area:
- 2021Explainable Artificial Intelligence for Autonomous Driving: A Comprehensive Overview and Field Guide for Future Research Directionscited by 73
- 2021A Survey of Deep RL and IL for Autonomous Driving Policy Learningcited by 61
- 2022Safe Reinforcement Learning via Shielding under Partial Observabilitycited by 56
- 2021Neural Network Repair with Reachability Analysiscited by 19
- 2021Addressing Inherent Uncertainty: Risk-Sensitive Behavior Generation for Automated Driving using Distributional Reinforcement Learningcited by 13
- 2022Dynamic Shielding for Reinforcement Learning in Black-Box Environmentscited by 11
- 2024Reward Machines for Deep RL in Noisy and Uncertain Environmentscited by 11
- 2021A Survey of Deep Reinforcement Learning Algorithms for Motion Planning and Control of Autonomous Vehiclescited by 10
- 2022Accelerated Reinforcement Learning for Temporal Logic Control Objectivescited by 9
- 2022Multi-task Safe Reinforcement Learning for Navigating Intersections in Dense Trafficcited by 8
- 2021Learning Interaction-aware Guidance Policies for Motion Planning in Dense Traffic Scenarioscited by 7
- 2024Autonomous Driving at Unsignalized Intersections: A Review of Decision-Making Challenges and Reinforcement Learning-Based Solutionscited by 7
16 more
- 2021Model-Free Learning of Safe yet Effective Controllerscited by 5
- 2022Targeted Adversarial Attacks on Deep Reinforcement Learning Policies via Model Checkingcited by 5
- 2023Probabilistic Reach-Avoid for Bayesian Neural Networkscited by 5
- 2024Sample-Efficient Reinforcement Learning with Temporal Logic Objectives: Leveraging the Task Specification to Guide Explorationcited by 5
- 2021Cooperation for Scalable Supervision of Autonomy in Mixed Trafficcited by 4
- 2024Long and Short-Term Constraints Driven Safe Reinforcement Learning for Autonomous Drivingcited by 4
- 2021Learning Optimal Strategies for Temporal Tasks in Stochastic Gamescited by 3
- 2025Turn-based Multi-Agent Reinforcement Learning Model Checkingcited by 3
- 2021On Assessing The Safety of Reinforcement Learning algorithms Using Formal Methodscited by 2
- 2024Learning to Model Diverse Driving Behaviors in Highly Interactive Autonomous Driving Scenarios with Multi-Agent Reinforcement Learningcited by 2
- 2025Compositional shield synthesis for safe reinforcement learning in partial observabilitycited by 2
- 2021Risk-Constrained Interactive Safety under Behavior Uncertainty for Autonomous Drivingcited by 1
- 2024Multi-agent transformer-accelerated RL for satisfaction of STL specificationscited by 1
- 2023Verified Compositional Neuro-Symbolic Control for Stochastic Systems with Temporal Logic Taskscited by 0
- 2024Enhancing Safety for Autonomous Agents in Partly Concealed Urban Traffic Environments Through Representation-Based Shieldingcited by 0
- 2025Shielded Controller Units for RL with Operational Constraints Applied to Remote Microgridscited by 0
- 2025Shielded Controller Units for RL with Operational Constraints Applied to Remote Microgrids30 Nov 2025
- 2025Compositional shield synthesis for safe reinforcement learning in partial observability15 Sep 2025
- 2025Turn-based Multi-Agent Reinforcement Learning Model Checking6 Jan 2025
- 2024Sample-Efficient Reinforcement Learning with Temporal Logic Objectives: Leveraging the Task Specification to Guide Exploration16 Oct 2024
- 2024Autonomous Driving at Unsignalized Intersections: A Review of Decision-Making Challenges and Reinforcement Learning-Based Solutions20 Sep 2024
- 2024Enhancing Safety for Autonomous Agents in Partly Concealed Urban Traffic Environments Through Representation-Based Shielding5 Jul 2024
- 2024Reward Machines for Deep RL in Noisy and Uncertain Environments31 May 2024
- 2024Long and Short-Term Constraints Driven Safe Reinforcement Learning for Autonomous Driving27 Mar 2024
- 2024Multi-agent transformer-accelerated RL for satisfaction of STL specifications23 Mar 2024
- 2024Learning to Model Diverse Driving Behaviors in Highly Interactive Autonomous Driving Scenarios with Multi-Agent Reinforcement Learning21 Feb 2024
- 2023Verified Compositional Neuro-Symbolic Control for Stochastic Systems with Temporal Logic Tasks17 Nov 2023
- 2023Probabilistic Reach-Avoid for Bayesian Neural Networks3 Oct 2023
16 more
- 2022Targeted Adversarial Attacks on Deep Reinforcement Learning Policies via Model Checking10 Dec 2022
- 2022Dynamic Shielding for Reinforcement Learning in Black-Box Environments27 Jul 2022
- 2022Accelerated Reinforcement Learning for Temporal Logic Control Objectives9 May 2022
- 2022Safe Reinforcement Learning via Shielding under Partial Observability2 Apr 2022
- 2022Multi-task Safe Reinforcement Learning for Navigating Intersections in Dense Traffic19 Feb 2022
- 2021Explainable Artificial Intelligence for Autonomous Driving: A Comprehensive Overview and Field Guide for Future Research Directions21 Dec 2021
- 2021Cooperation for Scalable Supervision of Autonomy in Mixed Traffic14 Dec 2021
- 2021On Assessing The Safety of Reinforcement Learning algorithms Using Formal Methods8 Nov 2021
- 2021Neural Network Repair with Reachability Analysis9 Aug 2021
- 2021Learning Interaction-aware Guidance Policies for Motion Planning in Dense Traffic Scenarios9 Jul 2021
- 2021A Survey of Deep Reinforcement Learning Algorithms for Motion Planning and Control of Autonomous Vehicles29 May 2021
- 2021Model-Free Learning of Safe yet Effective Controllers26 Mar 2021
- 2021Learning Optimal Strategies for Temporal Tasks in Stochastic Games8 Feb 2021
- 2021Addressing Inherent Uncertainty: Risk-Sensitive Behavior Generation for Automated Driving using Distributional Reinforcement Learning5 Feb 2021
- 2021Risk-Constrained Interactive Safety under Behavior Uncertainty for Autonomous Driving5 Feb 2021
- 2021A Survey of Deep RL and IL for Autonomous Driving Policy Learning6 Jan 2021
- 2021Explainable Artificial Intelligence for Autonomous Driving: A Comprehensive Overview and Field Guide for Future Research Directionscited by 73
- 2021A Survey of Deep RL and IL for Autonomous Driving Policy Learningcited by 61
- 2021Addressing Inherent Uncertainty: Risk-Sensitive Behavior Generation for Automated Driving using Distributional Reinforcement Learningcited by 13
- 2021A Survey of Deep Reinforcement Learning Algorithms for Motion Planning and Control of Autonomous Vehiclescited by 10
- 2024Autonomous Driving at Unsignalized Intersections: A Review of Decision-Making Challenges and Reinforcement Learning-Based Solutionscited by 7
- 2024Long and Short-Term Constraints Driven Safe Reinforcement Learning for Autonomous Drivingcited by 4
- 2024Learning to Model Diverse Driving Behaviors in Highly Interactive Autonomous Driving Scenarios with Multi-Agent Reinforcement Learningcited by 2
- 2021Risk-Constrained Interactive Safety under Behavior Uncertainty for Autonomous Drivingcited by 1
- 2024Autonomous Driving at Unsignalized Intersections: A Review of Decision-Making Challenges and Reinforcement Learning-Based Solutions20 Sep 2024
- 2024Long and Short-Term Constraints Driven Safe Reinforcement Learning for Autonomous Driving27 Mar 2024
- 2024Learning to Model Diverse Driving Behaviors in Highly Interactive Autonomous Driving Scenarios with Multi-Agent Reinforcement Learning21 Feb 2024
- 2021Explainable Artificial Intelligence for Autonomous Driving: A Comprehensive Overview and Field Guide for Future Research Directions21 Dec 2021
- 2021A Survey of Deep Reinforcement Learning Algorithms for Motion Planning and Control of Autonomous Vehicles29 May 2021
- 2021Addressing Inherent Uncertainty: Risk-Sensitive Behavior Generation for Automated Driving using Distributional Reinforcement Learning5 Feb 2021
- 2021Risk-Constrained Interactive Safety under Behavior Uncertainty for Autonomous Driving5 Feb 2021
- 2021A Survey of Deep RL and IL for Autonomous Driving Policy Learning6 Jan 2021
- 2024Reward Machines for Deep RL in Noisy and Uncertain Environmentscited by 11
- 2024Sample-Efficient Reinforcement Learning with Temporal Logic Objectives: Leveraging the Task Specification to Guide Explorationcited by 5
- 2025Compositional shield synthesis for safe reinforcement learning in partial observabilitycited by 2
- 2025Shielded Controller Units for RL with Operational Constraints Applied to Remote Microgridscited by 0
- 2025Shielded Controller Units for RL with Operational Constraints Applied to Remote Microgrids30 Nov 2025
- 2025Compositional shield synthesis for safe reinforcement learning in partial observability15 Sep 2025
- 2024Sample-Efficient Reinforcement Learning with Temporal Logic Objectives: Leveraging the Task Specification to Guide Exploration16 Oct 2024
- 2024Reward Machines for Deep RL in Noisy and Uncertain Environments31 May 2024
- 2022Safe Reinforcement Learning via Shielding under Partial Observabilitycited by 56
- 2021Neural Network Repair with Reachability Analysiscited by 19
- 2022Dynamic Shielding for Reinforcement Learning in Black-Box Environmentscited by 11
- 2022Accelerated Reinforcement Learning for Temporal Logic Control Objectivescited by 9
- 2022Multi-task Safe Reinforcement Learning for Navigating Intersections in Dense Trafficcited by 8
- 2021Learning Interaction-aware Guidance Policies for Motion Planning in Dense Traffic Scenarioscited by 7
- 2021Model-Free Learning of Safe yet Effective Controllerscited by 5
- 2022Targeted Adversarial Attacks on Deep Reinforcement Learning Policies via Model Checkingcited by 5
- 2023Probabilistic Reach-Avoid for Bayesian Neural Networkscited by 5
- 2021Cooperation for Scalable Supervision of Autonomy in Mixed Trafficcited by 4
- 2021Learning Optimal Strategies for Temporal Tasks in Stochastic Gamescited by 3
- 2025Turn-based Multi-Agent Reinforcement Learning Model Checkingcited by 3
12 most cited of 16 All 16 (JSON)
- 2025Turn-based Multi-Agent Reinforcement Learning Model Checking6 Jan 2025
- 2024Enhancing Safety for Autonomous Agents in Partly Concealed Urban Traffic Environments Through Representation-Based Shielding5 Jul 2024
- 2024Multi-agent transformer-accelerated RL for satisfaction of STL specifications23 Mar 2024
- 2023Verified Compositional Neuro-Symbolic Control for Stochastic Systems with Temporal Logic Tasks17 Nov 2023
- 2023Probabilistic Reach-Avoid for Bayesian Neural Networks3 Oct 2023
- 2022Targeted Adversarial Attacks on Deep Reinforcement Learning Policies via Model Checking10 Dec 2022
- 2022Dynamic Shielding for Reinforcement Learning in Black-Box Environments27 Jul 2022
- 2022Accelerated Reinforcement Learning for Temporal Logic Control Objectives9 May 2022
- 2022Safe Reinforcement Learning via Shielding under Partial Observability2 Apr 2022
- 2022Multi-task Safe Reinforcement Learning for Navigating Intersections in Dense Traffic19 Feb 2022
- 2021Cooperation for Scalable Supervision of Autonomy in Mixed Traffic14 Dec 2021
- 2021On Assessing The Safety of Reinforcement Learning algorithms Using Formal Methods8 Nov 2021
12 newest of 16 All 16 (JSON)