A Safety-Critical Decision Making and Control Framework Combining Machine Learning and Rule-based Algorithms
Not on the map. Why?
Abstract (arXiv)
While artificial-intelligence-based methods suffer from lack of transparency, rule-based methods dominate in safety-critical systems. Yet, the latter cannot compete with the first ones in robustness to multiple requirements, for instance, simultaneously addressing safety, comfort, and efficiency. Hence, to benefit from both methods they must be joined in a single system. This paper proposes a decision making and control framework, which profits from advantages of both the rule- and machine-learning-based techniques while compensating for their disadvantages. The proposed method embodies two controllers operating in parallel, called Safety and Learned. A rule-based switching logic selects one of the actions transmitted from both controllers. The Safety controller is prioritized every time, when the Learned one does not meet the safety constraint, and also directly participates in the safe Learned controller training. Decision making and control in autonomous driving is chosen as the system case study, where an autonomous vehicle learns a multi-task policy to safely cross an unprotected intersection. Multiple requirements (i.e., safety, efficiency, and comfort) are set for vehicle operation. A numerical simulation is performed for the proposed framework validation, where its ability to satisfy the requirements and robustness to changing environment is successfully demonstrated.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Builds on 20 of its 48 references that are in the map. First posted on arXiv 30 Jan 2022.
Builds on
20 of 48 references.
References · 20
- 2017Proximal Policy Optimization Algorithmscited by 14,441
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
- 2020Deep Reinforcement Learning for Autonomous Driving: A Surveycited by 698
- 2016Safe, Multi-Agent, Reinforcement Learning for Autonomous Drivingcited by 301
- 2018Learning to Drive in a Daycited by 266
- 2020What Matters In On-Policy Reinforcement Learning? A Large-Scale Empirical Studycited by 157
- 2019Model-free Deep Reinforcement Learning for Urban Autonomous Drivingcited by 96
- 2019Safe, Efficient, and Comfortable Velocity Control based on Reinforcement Learning for Autonomous Drivingcited by 56
- 2019Combining Planning and Deep Reinforcement Learning in Tactical Decision Making for Autonomous Drivingcited by 52
- 2019Safe Reinforcement Learning on Autonomous Vehiclescited by 48
- 2020Safe Reinforcement Learning for Autonomous Vehicles through Parallel Constrained Policy Optimizationcited by 34
- 2020Human-Like Decision Making for Autonomous Driving: A Noncooperative Game Theoretic Approachcited by 30
8 more
- 2021Improved Deep Reinforcement Learning with Expert Demonstrations for Urban Autonomous Drivingcited by 26
- 2019Safe Reinforcement Learning with Scene Decomposition for Navigating Complex Urban Environmentscited by 18
- 2018Robust Deep Reinforcement Learning for Security and Safety in Autonomous Vehicle Systemscited by 17
- 2019Learning-based Model Predictive Control for Safe Exploration and Reinforcement Learningcited by 16
- 2019Autonomous Driving using Safe Reinforcement Learning by Incorporating a Regret-based Human Lane-Changing Decision Modelcited by 14
- 2016Combining Deep Reinforcement Learning and Safety Based Control for Autonomous Drivingcited by 9
- 2020Safe Reinforcement Learning with Mixture Density Network: A Case Study in Autonomous Highway Drivingcited by 2
- 2020An online evolving framework for advancing reinforcement-learning based automated vehicle controlcited by 1
Built on by
Citing papers per year: 2022: 1.
1 paper.