Temporal Logic Guided Safe Reinforcement Learning Using Control Barrier Functions
Not on the map. Why?
Abstract (arXiv)
Using reinforcement learning to learn control policies is a challenge when the task is complex with potentially long horizons. Ensuring adequate but safe exploration is also crucial for controlling physical systems. In this paper, we use temporal logic to facilitate specification and learning of complex tasks. We combine temporal logic with control Lyapunov functions to improve exploration. We incorporate control barrier functions to safeguard the exploration and deployment process. We develop a flexible and learnable system that allows users to specify task objectives and constraints in different forms and at various levels. The framework is also able to take advantage of known system dynamics and handle unknown environmental dynamics by integrating model-free learning with model-based planning.
Key facts. Cited by 21 papers in the map (data through 14 Oct 2026). First posted on arXiv 23 Mar 2019.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 2; 2023: 6; 2024: 4; 2025: 1; 2026: 3.
21 papers.
Sort:
By area:
- 2022Constrained Update Projection Approach to Safe Policy Optimizationcited by 58
- 2022Trustworthy Reinforcement Learning Against Intrinsic Vulnerabilities: Robustness, Safety, and Generalizabilitycited by 36
- 2023A Survey on Physics Informed Reinforcement Learning: Review and Open Problemscited by 24
- 2024Balance Reward and Safety Optimization for Safe Reinforcement Learning: A Perspective of Gradient Manipulationcited by 21
- 2023A Human-Centered Safe Robot Reinforcement Learning Framework with Interactive Behaviorscited by 15
- 2024Safe and Balanced: A Framework for Constrained Multi-Objective Reinforcement Learningcited by 9
- 2021Reactive and Safe Road User Simulations using Neural Barrier Certificatescited by 7
- 2021Provably Correct Training of Neural Network Controllers Using Reachability Analysiscited by 5
- 2021Model-Free Learning of Safe yet Effective Controllerscited by 5
- 2025A Review On Safe Reinforcement Learning Using Lyapunov and Barrier Functionscited by 4
- 2021Reinforcement Learning with Formal Performance Metrics for Quadcopter Attitude Control under Non-nominal Contextscited by 3
- 2023Certifiably Robust Reinforcement Learning through Model-Based Abstract Interpretationcited by 3
9 more
- 2023ConBaT: Control Barrier Transformer for Safe Policy Learningcited by 3
- 2023Learning Adaptive Safety for Multi-Agent Systemscited by 3
- 2024On the Uniqueness of Solution for the Bellman Equation of LTL Objectivescited by 3
- 2023Safeguarded Progress in Reinforcement Learning: Safe Bayesian Exploration for Control Policy Synthesiscited by 1
- 2026Shielded Reinforcement Learning Under Dynamic Temporal Logic Constraintscited by 1
- 2021Failing with Grace: Learning Neural Network Controllers that are Boundedly Unsafecited by 0
- 2024Progressive Safeguards for Safe and Model-Agnostic Reinforcement Learningcited by 0
- 2026Integrating LTL Constraints into PPO for Safe Reinforcement Learningcited by 0
- 2026Kernel-Based Safe Exploration in Deep Reinforcement Learningcited by 0
- 2026Kernel-Based Safe Exploration in Deep Reinforcement Learning21 May 2026
- 2026Shielded Reinforcement Learning Under Dynamic Temporal Logic Constraints17 Mar 2026
- 2026Integrating LTL Constraints into PPO for Safe Reinforcement Learning1 Mar 2026
- 2025A Review On Safe Reinforcement Learning Using Lyapunov and Barrier Functions12 Aug 2025
- 2024Progressive Safeguards for Safe and Model-Agnostic Reinforcement Learning31 Oct 2024
- 2024Safe and Balanced: A Framework for Constrained Multi-Objective Reinforcement Learning26 May 2024
- 2024Balance Reward and Safety Optimization for Safe Reinforcement Learning: A Perspective of Gradient Manipulation2 May 2024
- 2024On the Uniqueness of Solution for the Bellman Equation of LTL Objectives7 Apr 2024
- 2023Safeguarded Progress in Reinforcement Learning: Safe Bayesian Exploration for Control Policy Synthesis18 Dec 2023
- 2023Learning Adaptive Safety for Multi-Agent Systems19 Sep 2023
- 2023A Survey on Physics Informed Reinforcement Learning: Review and Open Problems5 Sep 2023
- 2023ConBaT: Control Barrier Transformer for Safe Policy Learning7 Mar 2023
9 more
- 2023A Human-Centered Safe Robot Reinforcement Learning Framework with Interactive Behaviors25 Feb 2023
- 2023Certifiably Robust Reinforcement Learning through Model-Based Abstract Interpretation26 Jan 2023
- 2022Trustworthy Reinforcement Learning Against Intrinsic Vulnerabilities: Robustness, Safety, and Generalizability16 Sep 2022
- 2022Constrained Update Projection Approach to Safe Policy Optimization15 Sep 2022
- 2021Reactive and Safe Road User Simulations using Neural Barrier Certificates14 Sep 2021
- 2021Reinforcement Learning with Formal Performance Metrics for Quadcopter Attitude Control under Non-nominal Contexts27 Jul 2021
- 2021Failing with Grace: Learning Neural Network Controllers that are Boundedly Unsafe22 Jun 2021
- 2021Model-Free Learning of Safe yet Effective Controllers26 Mar 2021
- 2021Provably Correct Training of Neural Network Controllers Using Reachability Analysis22 Feb 2021
- 2024Balance Reward and Safety Optimization for Safe Reinforcement Learning: A Perspective of Gradient Manipulationcited by 21
- 2024Safe and Balanced: A Framework for Constrained Multi-Objective Reinforcement Learningcited by 9
- 2025A Review On Safe Reinforcement Learning Using Lyapunov and Barrier Functionscited by 4
- 2026Shielded Reinforcement Learning Under Dynamic Temporal Logic Constraintscited by 1
- 2024Progressive Safeguards for Safe and Model-Agnostic Reinforcement Learningcited by 0
- 2026Integrating LTL Constraints into PPO for Safe Reinforcement Learningcited by 0
- 2026Kernel-Based Safe Exploration in Deep Reinforcement Learningcited by 0
- 2026Kernel-Based Safe Exploration in Deep Reinforcement Learning21 May 2026
- 2026Shielded Reinforcement Learning Under Dynamic Temporal Logic Constraints17 Mar 2026
- 2026Integrating LTL Constraints into PPO for Safe Reinforcement Learning1 Mar 2026
- 2025A Review On Safe Reinforcement Learning Using Lyapunov and Barrier Functions12 Aug 2025
- 2024Progressive Safeguards for Safe and Model-Agnostic Reinforcement Learning31 Oct 2024
- 2024Safe and Balanced: A Framework for Constrained Multi-Objective Reinforcement Learning26 May 2024
- 2024Balance Reward and Safety Optimization for Safe Reinforcement Learning: A Perspective of Gradient Manipulation2 May 2024
- 2022Constrained Update Projection Approach to Safe Policy Optimizationcited by 58
- 2022Trustworthy Reinforcement Learning Against Intrinsic Vulnerabilities: Robustness, Safety, and Generalizabilitycited by 36
- 2023A Survey on Physics Informed Reinforcement Learning: Review and Open Problemscited by 24
- 2023A Human-Centered Safe Robot Reinforcement Learning Framework with Interactive Behaviorscited by 15
- 2021Reactive and Safe Road User Simulations using Neural Barrier Certificatescited by 7
- 2021Provably Correct Training of Neural Network Controllers Using Reachability Analysiscited by 5
- 2021Model-Free Learning of Safe yet Effective Controllerscited by 5
- 2021Reinforcement Learning with Formal Performance Metrics for Quadcopter Attitude Control under Non-nominal Contextscited by 3
- 2023Certifiably Robust Reinforcement Learning through Model-Based Abstract Interpretationcited by 3
- 2023ConBaT: Control Barrier Transformer for Safe Policy Learningcited by 3
- 2023Learning Adaptive Safety for Multi-Agent Systemscited by 3
- 2024On the Uniqueness of Solution for the Bellman Equation of LTL Objectivescited by 3
12 most cited of 14 All 14 (JSON)
- 2024On the Uniqueness of Solution for the Bellman Equation of LTL Objectives7 Apr 2024
- 2023Safeguarded Progress in Reinforcement Learning: Safe Bayesian Exploration for Control Policy Synthesis18 Dec 2023
- 2023Learning Adaptive Safety for Multi-Agent Systems19 Sep 2023
- 2023A Survey on Physics Informed Reinforcement Learning: Review and Open Problems5 Sep 2023
- 2023ConBaT: Control Barrier Transformer for Safe Policy Learning7 Mar 2023
- 2023A Human-Centered Safe Robot Reinforcement Learning Framework with Interactive Behaviors25 Feb 2023
- 2023Certifiably Robust Reinforcement Learning through Model-Based Abstract Interpretation26 Jan 2023
- 2022Trustworthy Reinforcement Learning Against Intrinsic Vulnerabilities: Robustness, Safety, and Generalizability16 Sep 2022
- 2022Constrained Update Projection Approach to Safe Policy Optimization15 Sep 2022
- 2021Reactive and Safe Road User Simulations using Neural Barrier Certificates14 Sep 2021
- 2021Reinforcement Learning with Formal Performance Metrics for Quadcopter Attitude Control under Non-nominal Contexts27 Jul 2021
- 2021Failing with Grace: Learning Neural Network Controllers that are Boundedly Unsafe22 Jun 2021
12 newest of 14 All 14 (JSON)