Learning Control Barrier Functions from Expert Demonstrations
On the map: Offline RL and imitation learning from data → Safe offline RL
Abstract (arXiv)
Inspired by the success of imitation and inverse reinforcement learning in replicating expert behavior through optimal control, we propose a learning based approach to safe controller synthesis based on control barrier functions (CBFs). We consider the setting of a known nonlinear control affine dynamical system and assume that we have access to safe trajectories generated by an expert - a practical example of such a setting would be a kinematic model of a self-driving vehicle with safe trajectories (e.g., trajectories that avoid collisions with obstacles in the environment) generated by a human driver. We then propose and analyze an optimization-based approach to learning a CBF that enjoys provable safety guarantees under suitable Lipschitz smoothness assumptions on the underlying dynamical system. A strength of our approach is that it is agnostic to the parameterization used to represent the CBF, assuming only that the Lipschitz constant of such functions can be efficiently bounded. Furthermore, if the CBF parameterization is convex, then under mild assumptions, so is our learning process. We end with extensive numerical evaluations of our results on both planar and realistic examples, using both random feature and deep neural network parameterizations of the CBF. To the best of our knowledge, these are the first results that learn provably safe control barrier functions from data.
Key facts. Cited by 88 papers in the map (data through 7 Oct 2026). Placed in Safe offline RL, one of 13 directions in Offline RL and imitation learning from data. First posted on arXiv 7 Apr 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 16; 2022: 13; 2023: 10; 2024: 14; 2025: 19; 2026: 16.
88 papers.
Sort:
By area:
- 2023The Safety Filter: A Unified View of Safety-Critical Control in Autonomous Systemscited by 77
- 2021Learning Safe Multi-Agent Control with Decentralized Neural Barrier Certificatescited by 71
- 2023SafeDiffuser: Safe Planning with Diffusion Probabilistic Modelscited by 69
- 2024Safe Offline Reinforcement Learning with Feasibility-Guided Diffusion Modelcited by 62
- 2025Generalizing Safety Beyond Collision-Avoidance via Latent-Space Reachability Analysiscited by 44
- 2025Safety Guardrails for LLM-Enabled Robotscited by 30
- 2025Uncertainty-aware Latent Safety Filters for Avoiding Out-of-Distribution Failurescited by 30
- 2022Lyapunov Density Models: Constraining Distribution Shift in Learning-Based Controlcited by 28
- 2023Physics-Informed Machine Learning for Modeling and Control of Dynamical Systemscited by 28
- 2022Safe Control Under Input Limits with Neural Control Barrier Functionscited by 27
- 2021Safe Pontryagin Differentiable Programmingcited by 25
- 2021Safe Occlusion-aware Autonomous Driving via Game-Theoretic Active Perceptioncited by 22
38 more
- 2022Safety Certification for Stochastic Systems via Neural Barrier Functionscited by 22
- 2025Steering Dialogue Dynamics for Robustness against Multi-turn Jailbreaking Attackscited by 20
- 2021Learning Robust Output Control Barrier Functions from Safe Expert Demonstrationscited by 19
- 2021Lyapunov-Net: A Deep Neural Network Architecture for Lyapunov Function Approximationcited by 16
- 2023In-Distribution Barrier Functions: Self-Supervised Policy Filters that Avoid Out-of-Distribution Statescited by 15
- 2021Learning Robust Hybrid Control Barrier Functions for Uncertain Systemscited by 14
- 2023Active Uncertainty Reduction for Safe and Efficient Interaction Planning: A Shielding-Aware Dual Control Approachcited by 13
- 2021SHARP: Shielding-Aware Robust Planning for Safe and Efficient Human-Robot Interactioncited by 12
- 2024Safe Reinforcement Learning on the Constraint Manifold: Theory and Applicationscited by 12
- 2024Gameplay Filters: Robust Zero-Shot Safety through Adversarial Imaginationcited by 12
- 2021BarrierNet: A Safety-Guaranteed Layer for Neural Networkscited by 11
- 2022Joint Differentiable Optimization and Verification for Certified Reinforcement Learningcited by 11
- 2025SafeFlowMatcher: Safe and Fast Planning using Flow Matching with Control Barrier Functionscited by 11
- 2022Differentiable Control Barrier Functions for Vision-based End-to-End Autonomous Drivingcited by 10
- 2022Temporal Logic Imitation: Learning Plan-Satisficing Motion Policies from Demonstrationscited by 10
- 2023Online Control Barrier Functions for Decentralized Multi-Agent Navigationcited by 10
- 2022Learning Differentiable Safety-Critical Control using Control Barrier Functions for Generalization to Novel Environmentscited by 8
- 2023Sequential Neural Barriers for Scalable Dynamic Obstacle Avoidancecited by 8
- 2021Safe Value Functionscited by 7
- 2024Verification-Aided Learning of Neural Network Barrier Functions with Termination Guaranteescited by 7
- 2026Safe Large-Scale Robust Nonlinear MPC in Milliseconds via Reachability-Constrained System Level Synthesis on the GPUcited by 7
- 2025Two-Stage Learning of Stabilizing Neural Controllers via Zubov Sampling and Iterative Domain Expansioncited by 6
- 2021Provably Correct Training of Neural Network Controllers Using Reachability Analysiscited by 5
- 2024MAGICS: Adversarial RL with Minimax Actors Guided by Implicit Critic Stackelberg for Convergent Neural Synthesis of Robot Safetycited by 5
- 2025V-OCBF: Learning Safety Filters from Offline Data via Value-Guided Offline Control Barrier Functionscited by 5
- 2024Learning Performance-Oriented Control Barrier Functions Under Complex Safety Constraints and Limited Actuationcited by 4
- 2024Reinforcement Learning with Ensemble Model Predictive Safety Certificationcited by 4
- 2025CP-NCBF: A Conformal Prediction-based Approach to Synthesize Verified Neural Control Barrier Functionscited by 4
- 2025Learning Conservative Neural Control Barrier Functions from Offline Datacited by 4
- 2021Model Free Barrier Functions via Implicit Evading Maneuverscited by 3
- 2021Learning Contraction Policies from Offline Datacited by 3
- 2022Bridging Model-based Safety and Model-free Reinforcement Learning through System Identification of Low Dimensional Linear Modelscited by 3
- 2022Safe Inverse Reinforcement Learning via Control Barrier Functioncited by 3
- 2023Multi-Step Model Predictive Safety Filters: Reducing Chattering by Increasing the Prediction Horizoncited by 3
- 2024Learning safety critics via a non-contractive binary bellman operatorcited by 3
- 2024Learning Control Barrier Functions and their application in Reinforcement Learning: A Surveycited by 3
- 2024Compositional Curvature Bounds for Deep Neural Networkscited by 3
- 2025Estimating Control Barriers from Offline Datacited by 3
50 most cited of 88 All 88 (JSON)
- 2026Turning Safety into Competence: Minimally Exploitable Robot Policies via Safety-Filtered Reinforcement Learning23 Sep 2026
- 2026Data-Driven Time-Varying Control Barrier Functions for Adaptive Safe-Set Learning with Online Decremental Support Vector Machines19 Aug 2026
- 2026Topological Feasibility Guarantees for Differentiable Predictive Control11 Aug 2026
- 2026End-to-End Learning of Safe Optimal Feedback Control in High Dimensions with Control Barrier Function Layers22 Jul 2026
- 2026Discriminative Barrier Functions for Safe Adversarial Imitation Learning from Observation15 Jul 2026
- 2026Learning from Demonstration via Spatiotemporal Tubes for Unknown Euler-Lagrange Systems1 Jul 2026
- 2026Pixels to Proofs: Probabilistically-Safe Latent World Model Control via Parallel Conformal Robust MPC14 Jun 2026
- 2026Permissive Safety Through Trusted Inference: Verifiable Belief-Space Neural Safety Filters for Assured Interactive Robotics1 Jun 2026
- 2026Bridging Control with Neural Network Verifier alpha-beta-CROWN: A Tutorial26 May 2026
- 2026TAIL-Safe: Task-Agnostic Safety Monitoring for Imitation Learning Policies2 May 2026
- 2026Safe Large-Scale Robust Nonlinear MPC in Milliseconds via Reachability-Constrained System Level Synthesis on the GPU8 Apr 2026
- 2026Safe Reinforcement Learning with Preference-based Constraint Inference24 Mar 2026
38 more
- 2026Safe Probabilistic Planning for Human-Robot Interaction using Conformal Risk Control11 Mar 2026
- 2026CN-CBF: Composite Neural Control Barrier Function for Robot Navigation in Dynamic Environments6 Mar 2026
- 2026V-MORALS: Visual Morse Graph-Aided Estimation of Regions of Attraction in a Learned Latent Space26 Feb 2026
- 2026BarrierSteer: LLM Safety via Learning Barrier Steering23 Feb 2026
- 2025V-OCBF: Learning Safety Filters from Offline Data via Value-Guided Offline Control Barrier Functions11 Dec 2025
- 2025Learning Neural Control Barrier Functions from Expert Demonstrations using Inverse Constraint Learning24 Oct 2025
- 2025Provably Optimal Reinforcement Learning under Safety Filtering20 Oct 2025
- 2025SafeFlowMatcher: Safe and Fast Planning using Flow Matching with Control Barrier Functions29 Sep 2025
- 2025ORN-CBF: Learning Observation-conditioned Residual Neural Control Barrier Functions via Hypernetworks20 Sep 2025
- 2025Real-Time Model Checking for Closed-Loop Robot Reactive Planning26 Aug 2025
- 2025Two-Stage Learning of Stabilizing Neural Controllers via Zubov Sampling and Iterative Domain Expansion2 Jun 2025
- 2025Reachability Barrier Networks: Learning Hamilton-Jacobi Solutions for Smooth and Flexible Control Barrier Functions16 May 2025
- 2025Learning Conservative Neural Control Barrier Functions from Offline Data1 May 2025
- 2025Uncertainty-aware Latent Safety Filters for Avoiding Out-of-Distribution Failures1 May 2025
- 2025Neural Control Barrier Functions from Physics Informed Neural Networks15 Apr 2025
- 2025Safe Human Robot Navigation in Warehouse Scenario27 Mar 2025
- 2025CP-NCBF: A Conformal Prediction-based Approach to Synthesize Verified Neural Control Barrier Functions18 Mar 2025
- 2025RISE: Robust Imitation through Stochastic Encoding15 Mar 2025
- 2025Safety Guardrails for LLM-Enabled Robots10 Mar 2025
- 2025T-CBF: Traversability-based Control Barrier Function to Navigate Vertically Challenging Terrain8 Mar 2025
- 2025Steering Dialogue Dynamics for Robustness against Multi-turn Jailbreaking Attacks28 Feb 2025
- 2025Estimating Control Barriers from Offline Data21 Feb 2025
- 2025Generalizing Safety Beyond Collision-Avoidance via Latent-Space Reachability Analysis2 Feb 2025
- 2024Stability properties of gradient flow dynamics for the symmetric low-rank matrix factorization problem24 Nov 2024
- 2024Domain Adaptive Safety Filters via Deep Operator Learning18 Oct 2024
- 2024MAGICS: Adversarial RL with Minimax Actors Guided by Implicit Critic Stackelberg for Convergent Neural Synthesis of Robot Safety20 Sep 2024
- 2024ABNet: Attention BarrierNet for Safe and Scalable Robot Learning18 Jun 2024
- 2024Compositional Curvature Bounds for Deep Neural Networks7 Jun 2024
- 2024Gameplay Filters: Robust Zero-Shot Safety through Adversarial Imagination1 May 2024
- 2024Learning Control Barrier Functions and their application in Reinforcement Learning: A Survey22 Apr 2024
- 2024Safe Reinforcement Learning on the Constraint Manifold: Theory and Applications13 Apr 2024
- 2024Verification-Aided Learning of Neural Network Barrier Functions with Termination Guarantees12 Mar 2024
- 2024Fault Tolerant Neural Control Barrier Functions for Robotic Systems under Sensor Faults and Attacks28 Feb 2024
- 2024Reinforcement Learning with Ensemble Model Predictive Safety Certification6 Feb 2024
- 2024Learning safety critics via a non-contractive binary bellman operator23 Jan 2024
- 2024Safe Offline Reinforcement Learning with Feasibility-Guided Diffusion Model19 Jan 2024
- 2024Learning Performance-Oriented Control Barrier Functions Under Complex Safety Constraints and Limited Actuation11 Jan 2024
- 2023Multi-Step Model Predictive Safety Filters: Reducing Chattering by Increasing the Prediction Horizon20 Sep 2023
50 newest of 88 All 88 (JSON)
- 2024Safe Offline Reinforcement Learning with Feasibility-Guided Diffusion Modelcited by 62
- 2022Temporal Logic Imitation: Learning Plan-Satisficing Motion Policies from Demonstrationscited by 10
- 2025V-OCBF: Learning Safety Filters from Offline Data via Value-Guided Offline Control Barrier Functionscited by 5
- 2025Learning Conservative Neural Control Barrier Functions from Offline Datacited by 4
- 2022Safe Inverse Reinforcement Learning via Control Barrier Functioncited by 3
- 2021Credit Assignment Safety Learning from Human Demonstrationscited by 0
- 2025RISE: Robust Imitation through Stochastic Encodingcited by 0
- 2026Learning from Demonstration via Spatiotemporal Tubes for Unknown Euler-Lagrange Systemscited by 0
- 2026Discriminative Barrier Functions for Safe Adversarial Imitation Learning from Observationcited by 0
- 2026Discriminative Barrier Functions for Safe Adversarial Imitation Learning from Observation15 Jul 2026
- 2026Learning from Demonstration via Spatiotemporal Tubes for Unknown Euler-Lagrange Systems1 Jul 2026
- 2025V-OCBF: Learning Safety Filters from Offline Data via Value-Guided Offline Control Barrier Functions11 Dec 2025
- 2025Learning Conservative Neural Control Barrier Functions from Offline Data1 May 2025
- 2025RISE: Robust Imitation through Stochastic Encoding15 Mar 2025
- 2024Safe Offline Reinforcement Learning with Feasibility-Guided Diffusion Model19 Jan 2024
- 2022Safe Inverse Reinforcement Learning via Control Barrier Function6 Dec 2022
- 2022Temporal Logic Imitation: Learning Plan-Satisficing Motion Policies from Demonstrations9 Jun 2022
- 2021Credit Assignment Safety Learning from Human Demonstrations9 Oct 2021
- 2025Safety Guardrails for LLM-Enabled Robotscited by 30
- 2025Steering Dialogue Dynamics for Robustness against Multi-turn Jailbreaking Attackscited by 20
- 2026BarrierSteer: LLM Safety via Learning Barrier Steeringcited by 0
- 2026BarrierSteer: LLM Safety via Learning Barrier Steering23 Feb 2026
- 2025Safety Guardrails for LLM-Enabled Robots10 Mar 2025
- 2025Steering Dialogue Dynamics for Robustness against Multi-turn Jailbreaking Attacks28 Feb 2025
- 2025Generalizing Safety Beyond Collision-Avoidance via Latent-Space Reachability Analysiscited by 44
- 2025Uncertainty-aware Latent Safety Filters for Avoiding Out-of-Distribution Failurescited by 30
- 2026Pixels to Proofs: Probabilistically-Safe Latent World Model Control via Parallel Conformal Robust MPCcited by 2
- 2026Pixels to Proofs: Probabilistically-Safe Latent World Model Control via Parallel Conformal Robust MPC14 Jun 2026
- 2025Uncertainty-aware Latent Safety Filters for Avoiding Out-of-Distribution Failures1 May 2025
- 2025Generalizing Safety Beyond Collision-Avoidance via Latent-Space Reachability Analysis2 Feb 2025
- 2023The Safety Filter: A Unified View of Safety-Critical Control in Autonomous Systemscited by 77
- 2021Learning Safe Multi-Agent Control with Decentralized Neural Barrier Certificatescited by 71
- 2022Lyapunov Density Models: Constraining Distribution Shift in Learning-Based Controlcited by 28
- 2023Physics-Informed Machine Learning for Modeling and Control of Dynamical Systemscited by 28
- 2022Safe Control Under Input Limits with Neural Control Barrier Functionscited by 27
- 2021Safe Pontryagin Differentiable Programmingcited by 25
- 2022Safety Certification for Stochastic Systems via Neural Barrier Functionscited by 22
- 2021Learning Robust Output Control Barrier Functions from Safe Expert Demonstrationscited by 19
- 2021Lyapunov-Net: A Deep Neural Network Architecture for Lyapunov Function Approximationcited by 16
- 2023In-Distribution Barrier Functions: Self-Supervised Policy Filters that Avoid Out-of-Distribution Statescited by 15
- 2021Learning Robust Hybrid Control Barrier Functions for Uncertain Systemscited by 14
- 2023Active Uncertainty Reduction for Safe and Efficient Interaction Planning: A Shielding-Aware Dual Control Approachcited by 13
12 most cited of 68 All 68 (JSON)
- 2026Turning Safety into Competence: Minimally Exploitable Robot Policies via Safety-Filtered Reinforcement Learning23 Sep 2026
- 2026Data-Driven Time-Varying Control Barrier Functions for Adaptive Safe-Set Learning with Online Decremental Support Vector Machines19 Aug 2026
- 2026Topological Feasibility Guarantees for Differentiable Predictive Control11 Aug 2026
- 2026End-to-End Learning of Safe Optimal Feedback Control in High Dimensions with Control Barrier Function Layers22 Jul 2026
- 2026Permissive Safety Through Trusted Inference: Verifiable Belief-Space Neural Safety Filters for Assured Interactive Robotics1 Jun 2026
- 2026Bridging Control with Neural Network Verifier alpha-beta-CROWN: A Tutorial26 May 2026
- 2026Safe Large-Scale Robust Nonlinear MPC in Milliseconds via Reachability-Constrained System Level Synthesis on the GPU8 Apr 2026
- 2026Safe Reinforcement Learning with Preference-based Constraint Inference24 Mar 2026
- 2026Safe Probabilistic Planning for Human-Robot Interaction using Conformal Risk Control11 Mar 2026
- 2026CN-CBF: Composite Neural Control Barrier Function for Robot Navigation in Dynamic Environments6 Mar 2026
- 2026V-MORALS: Visual Morse Graph-Aided Estimation of Regions of Attraction in a Learned Latent Space26 Feb 2026
- 2025Learning Neural Control Barrier Functions from Expert Demonstrations using Inverse Constraint Learning24 Oct 2025
12 newest of 68 All 68 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2022End-to-End Imitation Learning with Safety Guarantees using Control Barrier Functions
- 2020Training Neural Network Controllers Using Control Barrier Functions in the Presence of Disturbances
- 2025Barrier Function Overrides For Non-Convex Fixed Wing Flight Control and Self-Driving Cars
- 2023Safe Neural Control for Non-Affine Control Systems with Differentiable Control Barrier Functions
- 2024Semi-Supervised Safe Visuomotor Policy Synthesis using Barrier Certificates
- 2022Safe Reinforcement Learning with Probabilistic Control Barrier Functions for Ramp Merging
- 2026Individual Control Barrier Functions-Guided Diffusion Model for Safe Offline Multi-Agent Reinforcement Learning
- 2023Trajectory Generation, Control, and Safety with Denoising Diffusion Probabilistic Models