Hamilton-Jacobi Reachability: A Brief Overview and Recent Advances
Not on the map. Why?
Abstract (arXiv)
Hamilton-Jacobi (HJ) reachability analysis is an important formal verification method for guaranteeing performance and safety properties of dynamical systems; it has been applied to many small-scale systems in the past decade. Its advantages include compatibility with general nonlinear system dynamics, formal treatment of bounded disturbances, and the availability of well-developed numerical tools. The main challenge is addressing its exponential computational complexity with respect to the number of state variables. In this tutorial, we present an overview of basic HJ reachability theory and provide instructions for using the most recent numerical tools, including an efficient GPU-parallelized implementation of a Level Set Toolbox for computing reachable sets. In addition, we review some of the current work in high-dimensional HJ reachability to show how the dimensionality challenge can be alleviated via various general theoretical and application-specific insights.
Key facts. Cited by 186 papers in the map (data through 7 Oct 2026). First posted on arXiv 21 Sep 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 24; 2022: 16; 2023: 26; 2024: 36; 2025: 37; 2026: 47.
186 papers.
Sort:
By area:
- 2023Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysiscited by 99
- 2023The Safety Filter: A Unified View of Safety-Critical Control in Autonomous Systemscited by 77
- 2022Safe Reinforcement Learning by Imagining the Near Futurecited by 67
- 2024Safe Offline Reinforcement Learning with Feasibility-Guided Diffusion Modelcited by 62
- 2024Agile But Safe: Learning Collision-Free High-Speed Legged Locomotioncited by 53
- 2022Reachability Constrained Reinforcement Learningcited by 52
- 2023Conformal Decision Theory: Safe Autonomous Decisions from Imperfect Predictionscited by 46
- 2025Generalizing Safety Beyond Collision-Avoidance via Latent-Space Reachability Analysiscited by 44
- 2021Safety and Liveness Guarantees through Reach-Avoid Reinforcement Learningcited by 43
- 2021Reachability Analysis of Neural Feedback Loopscited by 41
- 2023Iterative Reachability Estimation for Safe Reinforcement Learningcited by 33
- 2022Lyapunov Density Models: Constraining Distribution Shift in Learning-Based Controlcited by 28
38 more
- 2022Safe Control Under Input Limits with Neural Control Barrier Functionscited by 27
- 2021Safe Pontryagin Differentiable Programmingcited by 25
- 2022Sim-to-Lab-to-Real: Safe Reinforcement Learning with Shielding and Generalization Guaranteescited by 24
- 2022ISAACS: Iterative Soft Adversarial Actor-Critic for Safetycited by 24
- 2021Safe Control with Neural Network Dynamic Modelscited by 21
- 2023Verification of Neural Reachable Tubes via Scenario Optimization and Conformal Predictioncited by 21
- 2022Backward Reachability Analysis of Neural Feedback Loops: Techniques for Linear and Nonlinear Systemscited by 18
- 2021Value Iteration in Continuous Actions, States and Timecited by 17
- 2023Robust Control for Dynamical Systems With Non-Gaussian Noise via Formal Abstractionscited by 16
- 2024Formally Verifying Deep Reinforcement Learning Controllers with Lyapunov Barrier Certificatescited by 15
- 2021Neural Network Verification in Controlcited by 14
- 2024Solving Minimum-Cost Reach Avoid using Reinforcement Learningcited by 14
- 2021Safe Autonomous Racing via Approximate Reachability on Ego-visioncited by 13
- 2021Sampling-Based Robust Control of Autonomous Systems with Non-Gaussian Noisecited by 13
- 2021Conservative and Adaptive Penalty for Model-Based Safe Reinforcement Learningcited by 13
- 2023Active Uncertainty Reduction for Safe and Efficient Interaction Planning: A Shielding-Aware Dual Control Approachcited by 13
- 2024SAFE-GIL: SAFEty Guided Imitation Learning for Robotic Systemscited by 13
- 2024FREA: Feasibility-Guided Generation of Safety-Critical Scenarios with Reasonable Adversarialitycited by 13
- 2021SHARP: Shielding-Aware Robust Planning for Safe and Efficient Human-Robot Interactioncited by 12
- 2024Gameplay Filters: Robust Zero-Shot Safety through Adversarial Imaginationcited by 12
- 2022Generating Formal Safety Assurances for High-Dimensional Reachabilitycited by 11
- 2022Statistical Safety and Robustness Guarantees for Feedback Motion Planning of Unknown Underactuated Stochastic Systemscited by 11
- 2024The Role of Predictive Uncertainty and Diversity in Embodied AI and Robot Learningcited by 11
- 2024Hamilton-Jacobi Reachability in Reinforcement Learning: A Surveycited by 11
- 2025SafeFlowMatcher: Safe and Fast Planning using Flow Matching with Control Barrier Functionscited by 11
- 2021Efficient Reachability Analysis of Closed-Loop Systems with Neural Network Controllerscited by 10
- 2021Scalable Learning of Safety Guarantees for Autonomous Systems using Hamilton-Jacobi Reachabilitycited by 10
- 2022End-to-End Imitation Learning with Safety Guarantees using Control Barrier Functionscited by 10
- 2025Real-Time Out-of-Distribution Failure Prevention via Multi-Modal Reasoningcited by 10
- 2025Preemptive Detection and Steering of LLM Misalignment via Latent Reachabilitycited by 10
- 2021LS3: Latent Space Safe Sets for Long-Horizon Visuomotor Control of Sparse Reward Iterative Taskscited by 9
- 2022Backward Reachability Analysis for Neural Feedback Loopscited by 9
- 2023Efficient Interaction-Aware Interval Analysis of Neural Network Feedback Loopscited by 9
- 2023Deception Game: Closing the Safety-Learning Loop in Interactive Robot Autonomycited by 9
- 2023Data-Driven Reachability Analysis of Stochastic Dynamical Systems with Conformal Inferencecited by 9
- 2023State-Wise Safe Reinforcement Learning With Pixel Observationscited by 9
- 2021Analyzing Human Models that Adapt Onlinecited by 8
- 2021Robust Value Iteration for Continuous Control Taskscited by 8
50 most cited of 186 All 186 (JSON)
- 2026Reachability-Informed Reinforcement Learning for Multi-Impulse Interplanetary Transfers1 Oct 2026
- 2026Stochastic World Models for Verifying Vision-Based Neural Feedback Systems29 Sep 2026
- 2026Zero-Shot Reactive Obstacle Avoidance for Generative Robot Policies28 Sep 2026
- 2026CrossSafe: Towards Cross-Embodiment Latent Safety Filters24 Sep 2026
- 2026LEAP-CBF: A Safety Filter for Uncertain Systems with Least-Effort Adversarial Potentials23 Sep 2026
- 2026Turning Safety into Competence: Minimally Exploitable Robot Policies via Safety-Filtered Reinforcement Learning23 Sep 2026
- 2026VLPSA: Vision-Language-Poisson-Safe Actions for Full-Body Safety of Learned Policies18 Sep 2026
- 2026Safe Meta-Reinforcement Learning via Information Space Reachability14 Sep 2026
- 2026VertexCBF: Improving Neural Control Barrier Functions via Vertex-Restricted Control Search11 Sep 2026
- 2026No Free Checker: A Survey of Verifiers for Robot Policies8 Sep 2026
- 2026ShieldVLA: Feasibility-Aware Safety Alignment for Vision-Language-Action Models2 Sep 2026
- 2026Humanoid Safe Stop via Learned Stoppability Value2 Sep 2026
38 more
- 2026Forward Trajectory Steering for Hamilton-Jacobi Reachability Analysis11 Aug 2026
- 2026Topological Feasibility Guarantees for Differentiable Predictive Control11 Aug 2026
- 2026Agentic Harnesses: LLM-Driven Verification Layers for Robot Autonomy10 Aug 2026
- 2026Towards General Language-Conditioned Latent Safety Filters31 Jul 2026
- 2026Towards Trustworthy Embodied Intelligence: A Systems Framework and Graded Trustworthiness Levels28 Jul 2026
- 2026Robust Peak-cost Constrained Reinforcement Learning16 Jul 2026
- 2026GPU-Parallel Linearization Error Bounds for Real-Time Robust Optimal Control of Nonlinear and Neural Network Dynamics1 Jul 2026
- 2026ShardNet: Training Neural Controllers with Hard, Non-Convex Constraints29 Jun 2026
- 2026Conformal Orbit-Valid Trust Horizons for Equivariant World Models23 Jun 2026
- 2026Sensitivity Shaping for Latent Modeling12 Jun 2026
- 2026Provably Safe, Yet Scalable Reinforcement Learning12 Jun 2026
- 2026VLESA: Vision-Language Embodied Safety Agent for Human Activity Monitoring2 Jun 2026
- 2026Permissive Safety Through Trusted Inference: Verifiable Belief-Space Neural Safety Filters for Assured Interactive Robotics1 Jun 2026
- 2026All Models are Wrong, Knowing Where is Useful: On Model Uncertainty in Reinforcement Learning31 May 2026
- 2026Offline Policy Evaluation for Manipulation Policies via Discounted Liveness Formulation12 May 2026
- 2026Unifying Goal-Conditioned RL and Unsupervised Skill Learning via Control-Maximization7 May 2026
- 2026Safety Certification is Classification7 May 2026
- 2026Model-Based Proactive Cost Generation for Learning Safe Policies Offline with Limited Violation Data2 May 2026
- 2026TAIL-Safe: Task-Agnostic Safety Monitoring for Imitation Learning Policies2 May 2026
- 2026Value Functions for Temporal Logic: Optimal Policies and Safety Filters1 May 2026
- 2026Uncertainty-Aware Predictive Safety Filters for Probabilistic Neural Network Dynamics29 Apr 2026
- 2026Dyna-Style Safety Augmented Reinforcement Learning: Staying Safe in the Face of Uncertainty28 Apr 2026
- 2026Safe Control using Learned Safety Filters and Adaptive Conformal Inference20 Apr 2026
- 2026Safe Large-Scale Robust Nonlinear MPC in Milliseconds via Reachability-Constrained System Level Synthesis on the GPU8 Apr 2026
- 2026CMP: Robust Whole-Body Tracking for Loco-Manipulation via Competence Manifold Projection8 Apr 2026
- 2026Safe Flow Q-Learning: Offline Safe Reinforcement Learning with Reachability-Based Flow Policies16 Mar 2026
- 2026The FABRIC Strategy for Verifying Neural Feedback Systems9 Mar 2026
- 2026CN-CBF: Composite Neural Control Barrier Function for Robot Navigation in Dynamic Environments6 Mar 2026
- 2026SaFeR: Safety-Critical Scenario Generation for Autonomous Driving Test via Feasibility-Constrained Token Resampling4 Mar 2026
- 2026V-MORALS: Visual Morse Graph-Aided Estimation of Regions of Attraction in a Learned Latent Space26 Feb 2026
- 2026Steering Away from Memorization: Reachability-Constrained Reinforcement Learning for Text-to-Image Diffusion24 Feb 2026
- 2026Contextual Safety Reasoning and Grounding for Open-World Robots23 Feb 2026
- 2026Interacting safely with cyclists using Hamilton-Jacobi reachability and reinforcement learning20 Feb 2026
- 2026GenCtrl -- A Formal Controllability Toolkit for Generative Models9 Jan 2026
- 2026Scalable Data-Driven Reachability Analysis and Control via Koopman Operators with Conformal Coverage Guarantees3 Jan 2026
- 2025MSACL: Multi-Step Actor-Critic Learning with Lyapunov Certificates for Exponentially Stabilizing Control31 Dec 2025
- 2025Reach-Avoid Differential game with Reachability Analysis for UAVs: A decomposition approach28 Dec 2025
- 2025V-OCBF: Learning Safety Filters from Offline Data via Value-Guided Offline Control Barrier Functions11 Dec 2025
50 newest of 186 All 186 (JSON)
- 2024Safe Offline Reinforcement Learning with Feasibility-Guided Diffusion Modelcited by 62
- 2024SAFE-GIL: SAFEty Guided Imitation Learning for Robotic Systemscited by 13
- 2022End-to-End Imitation Learning with Safety Guarantees using Control Barrier Functionscited by 10
- 2025V-OCBF: Learning Safety Filters from Offline Data via Value-Guided Offline Control Barrier Functionscited by 5
- 2025Learning Conservative Neural Control Barrier Functions from Offline Datacited by 4
- 2026Safe Flow Q-Learning: Offline Safe Reinforcement Learning with Reachability-Based Flow Policiescited by 3
- 2022Fail-Safe Adversarial Generative Imitation Learningcited by 2
- 2025A Simple Approach to Constraint-Aware Imitation Learning with Application to Autonomous Racingcited by 2
- 2025RISE: Robust Imitation through Stochastic Encodingcited by 0
- 2025Feasibility-Aware Pessimistic Estimation: Toward Long-Horizon Safety in Offline RLcited by 0
- 2025Safety-Aware Imitation Learning via MPC-Guided Disturbance Injectioncited by 0
- 2025TubeDAgger: Reducing the Number of Expert Interventions with Stochastic Reach-Tubescited by 0
- 2026Safe Flow Q-Learning: Offline Safe Reinforcement Learning with Reachability-Based Flow Policies16 Mar 2026
- 2025V-OCBF: Learning Safety Filters from Offline Data via Value-Guided Offline Control Barrier Functions11 Dec 2025
- 2025TubeDAgger: Reducing the Number of Expert Interventions with Stochastic Reach-Tubes1 Oct 2025
- 2025Safety-Aware Imitation Learning via MPC-Guided Disturbance Injection5 Aug 2025
- 2025Feasibility-Aware Pessimistic Estimation: Toward Long-Horizon Safety in Offline RL13 May 2025
- 2025Learning Conservative Neural Control Barrier Functions from Offline Data1 May 2025
- 2025RISE: Robust Imitation through Stochastic Encoding15 Mar 2025
- 2025A Simple Approach to Constraint-Aware Imitation Learning with Application to Autonomous Racing10 Mar 2025
- 2024SAFE-GIL: SAFEty Guided Imitation Learning for Robotic Systems8 Apr 2024
- 2024Safe Offline Reinforcement Learning with Feasibility-Guided Diffusion Model19 Jan 2024
- 2022End-to-End Imitation Learning with Safety Guarantees using Control Barrier Functions21 Dec 2022
- 2022Fail-Safe Adversarial Generative Imitation Learning3 Mar 2022
- 2025Generalizing Safety Beyond Collision-Avoidance via Latent-Space Reachability Analysiscited by 44
- 2025AnySafe: Adapting Latent Safety Filters at Runtime via Safety Constraint Parameterization in the Latent Spacecited by 5
- 2025Designing Latent Safety Filters using Pre-Trained Vision Modelscited by 3
- 2025Safety Certification in the Latent space using Control Barrier Functions and World Modelscited by 2
- 2026Conformal Orbit-Valid Trust Horizons for Equivariant World Modelscited by 1
- 2025How Well Do Latent World Models Understand Partially Observable Safety Constraints?cited by 0
- 2026Stochastic World Models for Verifying Vision-Based Neural Feedback Systemscited by 0
- 2026Stochastic World Models for Verifying Vision-Based Neural Feedback Systems29 Sep 2026
- 2026Conformal Orbit-Valid Trust Horizons for Equivariant World Models23 Jun 2026
- 2025How Well Do Latent World Models Understand Partially Observable Safety Constraints?7 Oct 2025
- 2025AnySafe: Adapting Latent Safety Filters at Runtime via Safety Constraint Parameterization in the Latent Space23 Sep 2025
- 2025Designing Latent Safety Filters using Pre-Trained Vision Models18 Sep 2025
- 2025Safety Certification in the Latent space using Control Barrier Functions and World Models18 Jul 2025
- 2025Generalizing Safety Beyond Collision-Avoidance via Latent-Space Reachability Analysis2 Feb 2025
- 2025SafeFlowMatcher: Safe and Fast Planning using Flow Matching with Control Barrier Functionscited by 11
- 2024Predicting Long-Term Human Behaviors in Discrete Representations via Physics-Guided Diffusioncited by 6
- 2026Steering Away from Memorization: Reachability-Constrained Reinforcement Learning for Text-to-Image Diffusioncited by 1
- 2026TAIL-Safe: Task-Agnostic Safety Monitoring for Imitation Learning Policiescited by 0
- 2026Zero-Shot Reactive Obstacle Avoidance for Generative Robot Policiescited by 0
- 2026Zero-Shot Reactive Obstacle Avoidance for Generative Robot Policies28 Sep 2026
- 2026TAIL-Safe: Task-Agnostic Safety Monitoring for Imitation Learning Policies2 May 2026
- 2026Steering Away from Memorization: Reachability-Constrained Reinforcement Learning for Text-to-Image Diffusion24 Feb 2026
- 2025SafeFlowMatcher: Safe and Fast Planning using Flow Matching with Control Barrier Functions29 Sep 2025
- 2024Predicting Long-Term Human Behaviors in Discrete Representations via Physics-Guided Diffusion29 May 2024
- 2026Towards General Language-Conditioned Latent Safety Filterscited by 1
- 2026ShieldVLA: Feasibility-Aware Safety Alignment for Vision-Language-Action Modelscited by 0
- 2026VLPSA: Vision-Language-Poisson-Safe Actions for Full-Body Safety of Learned Policiescited by 0
- 2026CrossSafe: Towards Cross-Embodiment Latent Safety Filterscited by 0
- 2026CrossSafe: Towards Cross-Embodiment Latent Safety Filters24 Sep 2026
- 2026VLPSA: Vision-Language-Poisson-Safe Actions for Full-Body Safety of Learned Policies18 Sep 2026
- 2026ShieldVLA: Feasibility-Aware Safety Alignment for Vision-Language-Action Models2 Sep 2026
- 2026Towards General Language-Conditioned Latent Safety Filters31 Jul 2026
- 2023Toward General-Purpose Robots via Foundation Models: A Survey and Meta-Analysiscited by 99
- 2023The Safety Filter: A Unified View of Safety-Critical Control in Autonomous Systemscited by 77
- 2022Safe Reinforcement Learning by Imagining the Near Futurecited by 67
- 2024Agile But Safe: Learning Collision-Free High-Speed Legged Locomotioncited by 53
- 2022Reachability Constrained Reinforcement Learningcited by 52
- 2023Conformal Decision Theory: Safe Autonomous Decisions from Imperfect Predictionscited by 46
- 2021Safety and Liveness Guarantees through Reach-Avoid Reinforcement Learningcited by 43
- 2021Reachability Analysis of Neural Feedback Loopscited by 41
- 2023Iterative Reachability Estimation for Safe Reinforcement Learningcited by 33
- 2022Lyapunov Density Models: Constraining Distribution Shift in Learning-Based Controlcited by 28
- 2022Safe Control Under Input Limits with Neural Control Barrier Functionscited by 27
- 2021Safe Pontryagin Differentiable Programmingcited by 25
12 most cited of 152 All 152 (JSON)
- 2026Reachability-Informed Reinforcement Learning for Multi-Impulse Interplanetary Transfers1 Oct 2026
- 2026LEAP-CBF: A Safety Filter for Uncertain Systems with Least-Effort Adversarial Potentials23 Sep 2026
- 2026Turning Safety into Competence: Minimally Exploitable Robot Policies via Safety-Filtered Reinforcement Learning23 Sep 2026
- 2026Safe Meta-Reinforcement Learning via Information Space Reachability14 Sep 2026
- 2026VertexCBF: Improving Neural Control Barrier Functions via Vertex-Restricted Control Search11 Sep 2026
- 2026No Free Checker: A Survey of Verifiers for Robot Policies8 Sep 2026
- 2026Humanoid Safe Stop via Learned Stoppability Value2 Sep 2026
- 2026Forward Trajectory Steering for Hamilton-Jacobi Reachability Analysis11 Aug 2026
- 2026Topological Feasibility Guarantees for Differentiable Predictive Control11 Aug 2026
- 2026Towards Trustworthy Embodied Intelligence: A Systems Framework and Graded Trustworthiness Levels28 Jul 2026
- 2026Robust Peak-cost Constrained Reinforcement Learning16 Jul 2026
- 2026GPU-Parallel Linearization Error Bounds for Real-Time Robust Optimal Control of Nonlinear and Neural Network Dynamics1 Jul 2026
12 newest of 152 All 152 (JSON)