DeepReach: A Deep Learning Approach to High-Dimensional Reachability
Not on the map. Why?
Abstract (arXiv)
Hamilton-Jacobi (HJ) reachability analysis is an important formal verification method for guaranteeing performance and safety properties of dynamical control systems. Its advantages include compatibility with general nonlinear system dynamics, formal treatment of bounded disturbances, and the ability to deal with state and input constraints. However, it involves solving a PDE, whose computational and memory complexity scales exponentially with respect to the number of state variables, limiting its direct use to small-scale systems. We propose DeepReach, a method that leverages new developments in sinusoidal networks to develop a neural PDE solver for high-dimensional reachability problems. The computational requirements of DeepReach do not scale directly with the state dimension, but rather with the complexity of the underlying reachable tube. DeepReach achieves comparable results to the state-of-the-art reachability methods, does not require any explicit supervision for the PDE solution, can easily handle external disturbances, adversarial inputs, and system constraints, and also provides a safety controller for the system. We demonstrate DeepReach on a 9D multi-vehicle collision problem, and a 10D narrow passage problem, motivated by autonomous driving applications.
Key facts. Cited by 91 papers in the map (data through 14 Oct 2026). First posted on arXiv 4 Nov 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 5; 2022: 10; 2023: 9; 2024: 20; 2025: 26; 2026: 21.
91 papers.
Sort:
By area:
- 2023The Safety Filter: A Unified View of Safety-Critical Control in Autonomous Systemscited by 88
- 2024Agile But Safe: Learning Collision-Free High-Speed Legged Locomotioncited by 73
- 2022Reachability Constrained Reinforcement Learningcited by 59
- 2021Safety and Liveness Guarantees through Reach-Avoid Reinforcement Learningcited by 49
- 2025Generalizing Safety Beyond Collision-Avoidance via Latent-Space Reachability Analysiscited by 45
- 2023Iterative Reachability Estimation for Safe Reinforcement Learningcited by 37
- 2025Uncertainty-aware Latent Safety Filters for Avoiding Out-of-Distribution Failurescited by 33
- 2022ISAACS: Iterative Soft Adversarial Actor-Critic for Safetycited by 28
- 2021Fast PDE-constrained optimization via self-supervised operator learningcited by 25
- 2023Verification of Neural Reachable Tubes via Scenario Optimization and Conformal Predictioncited by 23
- 2024Gameplay Filters: Robust Zero-Shot Safety through Adversarial Imaginationcited by 16
- 2021Neural Network Verification in Controlcited by 14
38 more
- 2024SAFE-GIL: SAFEty Guided Imitation Learning for Robotic Systemscited by 14
- 2023Tensor-Compressed Back-Propagation-Free Training for (Physics-Informed) Neural Networkscited by 12
- 2024Safety Filters for Black-Box Dynamical Systems by Learning Discriminating Hyperplanescited by 12
- 2025A Physics-Informed Machine Learning Framework for Safe and Optimal Control of Autonomous Systemscited by 12
- 2021Learning Density Distribution of Reachable States for Autonomous Systemscited by 11
- 2022Generating Formal Safety Assurances for High-Dimensional Reachabilitycited by 11
- 2023Deception Game: Closing the Safety-Learning Loop in Interactive Robot Autonomycited by 10
- 2025Preemptive Detection and Steering of LLM Misalignment via Latent Reachabilitycited by 10
- 2022SympOCnet: Solving optimal control problems with applications to high-dimensional multi-agent path planning problemscited by 9
- 2024One Filter to Deploy Them All: Robust Safety for Quadrupedal Navigation in Unknown Environmentscited by 9
- 2025How to Train Your Latent Control Barrier Function: Smooth Safety Filtering Under Hard-to-Model Constraintscited by 9
- 2024Neural Network Approaches for Parameterized Optimal Controlcited by 8
- 2022TT-PINN: A Tensor-Compressed Neural PDE Solver for Edge Computingcited by 7
- 2024Human-AI Safety: A Descendant of Generative AI and Control Systems Safetycited by 7
- 2024MAGICS: Adversarial RL with Minimax Actors Guided by Implicit Critic Stackelberg for Convergent Neural Synthesis of Robot Safetycited by 7
- 2025AnySafe: Adapting Latent Safety Filters at Runtime via Safety Constraint Parameterization in the Latent Spacecited by 7
- 2026Safe Large-Scale Robust Nonlinear MPC in Milliseconds via Reachability-Constrained System Level Synthesis on the GPUcited by 7
- 2022Infinite-Horizon Reach-Avoid Zero-Sum Games via Deep Reinforcement Learningcited by 6
- 2025Goal Reaching with Eikonal-Constrained Hierarchical Quasimetric Reinforcement Learningcited by 6
- 2021Neural network architectures using min-plus algebra for solving certain high dimensional optimal control problems and Hamilton-Jacobi PDEscited by 5
- 2022Bridging Model-based Safety and Model-free Reinforcement Learning through System Identification of Low Dimensional Linear Modelscited by 5
- 2022Approximating Discontinuous Nash Equilibrial Values of Two-Player General-Sum Differential Gamescited by 5
- 2022Discovering Closed-Loop Failures of Vision-Based Controllers via Reachability Analysiscited by 5
- 2023Bridging Dimensions: Confident Reachability for High-Dimensional Controllerscited by 5
- 2023Detecting and Mitigating System-Level Anomalies of Vision-Based Controllerscited by 4
- 2023Real-Time FJ/MAC PDE Solvers via Tensorized, Back-Propagation-Free Optical PINN Trainingcited by 4
- 2024Learning Performance-Oriented Control Barrier Functions Under Complex Safety Constraints and Limited Actuationcited by 4
- 2025Statistically Assuring Safety of Control Systems using Ensembles of Safety Filters and Conformal Predictioncited by 4
- 2023Value Approximation for Two-Player General-Sum Differential Games with State Constraintscited by 3
- 2024Pontryagin Neural Operator for Solving Parametric General-Sum Differential Gamescited by 3
- 2024Learning Maximal Safe Sets Using Hypernetworks for MPC-based Local Trajectory Planning in Unknown Environmentscited by 3
- 2025Ultra Memory-Efficient On-FPGA Training of Transformers via Tensor-Compressed Optimizationcited by 3
- 2025Your Learned Constraint is Secretly a Backward Reachable Tubecited by 3
- 2025Reachability Barrier Networks: Learning Hamilton-Jacobi Solutions for Smooth and Flexible Control Barrier Functionscited by 3
- 2025Residual Neural Terminal Constraint for MPC-based Collision Avoidance in Dynamic Environmentscited by 3
- 2025Provably Optimal Reinforcement Learning under Safety Filteringcited by 3
- 2025Back to Base: Towards Hands-Off Learning via Safe Resets with Reach-Avoid Safety Filterscited by 2
- 2025Scalable Back-Propagation-Free Training of Optical Physics-Informed Neural Networkscited by 2
50 most cited of 91 All 91 (JSON)
- 2026LEAP-CBF: A Safety Filter for Uncertain Systems with Least-Effort Adversarial Potentials23 Sep 2026
- 2026Turning Safety into Competence: Minimally Exploitable Robot Policies via Safety-Filtered Reinforcement Learning23 Sep 2026
- 2026VertexCBF: Improving Neural Control Barrier Functions via Vertex-Restricted Control Search11 Sep 2026
- 2026Forward Trajectory Steering for Hamilton-Jacobi Reachability Analysis11 Aug 2026
- 2026Reachability-Preserving Bellman Operator for the Discounted Reach-Cost Value Function: Uniting Hamilton-Jacobi Reachability and Reinforcement Learning8 Jul 2026
- 2026ShardNet: Training Neural Controllers with Hard, Non-Convex Constraints29 Jun 2026
- 2026Hamilton-Jacobi Reachability-Based Safe Reinforcement Learning for Emergency Collision Avoidance13 Jun 2026
- 2026Permissive Safety Through Trusted Inference: Verifiable Belief-Space Neural Safety Filters for Assured Interactive Robotics1 Jun 2026
- 2026Unifying Goal-Conditioned RL and Unsupervised Skill Learning via Control-Maximization7 May 2026
- 2026Verifiable Model-Free Safety Filters via Reinforcement Learning7 May 2026
- 2026Lyapunov-Guided Self-Alignment: Test-Time Adaptation for Offline Safe Reinforcement Learning29 Apr 2026
- 2026Safe Large-Scale Robust Nonlinear MPC in Milliseconds via Reachability-Constrained System Level Synthesis on the GPU8 Apr 2026
38 more
- 2026Data-Driven Reachability Analysis via Diffusion Models with PAC Guarantees31 Mar 2026
- 2026CN-CBF: Composite Neural Control Barrier Function for Robot Navigation in Dynamic Environments6 Mar 2026
- 2026V-MORALS: Visual Morse Graph-Aided Estimation of Regions of Attraction in a Learned Latent Space26 Feb 2026
- 2026Steering Away from Memorization: Reachability-Constrained Reinforcement Learning for Text-to-Image Diffusion24 Feb 2026
- 2026Certifying Hamilton-Jacobi Reachability Learned via Reinforcement Learning18 Feb 2026
- 2026Solving Parameter-Robust Avoid Problems with Unknown Feasibility using Reinforcement Learning17 Feb 2026
- 2026Unifying Hamilton-Jacobi Reachability and Reinforcement Learning12 Jan 2026
- 2026GenCtrl -- A Formal Controllability Toolkit for Generative Models9 Jan 2026
- 2026Scalable Data-Driven Reachability Analysis and Control via Koopman Operators with Conformal Coverage Guarantees3 Jan 2026
- 2025Reach-Avoid Differential game with Reachability Analysis for UAVs: A decomposition approach28 Dec 2025
- 2025Goal Reaching with Eikonal-Constrained Hierarchical Quasimetric Reinforcement Learning12 Dec 2025
- 2025How to Train Your Latent Control Barrier Function: Smooth Safety Filtering Under Hard-to-Model Constraints23 Nov 2025
- 2025Statistically Assuring Safety of Control Systems using Ensembles of Safety Filters and Conformal Prediction11 Nov 2025
- 2025Provably Optimal Reinforcement Learning under Safety Filtering20 Oct 2025
- 2025From Refusal to Recovery: A Control-Theoretic Approach to Generative AI Guardrails15 Oct 2025
- 2025MAD-PINN: A Decentralized Physics-Informed Machine Learning Framework for Safe and Optimal Multi-Agent Control28 Sep 2025
- 2025Preemptive Detection and Steering of LLM Misalignment via Latent Reachability25 Sep 2025
- 2025AnySafe: Adapting Latent Safety Filters at Runtime via Safety Constraint Parameterization in the Latent Space23 Sep 2025
- 2025ORN-CBF: Learning Observation-conditioned Residual Neural Control Barrier Functions via Hypernetworks20 Sep 2025
- 2025Continuous-Time Value Iteration for Multi-Agent Reinforcement Learning11 Sep 2025
- 2025Residual Neural Terminal Constraint for MPC-based Collision Avoidance in Dynamic Environments5 Aug 2025
- 2025Solving nonconvex Hamilton--Jacobi--Isaacs equations with PINN-based policy iteration21 Jul 2025
- 2025Test Automation for Interactive Scenarios via Promptable Traffic Simulation1 Jun 2025
- 2025Reachability Barrier Networks: Learning Hamilton-Jacobi Solutions for Smooth and Flexible Control Barrier Functions16 May 2025
- 2025Uncertainty-aware Latent Safety Filters for Avoiding Out-of-Distribution Failures1 May 2025
- 2025Certified Approximate Reachability (CARe): Formal Error Bounds on Deep Learning of Reachable Sets31 Mar 2025
- 2025Learning Nash Equilibrial Hamiltonian for Two-Player Collision-Avoiding Interactions10 Mar 2025
- 2025Safe Beyond the Horizon: Efficient Sampling-based MPC with Neural Control Barrier Functions20 Feb 2025
- 2025Scalable Back-Propagation-Free Training of Optical Physics-Informed Neural Networks17 Feb 2025
- 2025A Physics-Informed Machine Learning Framework for Safe and Optimal Control of Autonomous Systems16 Feb 2025
- 2025Generalizing Safety Beyond Collision-Avoidance via Latent-Space Reachability Analysis2 Feb 2025
- 2025Your Learned Constraint is Secretly a Backward Reachable Tube26 Jan 2025
- 2025Ultra Memory-Efficient On-FPGA Training of Transformers via Tensor-Compressed Optimization11 Jan 2025
- 2025Back to Base: Towards Hands-Off Learning via Safe Resets with Reach-Avoid Safety Filters5 Jan 2025
- 2025Experimental Demonstration of an Optical Neural PDE Solver via On-Chip PINN Training1 Jan 2025
- 2024One Filter to Deploy Them All: Robust Safety for Quadrupedal Navigation in Unknown Environments13 Dec 2024
- 2024Safe PDE Boundary Control with Neural Operators23 Nov 2024
- 2024Dynamic Tube MPC: Learning Tube Dynamics with Massively Parallel Simulation for Robust Safety in Practice22 Nov 2024
50 newest of 91 All 91 (JSON)
- 2024Safety Filters for Black-Box Dynamical Systems by Learning Discriminating Hyperplanescited by 12
- 2024Neural Network Approaches for Parameterized Optimal Controlcited by 8
- 2024MAGICS: Adversarial RL with Minimax Actors Guided by Implicit Critic Stackelberg for Convergent Neural Synthesis of Robot Safetycited by 7
- 2025Goal Reaching with Eikonal-Constrained Hierarchical Quasimetric Reinforcement Learningcited by 6
- 2025Provably Optimal Reinforcement Learning under Safety Filteringcited by 3
- 2025Back to Base: Towards Hands-Off Learning via Safe Resets with Reach-Avoid Safety Filterscited by 2
- 2026Unifying Goal-Conditioned RL and Unsupervised Skill Learning via Control-Maximizationcited by 2
- 2024The Feasibility Theory of Constrained Reinforcement Learning: A Tutorial Studycited by 1
- 2024Learning Robust Policies via Interpretable Hamilton-Jacobi Reachability-Guided Disturbancescited by 1
- 2024Deep Reinforcement Learning for Reach-Avoid-Stay Problemscited by 1
- 2026Certifying Hamilton-Jacobi Reachability Learned via Reinforcement Learningcited by 1
- 2026Unifying Hamilton-Jacobi Reachability and Reinforcement Learningcited by 0
12 most cited of 17 All 17 (JSON)
- 2026Turning Safety into Competence: Minimally Exploitable Robot Policies via Safety-Filtered Reinforcement Learning23 Sep 2026
- 2026Reachability-Preserving Bellman Operator for the Discounted Reach-Cost Value Function: Uniting Hamilton-Jacobi Reachability and Reinforcement Learning8 Jul 2026
- 2026Hamilton-Jacobi Reachability-Based Safe Reinforcement Learning for Emergency Collision Avoidance13 Jun 2026
- 2026Unifying Goal-Conditioned RL and Unsupervised Skill Learning via Control-Maximization7 May 2026
- 2026Verifiable Model-Free Safety Filters via Reinforcement Learning7 May 2026
- 2026Certifying Hamilton-Jacobi Reachability Learned via Reinforcement Learning18 Feb 2026
- 2026Solving Parameter-Robust Avoid Problems with Unknown Feasibility using Reinforcement Learning17 Feb 2026
- 2026Unifying Hamilton-Jacobi Reachability and Reinforcement Learning12 Jan 2026
- 2025Goal Reaching with Eikonal-Constrained Hierarchical Quasimetric Reinforcement Learning12 Dec 2025
- 2025Provably Optimal Reinforcement Learning under Safety Filtering20 Oct 2025
- 2025Back to Base: Towards Hands-Off Learning via Safe Resets with Reach-Avoid Safety Filters5 Jan 2025
- 2024Deep Reinforcement Learning for Reach-Avoid-Stay Problems3 Oct 2024
12 newest of 17 All 17 (JSON)
- 2025Generalizing Safety Beyond Collision-Avoidance via Latent-Space Reachability Analysiscited by 45
- 2025Uncertainty-aware Latent Safety Filters for Avoiding Out-of-Distribution Failurescited by 33
- 2025AnySafe: Adapting Latent Safety Filters at Runtime via Safety Constraint Parameterization in the Latent Spacecited by 7
- 2025AnySafe: Adapting Latent Safety Filters at Runtime via Safety Constraint Parameterization in the Latent Space23 Sep 2025
- 2025Uncertainty-aware Latent Safety Filters for Avoiding Out-of-Distribution Failures1 May 2025
- 2025Generalizing Safety Beyond Collision-Avoidance via Latent-Space Reachability Analysis2 Feb 2025
- 2023The Safety Filter: A Unified View of Safety-Critical Control in Autonomous Systemscited by 88
- 2024Agile But Safe: Learning Collision-Free High-Speed Legged Locomotioncited by 73
- 2022Reachability Constrained Reinforcement Learningcited by 59
- 2021Safety and Liveness Guarantees through Reach-Avoid Reinforcement Learningcited by 49
- 2023Iterative Reachability Estimation for Safe Reinforcement Learningcited by 37
- 2022ISAACS: Iterative Soft Adversarial Actor-Critic for Safetycited by 28
- 2021Fast PDE-constrained optimization via self-supervised operator learningcited by 25
- 2023Verification of Neural Reachable Tubes via Scenario Optimization and Conformal Predictioncited by 23
- 2024Gameplay Filters: Robust Zero-Shot Safety through Adversarial Imaginationcited by 16
- 2021Neural Network Verification in Controlcited by 14
- 2023Tensor-Compressed Back-Propagation-Free Training for (Physics-Informed) Neural Networkscited by 12
- 2025A Physics-Informed Machine Learning Framework for Safe and Optimal Control of Autonomous Systemscited by 12
12 most cited of 64 All 64 (JSON)
- 2026LEAP-CBF: A Safety Filter for Uncertain Systems with Least-Effort Adversarial Potentials23 Sep 2026
- 2026VertexCBF: Improving Neural Control Barrier Functions via Vertex-Restricted Control Search11 Sep 2026
- 2026Forward Trajectory Steering for Hamilton-Jacobi Reachability Analysis11 Aug 2026
- 2026ShardNet: Training Neural Controllers with Hard, Non-Convex Constraints29 Jun 2026
- 2026Permissive Safety Through Trusted Inference: Verifiable Belief-Space Neural Safety Filters for Assured Interactive Robotics1 Jun 2026
- 2026Safe Large-Scale Robust Nonlinear MPC in Milliseconds via Reachability-Constrained System Level Synthesis on the GPU8 Apr 2026
- 2026CN-CBF: Composite Neural Control Barrier Function for Robot Navigation in Dynamic Environments6 Mar 2026
- 2026V-MORALS: Visual Morse Graph-Aided Estimation of Regions of Attraction in a Learned Latent Space26 Feb 2026
- 2026GenCtrl -- A Formal Controllability Toolkit for Generative Models9 Jan 2026
- 2026Scalable Data-Driven Reachability Analysis and Control via Koopman Operators with Conformal Coverage Guarantees3 Jan 2026
- 2025Reach-Avoid Differential game with Reachability Analysis for UAVs: A decomposition approach28 Dec 2025
- 2025How to Train Your Latent Control Barrier Function: Smooth Safety Filtering Under Hard-to-Model Constraints23 Nov 2025
12 newest of 64 All 64 (JSON)