Learning Density Distribution of Reachable States for Autonomous Systems
Not on the map. Why?
Abstract (arXiv)
State density distribution, in contrast to worst-case reachability, can be leveraged for safety-related problems to better quantify the likelihood of the risk for potentially hazardous situations. In this work, we propose a data-driven method to compute the density distribution of reachable states for nonlinear and even black-box systems. Our semi-supervised approach learns system dynamics and the state density jointly from trajectory data, guided by the fact that the state density evolution follows the Liouville partial differential equation. With the help of neural network reachability tools, our approach can estimate the set of all possible future states as well as their density. Moreover, we could perform online safety verification with probability ranges for unsafe behaviors to occur. We use an extensive set of experiments to show that our learned solution can produce a much more accurate estimate on density distribution, and can quantify risks less conservatively and flexibly comparing with worst-case analysis.
Key facts. Cited by 11 papers in the map (data through 7 Oct 2026). Builds on 41 of its 85 references that are in the map. First posted on arXiv 14 Sep 2021.
Builds on
41 of 85 references.
References · 41
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,160
- 2015Continuous control with deep reinforcement learningcited by 3,279
- 2020Fourier Neural Operator for Parametric Partial Differential Equationscited by 2,806
- 2017Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networkscited by 739
- 2017DGM: A deep learning algorithm for solving partial differential equationscited by 674
- 2019DeepXDE: A deep learning library for solving differential equationscited by 617
- 2017The Deep Ritz method: A deep learning-based numerical algorithm for solving variational problemscited by 581
- 2017PDE-Net: Learning PDEs from Datacited by 304
- 2019Algorithms for Verifying Deep Neural Networkscited by 221
- 2018Quantifying total uncertainty in physics-informed neural networks for solving forward and inverse stochastic problemscited by 144
- 2020Neural Lyapunov Controlcited by 142
- 2018Physics-Informed Generative Adversarial Networks for Stochastic Differential Equationscited by 133
29 more
- 2020NNV: The Neural Network Verification Tool for Deep Neural Networks and Learning-Enabled Cyber-Physical Systemscited by 128
- 2017A unified deep artificial neural network approach to partial differential equations in complex geometriescited by 122
- 2018Verisig: verifying safety properties of hybrid systems with neural network controllerscited by 83
- 2020DeepReach: A Deep Learning Approach to High-Dimensional Reachabilitycited by 81
- 2017Output Reachable Set Estimation and Verification for Multi-Layer Neural Networkscited by 79
- 2020Algorithms for Solving High Dimensional PDEs: From Nonlinear Monte Carlo to Machine Learningcited by 77
- 2019A Theoretical Analysis of Deep Neural Networks and Parametric PDEscited by 74
- 2020Learning Stability Certificates from Datacited by 45
- 2020Reach-SDP: Reachability Analysis of Closed-Loop Systems with Neural Network Controllers via Semidefinite Programmingcited by 43
- 2019An Inductive Synthesis Framework for Verifiable Reinforcement Learningcited by 39
- 2020Reachable Polyhedral Marching (RPM): A Safety Verification Algorithm for Robotic Systems with Deep Neural Network Componentscited by 36
- 2017Output Range Analysis for Deep Neural Networkscited by 30
- 2018Efficient Bayesian Inference of Sigmoidal Gaussian Cox Processescited by 16
- 2019PyDEns: a Python Framework for Solving Differential Equations with Neural Networkscited by 14
- 2019Data-Driven Reachable Set Computation using Adaptive Gaussian Process Classification and Monte Carlo Methodscited by 14
- 2019TIRA: Toolbox for Interval Reachability Analysiscited by 12
- 2020Reachability Analysis for Feed-Forward Neural Networks using Face Latticescited by 11
- 2020Sampling-based Reachability Analysis: A Random Set Theory Approach with Adversarial Samplingcited by 11
- 2021Efficient Reachability Analysis of Closed-Loop Systems with Neural Network Controllerscited by 10
- 2013Technical Report: Convex Optimization of Nonlinear Feedback Controllers via Occupation Measurescited by 8
- 2020PAC Model Checking of Black-Box Continuous-Time Dynamical Systemscited by 8
- 2021Data-Driven Set-Based Estimation using Matrix Zonotopes with Set Containment Guaranteescited by 6
- 2019Online monitoring for safe pedestrian-vehicle interactionscited by 5
- 2017Lagrangian Reachabililtycited by 3
- 2020State-Based Confidence Bounds for Data-Driven Stochastic Reachability Using Hilbert Space Embeddingscited by 3
- 2014Approximation of reachable sets using optimal control and support vector machinescited by 2
- 2019Optimal Safe Controller Synthesis: A Density Function Approachcited by 2
- 2020Data-Driven Approach for Uncertainty Propagation and Reachability Analysis in Dynamical Systemscited by 2
- 2019Density Propagation with Characteristics-based Deep Learningcited by 1
Built on by
Citing papers per year: 2021: 1; 2022: 5; 2023: 1; 2024: 3; 2025: 1.
11 papers.
- 2022The Third International Verification of Neural Networks Competition (VNN-COMP 2022): Summary and Resultscited by 39
- 2022Statistical Safety and Robustness Guarantees for Feedback Motion Planning of Unknown Underactuated Stochastic Systemscited by 11
- 2022Reachable Polyhedral Marching (RPM): An Exact Analysis Tool for Deep-Learned Control Systemscited by 6
- 2023NeuroCodeBench: a plain C neural network benchmark for software verificationcited by 3
- 2024Automated Repair of AI Code with Large Language Models and Formal Verificationcited by 3
- 2024Transport of Algebraic Structure to Latent Embeddingscited by 2
- 2025Floating-Point Neural Network Verification at the Software Levelcited by 2
- 2022Case Studies for Computing Density of Reachable States for Safe Autonomous Motion Planningcited by 1
- 2021Data-driven Set-based Estimation of Polynomial Systems with Application to SIR Epidemicscited by 0
- 2022NExG: Provable and Guided State Space Exploration of Neural Network Control Systems using Sensitivity Approximationcited by 0
- 2024Predicting AI Agent Behavior through Approximation of the Perron-Frobenius Operatorcited by 0
- 2025Floating-Point Neural Network Verification at the Software Level27 Oct 2025
- 2024Predicting AI Agent Behavior through Approximation of the Perron-Frobenius Operator4 Jun 2024
- 2024Transport of Algebraic Structure to Latent Embeddings27 May 2024
- 2024Automated Repair of AI Code with Large Language Models and Formal Verification14 May 2024
- 2023NeuroCodeBench: a plain C neural network benchmark for software verification7 Sep 2023
- 2022The Third International Verification of Neural Networks Competition (VNN-COMP 2022): Summary and Results20 Dec 2022
- 2022Statistical Safety and Robustness Guarantees for Feedback Motion Planning of Unknown Underactuated Stochastic Systems13 Dec 2022
- 2022Reachable Polyhedral Marching (RPM): An Exact Analysis Tool for Deep-Learned Control Systems15 Oct 2022
- 2022Case Studies for Computing Density of Reachable States for Safe Autonomous Motion Planning16 Sep 2022
- 2022NExG: Provable and Guided State Space Exploration of Neural Network Control Systems using Sensitivity Approximation8 Jul 2022
- 2021Data-driven Set-based Estimation of Polynomial Systems with Application to SIR Epidemics8 Nov 2021