Reach-Avoid Problems with Time-Varying Dynamics, Targets and Constraints
Not on the map. Why?
Abstract (arXiv)
We consider a reach-avoid differential game, in which one of the players aims to steer the system into a target set without violating a set of state constraints, while the other player tries to prevent the first from succeeding; the system dynamics, target set, and state constraints may all be time-varying. The analysis of this problem plays an important role in collision avoidance, motion planning and aircraft control, among other applications. Previous methods for computing the guaranteed winning initial conditions and strategies for each player have either required augmenting the state vector to include time, or have been limited to problems with either no state constraints or entirely static targets, constraints and dynamics. To incorporate time-varying dynamics, targets and constraints without the need for state augmentation, we propose a modified Hamilton-Jacobi-Isaacs equation in the form of a double-obstacle variational inequality, and prove that the zero sublevel set of its viscosity solution characterizes the capture basin for the target under the state constraints. Through this formulation, our method can compute the capture basin and winning strategies for time-varying games at no additional computational cost with respect to the time-invariant case. We provide an implementation of this method based on well-known numerical schemes and show its convergence through a simple example; we include a second example in which our method substantially outperforms the state augmentation approach.
Key facts. Cited by 41 papers in the map (data through 7 Oct 2026). First posted on arXiv 23 Oct 2014.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 8; 2022: 6; 2023: 5; 2024: 10; 2025: 10; 2026: 2.
41 papers.
Sort:
By area:
- 2023The Safety Filter: A Unified View of Safety-Critical Control in Autonomous Systemscited by 77
- 2024Agile But Safe: Learning Collision-Free High-Speed Legged Locomotioncited by 53
- 2025Generalizing Safety Beyond Collision-Avoidance via Latent-Space Reachability Analysiscited by 44
- 2021Safety and Liveness Guarantees through Reach-Avoid Reinforcement Learningcited by 43
- 2023Iterative Reachability Estimation for Safe Reinforcement Learningcited by 33
- 2022Sim-to-Lab-to-Real: Safe Reinforcement Learning with Shielding and Generalization Guaranteescited by 24
- 2022ISAACS: Iterative Soft Adversarial Actor-Critic for Safetycited by 24
- 2021Safe Occlusion-aware Autonomous Driving via Game-Theoretic Active Perceptioncited by 22
- 2022Safe Model-Based Reinforcement Learning with an Uncertainty-Aware Reachability Certificatecited by 16
- 2024Formally Verifying Deep Reinforcement Learning Controllers with Lyapunov Barrier Certificatescited by 15
- 2021Risk-averse autonomous systems: A brief history and recent developments from the perspective of optimal controlcited by 12
- 2024Gameplay Filters: Robust Zero-Shot Safety through Adversarial Imaginationcited by 12
29 more
- 2022Probabilities Are Not Enough: Formal Controller Synthesis for Stochastic Dynamical Models with Epistemic Uncertaintycited by 11
- 2024Hamilton-Jacobi Reachability in Reinforcement Learning: A Surveycited by 11
- 2021Scalable Learning of Safety Guarantees for Autonomous Systems using Hamilton-Jacobi Reachabilitycited by 10
- 2025Real-Time Out-of-Distribution Failure Prevention via Multi-Modal Reasoningcited by 10
- 2023Deception Game: Closing the Safety-Learning Loop in Interactive Robot Autonomycited by 9
- 2021Analyzing Human Models that Adapt Onlinecited by 8
- 2024To the Max: Reinventing Reward in Reinforcement Learningcited by 7
- 2024Human-AI Safety: A Descendant of Generative AI and Control Systems Safetycited by 7
- 2022Infinite-Horizon Reach-Avoid Zero-Sum Games via Deep Reinforcement Learningcited by 6
- 2021Correct-by-construction reach-avoid control of partially observable linear stochastic systemscited by 5
- 2024Safe and Reliable Training of Learning-Based Aerospace Controllerscited by 4
- 2021Deep Reinforcement Learning-based UAV Navigation and Control: A Soft Actor-Critic with Hindsight Experience Replay Approachcited by 3
- 2022A Survey of Decision Making in Adversarial Gamescited by 3
- 2024Pontryagin Neural Operator for Solving Parametric General-Sum Differential Gamescited by 3
- 2025Verifiable Safety Q-Filters via Hamilton-Jacobi Reachability and Multiplicative Q-Networkscited by 3
- 2025Residual Neural Terminal Constraint for MPC-based Collision Avoidance in Dynamic Environmentscited by 3
- 2021Towards Data-Driven Synthesis of Autonomous Vehicle Safety Conceptscited by 2
- 2025Your Learned Constraint is Secretly a Backward Reachable Tubecited by 2
- 2025Dual-Objective Reinforcement Learning with Novel Hamilton-Jacobi-Bellman Formulationscited by 2
- 2025Hierarchical Vision Language Action Model Using Success and Failure Demonstrationscited by 2
- 2025From Refusal to Recovery: A Control-Theoretic Approach to Generative AI Guardrailscited by 1
- 2026Value Functions for Temporal Logic: Optimal Policies and Safety Filterscited by 1
- 2023Learned Risk Metric Maps for Kinodynamic Systemscited by 0
- 2023Correct-by-Construction Control for Stochastic and Uncertain Dynamical Models via Formal Abstractionscited by 0
- 2024Tackling Decision Processes with Non-Cumulative Objectives using Reinforcement Learningcited by 0
- 2024Gait Switching and Enhanced Stabilization of Walking Robots with Deep Learning-based Reachability: A Case Study on Two-link Walkercited by 0
- 2025Neural Network-assisted Interval Reachability for Systems with Control Barrier Function-Based Safe Controllerscited by 0
- 2025Reach-Avoid Differential game with Reachability Analysis for UAVs: A decomposition approachcited by 0
- 2026TAIL-Safe: Task-Agnostic Safety Monitoring for Imitation Learning Policiescited by 0
- 2026TAIL-Safe: Task-Agnostic Safety Monitoring for Imitation Learning Policies2 May 2026
- 2026Value Functions for Temporal Logic: Optimal Policies and Safety Filters1 May 2026
- 2025Reach-Avoid Differential game with Reachability Analysis for UAVs: A decomposition approach28 Dec 2025
- 2025Hierarchical Vision Language Action Model Using Success and Failure Demonstrations3 Dec 2025
- 2025From Refusal to Recovery: A Control-Theoretic Approach to Generative AI Guardrails15 Oct 2025
- 2025Residual Neural Terminal Constraint for MPC-based Collision Avoidance in Dynamic Environments5 Aug 2025
- 2025Dual-Objective Reinforcement Learning with Novel Hamilton-Jacobi-Bellman Formulations19 Jun 2025
- 2025Verifiable Safety Q-Filters via Hamilton-Jacobi Reachability and Multiplicative Q-Networks27 May 2025
- 2025Real-Time Out-of-Distribution Failure Prevention via Multi-Modal Reasoning15 May 2025
- 2025Neural Network-assisted Interval Reachability for Systems with Control Barrier Function-Based Safe Controllers11 Apr 2025
- 2025Generalizing Safety Beyond Collision-Avoidance via Latent-Space Reachability Analysis2 Feb 2025
- 2025Your Learned Constraint is Secretly a Backward Reachable Tube26 Jan 2025
29 more
- 2024Gait Switching and Enhanced Stabilization of Walking Robots with Deep Learning-based Reachability: A Case Study on Two-link Walker10 Sep 2024
- 2024Hamilton-Jacobi Reachability in Reinforcement Learning: A Survey12 Jul 2024
- 2024Safe and Reliable Training of Learning-Based Aerospace Controllers9 Jul 2024
- 2024Formally Verifying Deep Reinforcement Learning Controllers with Lyapunov Barrier Certificates22 May 2024
- 2024Tackling Decision Processes with Non-Cumulative Objectives using Reinforcement Learning22 May 2024
- 2024Human-AI Safety: A Descendant of Generative AI and Control Systems Safety16 May 2024
- 2024Gameplay Filters: Robust Zero-Shot Safety through Adversarial Imagination1 May 2024
- 2024To the Max: Reinventing Reward in Reinforcement Learning2 Feb 2024
- 2024Agile But Safe: Learning Collision-Free High-Speed Legged Locomotion31 Jan 2024
- 2024Pontryagin Neural Operator for Solving Parametric General-Sum Differential Games3 Jan 2024
- 2023Correct-by-Construction Control for Stochastic and Uncertain Dynamical Models via Formal Abstractions16 Nov 2023
- 2023Iterative Reachability Estimation for Safe Reinforcement Learning24 Sep 2023
- 2023The Safety Filter: A Unified View of Safety-Critical Control in Autonomous Systems11 Sep 2023
- 2023Deception Game: Closing the Safety-Learning Loop in Interactive Robot Autonomy3 Sep 2023
- 2023Learned Risk Metric Maps for Kinodynamic Systems28 Feb 2023
- 2022ISAACS: Iterative Soft Adversarial Actor-Critic for Safety6 Dec 2022
- 2022Safe Model-Based Reinforcement Learning with an Uncertainty-Aware Reachability Certificate14 Oct 2022
- 2022Probabilities Are Not Enough: Formal Controller Synthesis for Stochastic Dynamical Models with Epistemic Uncertainty12 Oct 2022
- 2022A Survey of Decision Making in Adversarial Games16 Jul 2022
- 2022Infinite-Horizon Reach-Avoid Zero-Sum Games via Deep Reinforcement Learning18 Mar 2022
- 2022Sim-to-Lab-to-Real: Safe Reinforcement Learning with Shielding and Generalization Guarantees20 Jan 2022
- 2021Safety and Liveness Guarantees through Reach-Avoid Reinforcement Learning23 Dec 2021
- 2021Risk-averse autonomous systems: A brief history and recent developments from the perspective of optimal control18 Sep 2021
- 2021Towards Data-Driven Synthesis of Autonomous Vehicle Safety Concepts30 Jul 2021
- 2021Deep Reinforcement Learning-based UAV Navigation and Control: A Soft Actor-Critic with Hindsight Experience Replay Approach2 Jun 2021
- 2021Safe Occlusion-aware Autonomous Driving via Game-Theoretic Active Perception17 May 2021
- 2021Analyzing Human Models that Adapt Online9 Mar 2021
- 2021Correct-by-construction reach-avoid control of partially observable linear stochastic systems3 Mar 2021
- 2021Scalable Learning of Safety Guarantees for Autonomous Systems using Hamilton-Jacobi Reachability15 Jan 2021
- 2023The Safety Filter: A Unified View of Safety-Critical Control in Autonomous Systemscited by 77
- 2024Agile But Safe: Learning Collision-Free High-Speed Legged Locomotioncited by 53
- 2021Safety and Liveness Guarantees through Reach-Avoid Reinforcement Learningcited by 43
- 2023Iterative Reachability Estimation for Safe Reinforcement Learningcited by 33
- 2022Sim-to-Lab-to-Real: Safe Reinforcement Learning with Shielding and Generalization Guaranteescited by 24
- 2022ISAACS: Iterative Soft Adversarial Actor-Critic for Safetycited by 24
- 2022Safe Model-Based Reinforcement Learning with an Uncertainty-Aware Reachability Certificatecited by 16
- 2024Formally Verifying Deep Reinforcement Learning Controllers with Lyapunov Barrier Certificatescited by 15
- 2021Risk-averse autonomous systems: A brief history and recent developments from the perspective of optimal controlcited by 12
- 2024Gameplay Filters: Robust Zero-Shot Safety through Adversarial Imaginationcited by 12
- 2022Probabilities Are Not Enough: Formal Controller Synthesis for Stochastic Dynamical Models with Epistemic Uncertaintycited by 11
- 2024Hamilton-Jacobi Reachability in Reinforcement Learning: A Surveycited by 11
12 most cited of 36 All 36 (JSON)
- 2026Value Functions for Temporal Logic: Optimal Policies and Safety Filters1 May 2026
- 2025Reach-Avoid Differential game with Reachability Analysis for UAVs: A decomposition approach28 Dec 2025
- 2025Residual Neural Terminal Constraint for MPC-based Collision Avoidance in Dynamic Environments5 Aug 2025
- 2025Dual-Objective Reinforcement Learning with Novel Hamilton-Jacobi-Bellman Formulations19 Jun 2025
- 2025Verifiable Safety Q-Filters via Hamilton-Jacobi Reachability and Multiplicative Q-Networks27 May 2025
- 2025Real-Time Out-of-Distribution Failure Prevention via Multi-Modal Reasoning15 May 2025
- 2025Neural Network-assisted Interval Reachability for Systems with Control Barrier Function-Based Safe Controllers11 Apr 2025
- 2025Your Learned Constraint is Secretly a Backward Reachable Tube26 Jan 2025
- 2024Gait Switching and Enhanced Stabilization of Walking Robots with Deep Learning-based Reachability: A Case Study on Two-link Walker10 Sep 2024
- 2024Hamilton-Jacobi Reachability in Reinforcement Learning: A Survey12 Jul 2024
- 2024Safe and Reliable Training of Learning-Based Aerospace Controllers9 Jul 2024
- 2024Formally Verifying Deep Reinforcement Learning Controllers with Lyapunov Barrier Certificates22 May 2024
12 newest of 36 All 36 (JSON)