Learning Disturbances Online for Risk-Aware Control: Risk-Aware Flight with Less Than One Minute of Data
Not on the map. Why?
Abstract (arXiv)
Recent advances in safety-critical risk-aware control are predicated on apriori knowledge of the disturbances a system might face. This paper proposes a method to efficiently learn these disturbances online, in a risk-aware context. First, we introduce the concept of a Surface-at-Risk, a risk measure for stochastic processes that extends Value-at-Risk -- a commonly utilized risk measure in the risk-aware controls community. Second, we model the norm of the state discrepancy between the model and the true system evolution as a scalar-valued stochastic process and determine an upper bound to its Surface-at-Risk via Gaussian Process Regression. Third, we provide theoretical results on the accuracy of our fitted surface subject to mild assumptions that are verifiable with respect to the data sets collected during system operation. Finally, we experimentally verify our procedure by augmenting a drone's controller and highlight performance increases achieved via our risk-aware approach after collecting less than a minute of operating data.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 23 of its 41 references that are in the map. First posted on arXiv 12 Dec 2022.
Builds on
23 of 41 references.
References · 23
- 2017On Kernelized Multi-armed Banditscited by 348
- 2015Risk-Constrained Reinforcement Learning with Percentile Risk Criteriacited by 320
- 2018Residual Reinforcement Learning for Robot Controlcited by 242
- 2019TossingBot: Learning to Throw Arbitrary Objects with Residual Physicscited by 131
- 2013Risk-sensitive Reinforcement Learningcited by 129
- 2022Neural-Fly Enables Rapid Learning for Agile Flight in Strong Windscited by 80
- 2019Learning for Safety-Critical Control with Control Barrier Functionscited by 66
- 2017How Should a Robot Assess Risk? Towards an Axiomatic Theory of Risk in Roboticscited by 57
- 2020Bayesian Optimization of Risk Measurescited by 35
- 2017Safe Learning of Quadrotor Dynamics Using Barrier Certificatescited by 32
- 2019Actively Learning Gaussian Process Dynamicscited by 26
- 2020Autonomous Spot: Long-Range Autonomous Exploration of Extreme Environments with Legged Locomotioncited by 18
11 more
- 2021Risk-averse Heteroscedastic Bayesian Optimizationcited by 17
- 2021Safe Learning and Optimization Techniques: Towards a Survey of the State of the Artcited by 16
- 2020Constrained Risk-Averse Markov Decision Processescited by 15
- 2018Input-to-State Safety With Control Barrier Functionscited by 10
- 2020Risk-Sensitive Motion Planning using Entropic Value-at-Riskcited by 7
- 2021Safe Controller Synthesis with Tunable Input-to-State Safe Control Barrier Functionscited by 5
- 2021Reactive and Risk-Aware Control for Signal Temporal Logiccited by 5
- 2021Verifying Safe Transitions between Dynamic Motion Primitives on Legged Robotscited by 3
- 2022Sample-Based Bounds for Coherent Risk Measures: Applications to Policy Synthesis and Verificationcited by 3
- 2020Risk-Averse Planning via CVaR Barrier Functions: Application to Bipedal Robot Locomotioncited by 2
- 2022Safety-Critical Controller Verification via Sim2Real Gap Quantificationcited by 1
Built on by
Not cited yet.