Bridging the Model-Reality Gap with Lipschitz Network Adaptation
Not on the map. Why?
Abstract (arXiv)
As robots venture into the real world, they are subject to unmodeled dynamics and disturbances. Traditional model-based control approaches have been proven successful in relatively static and known operating environments. However, when an accurate model of the robot is not available, model-based design can lead to suboptimal and even unsafe behaviour. In this work, we propose a method that bridges the model-reality gap and enables the application of model-based approaches even if dynamic uncertainties are present. In particular, we present a learning-based model reference adaptation approach that makes a robot system, with possibly uncertain dynamics, behave as a predefined reference model. In turn, the reference model can be used for model-based controller design. In contrast to typical model reference adaptation control approaches, we leverage the representative power of neural networks to capture highly nonlinear dynamics uncertainties and guarantee stability by encoding a certifying Lipschitz condition in the architectural design of a special type of neural network called the Lipschitz network. Our approach applies to a general class of nonlinear control-affine systems even when our prior knowledge about the true robot system is limited. We demonstrate our approach in flying inverted pendulum experiments, where an off-the-shelf quadrotor is challenged to balance an inverted pendulum while hovering or tracking circular trajectories.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 10 of its 32 references that are in the map. First posted on arXiv 7 Dec 2021.
Builds on
10 of 32 references.
References · 10
- 2017Sim-to-Real Transfer of Robotic Control with Dynamics Randomizationcited by 672
- 2021Safe Learning in Robotics: From Learning-Based Control to Safe Reinforcement Learningcited by 371
- 2019Efficient and Accurate Estimation of Lipschitz Constants for Deep Neural Networkscited by 293
- 2018Sorting out Lipschitz function approximationcited by 213
- 2018Neural Lander: Stable Drone Landing Control using Learned Dynamicscited by 85
- 2020Deep Reinforcement Learning amidst Lifelong Non-Stationaritycited by 43
- 2019Deep Model Reference Adaptive Controlcited by 14
- 2018Learn Fast, Forget Slow: Safe Predictive Learning Control for Systems with Unknown and Changing Dynamics Performing Repetitive Taskscited by 8
- 2020Experience Selection Using Dynamics Similarity for Efficient Multi-Source Transfer Learning Between Robotscited by 7
- 2019Knowledge Transfer Between Robots with Similar Dynamics for High-Accuracy Impromptu Trajectory Trackingcited by 1
Built on by
Citing papers per year: 2023: 2.
2 papers.