Adaptive-Control-Oriented Meta-Learning for Nonlinear Systems
Not on the map. Why?
Abstract (arXiv)
Real-time adaptation is imperative to the control of robots operating in complex, dynamic environments. Adaptive control laws can endow even nonlinear systems with good trajectory tracking performance, provided that any uncertain dynamics terms are linearly parameterizable with known nonlinear features. However, it is often difficult to specify such features a priori, such as for aerodynamic disturbances on rotorcraft or interaction forces between a manipulator arm and various objects. In this paper, we turn to data-driven modeling with neural networks to learn, offline from past data, an adaptive controller with an internal parametric model of these nonlinear features. Our key insight is that we can better prepare the controller for deployment with control-oriented meta-learning of features in closed-loop simulation, rather than regression-oriented meta-learning of features to fit input-output data. Specifically, we meta-learn the adaptive controller with closed-loop tracking simulation as the base-learner and the average tracking error as the meta-objective. With a nonlinear planar rotorcraft subject to wind, we demonstrate that our adaptive controller outperforms other controllers trained with regression-oriented meta-learning when deployed in closed-loop for trajectory tracking control.
Key facts. Cited by 38 papers in the map (data through 7 Oct 2026). Builds on 35 of its 84 references that are in the map. First posted on arXiv 7 Mar 2021.
Builds on
35 of 84 references.
References · 35
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,861
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,888
- 2018Neural Ordinary Differential Equationscited by 3,733
- 2020Meta-Learning in Neural Networks: A Surveycited by 944
- 2019Meta-Learning with Implicit Gradientscited by 523
- 2019Meta-Learning with Differentiable Convex Optimizationcited by 461
- 2018Meta-learning with differentiable closed-form solverscited by 395
- 2018Learning to Adapt in Dynamic, Real-World Environments Through Meta-Reinforcement Learningcited by 270
- 2018Model-Ensemble Trust-Region Policy Optimizationcited by 214
- 2018Differentiable MPC for End-to-end Planning and Controlcited by 178
- 2020Neural Lyapunov Controlcited by 142
23 more
- 2016EPOpt: Learning Robust Neural Network Policies Using Model Ensemblescited by 136
- 2018Model-Based Reinforcement Learning via Meta-Policy Optimizationcited by 99
- 2018The Lyapunov Neural Network: Adaptive Stability Certification for Safe Learning of Dynamical Systemscited by 87
- 2020Adaptive Checkpoint Adjoint Method for Gradient Estimation in Neural ODEcited by 76
- 2020Learning Certified Control using Contraction Metriccited by 48
- 2018Meta-Learning Priors for Efficient Online Bayesian Regressioncited by 47
- 2020Learning Stability Certificates from Datacited by 45
- 2019Stochastic Mirror Descent on Overparameterized Nonlinear Models: Convergence, Implicit Regularization, and Generalizationcited by 40
- 2015Control Contraction Metrics: Convex and Intrinsic Criteria for Nonlinear Feedback Designcited by 38
- 2019Learning Stabilizable Nonlinear Dynamics with Contraction-Based Regularizationcited by 32
- 2019Learning Convex Optimization Control Policiescited by 31
- 2018Stochastic Gradient/Mirror Descent: Minimax Optimality and Implicit Regularizationcited by 29
- 2020Model-Based Meta-Reinforcement Learning for Flight with Suspended Payloadscited by 27
- 2018Beyond Convexity -- Contraction and Global Convergence of Gradient Descentcited by 17
- 2018Adaptive MPC for Iterative Taskscited by 15
- 2019Deep Model Reference Adaptive Controlcited by 14
- 2020Asynchronous Deep Model Reference Adaptive Controlcited by 13
- 2017Linear Matrix Inequalities for Physically-Consistent Inertial Parameter Identification: A Statistical Perspective on the Mass Distributioncited by 11
- 2021Meta-Learning-Based Robust Adaptive Flight Control Under Uncertain Wind Conditionscited by 8
- 2019A robust adaptive model predictive control framework for nonlinear uncertain systemscited by 7
- 2019Implicit Regularization and Momentum Algorithms in Nonlinearly Parameterized Adaptive Control and Predictioncited by 7
- 2018Voliro: An Omnidirectional Hexacopter With Tiltable Rotorscited by 6
- 2020Automatic Differentiation and Continuous Sensitivity Analysis of Rigid Body Dynamicscited by 4
Built on by
Citing papers per year: 2021: 4; 2022: 11; 2023: 11; 2024: 7; 2025: 3; 2026: 2.
38 papers.
Sort:
By area:
- 2022Neural-Fly Enables Rapid Learning for Agile Flight in Strong Windscited by 80
- 2023Finetuning Offline World Models in the Real Worldcited by 39
- 2022A System-Level View on Out-of-Distribution Data in Roboticscited by 33
- 2023Physics-Informed Machine Learning for Modeling and Control of Dynamical Systemscited by 28
- 2024ASID: Active Exploration for System Identification in Robotic Manipulationcited by 27
- 2021Meta-Adaptive Nonlinear Control: Theory and Algorithmscited by 23
- 2022Multi-Task Imitation Learning for Linear Dynamical Systemscited by 22
- 2022Control-oriented meta-learningcited by 17
- 2023Optimal Exploration for Model-Based RL in Nonlinear Systemscited by 17
- 2023Sample-Efficient Linear Representation Learning from Non-IID Non-Isotropic Datacited by 12
- 2022Meta-Learning of Neural State-Space Models Using Data From Similar Systemscited by 11
- 2021Adaptive Robust Model Predictive Control with Matched and Unmatched Uncertaintycited by 7
26 more
- 2021Adaptive Control of SE(3) Hamiltonian Dynamics with Learned Disturbance Featurescited by 6
- 2023Data-Driven Control with Inherent Lyapunov Stabilitycited by 6
- 2022Optimizing Closed-Loop Performance with Data from Similar Systems: A Bayesian Meta-Learning Approachcited by 5
- 2023Learning Control-Oriented Dynamical Structure from Datacited by 5
- 2023Safe Navigation in Unstructured Environments by Minimizing Uncertainty in Control and Perceptioncited by 5
- 2023On the adaptation of in-context learners for system identificationcited by 5
- 2024Projected Neural Differential Equations for Learning Constrained Dynamicscited by 5
- 2025Meta-Learning for Physically-Constrained Neural System Identificationcited by 5
- 2022Meta-SysId: A Meta-Learning Approach for Simultaneous Identification and Predictioncited by 3
- 2021Online Algorithms and Policies Using Adaptive and Machine Learning Approachescited by 2
- 2022Adaptive Asynchronous Control Using Meta-learned Neural Ordinary Differential Equationscited by 2
- 2022Neural-Rendezvous: Provably Robust Guidance and Control to Encounter Interstellar Objectscited by 2
- 2022Graph Neural Network Expressivity and Meta-Learning for Molecular Property Regressioncited by 2
- 2024Combining Federated Learning and Control: A Surveycited by 2
- 2024Predictive Control and Regret Analysis of Non-Stationary MDP with Look-ahead Informationcited by 2
- 2025Context-Aware Deep Lagrangian Networks for Model Predictive Controlcited by 2
- 2022Adaptive Robust Model Predictive Control via Uncertainty Cancellationcited by 1
- 2023Model-Assisted Probabilistic Safe Adaptive Control With Meta-Bayesian Learningcited by 1
- 2024LeARN: Learnable and Adaptive Representations for Nonlinear Dynamics in System Identificationcited by 1
- 2023Efficient Deep Learning of Robust, Adaptive Policies using Tube MPC-Guided Data Augmentationcited by 0
- 2023A Reinforcement Learning Approach for Robust Supervisory Control of UAVs Under Disturbancescited by 0
- 2024Proto-MPC: An Encoder-Prototype-Decoder Approach for Quadrotor Control in Challenging Windscited by 0
- 2024Extremum-Seeking Action Selection for Accelerating Policy Optimizationcited by 0
- 2025Adaptive MPC-based quadrupedal robot control under periodic disturbancescited by 0
- 2026T2S-MPC: Time-Embedded Online Adaptive Model Predictive Control for Time-Varying Dynamicscited by 0
- 2026Neural ODEs Meet Concurrent Learning: Stable Online Learning with Lyapunov Guaranteescited by 0
- 2026Neural ODEs Meet Concurrent Learning: Stable Online Learning with Lyapunov Guarantees26 Sep 2026
- 2026T2S-MPC: Time-Embedded Online Adaptive Model Predictive Control for Time-Varying Dynamics24 May 2026
- 2025Context-Aware Deep Lagrangian Networks for Model Predictive Control18 Jun 2025
- 2025Adaptive MPC-based quadrupedal robot control under periodic disturbances18 May 2025
- 2025Meta-Learning for Physically-Constrained Neural System Identification10 Jan 2025
- 2024LeARN: Learnable and Adaptive Representations for Nonlinear Dynamics in System Identification16 Dec 2024
- 2024Projected Neural Differential Equations for Learning Constrained Dynamics31 Oct 2024
- 2024Predictive Control and Regret Analysis of Non-Stationary MDP with Look-ahead Information13 Sep 2024
- 2024Combining Federated Learning and Control: A Survey12 Jul 2024
- 2024ASID: Active Exploration for System Identification in Robotic Manipulation18 Apr 2024
- 2024Extremum-Seeking Action Selection for Accelerating Policy Optimization2 Apr 2024
- 2024Proto-MPC: An Encoder-Prototype-Decoder Approach for Quadrotor Control in Challenging Winds27 Jan 2024
26 more
- 2023On the adaptation of in-context learners for system identification7 Dec 2023
- 2023Finetuning Offline World Models in the Real World24 Oct 2023
- 2023Sample-Efficient Linear Representation Learning from Non-IID Non-Isotropic Data8 Aug 2023
- 2023Model-Assisted Probabilistic Safe Adaptive Control With Meta-Bayesian Learning3 Jul 2023
- 2023Safe Navigation in Unstructured Environments by Minimizing Uncertainty in Control and Perception26 Jun 2023
- 2023Physics-Informed Machine Learning for Modeling and Control of Dynamical Systems24 Jun 2023
- 2023Optimal Exploration for Model-Based RL in Nonlinear Systems15 Jun 2023
- 2023A Reinforcement Learning Approach for Robust Supervisory Control of UAVs Under Disturbances21 May 2023
- 2023Efficient Deep Learning of Robust, Adaptive Policies using Tube MPC-Guided Data Augmentation28 Mar 2023
- 2023Data-Driven Control with Inherent Lyapunov Stability6 Mar 2023
- 2023Learning Control-Oriented Dynamical Structure from Data6 Feb 2023
- 2022A System-Level View on Out-of-Distribution Data in Robotics28 Dec 2022
- 2022Adaptive Robust Model Predictive Control via Uncertainty Cancellation2 Dec 2022
- 2022Multi-Task Imitation Learning for Linear Dynamical Systems1 Dec 2022
- 2022Meta-Learning of Neural State-Space Models Using Data From Similar Systems14 Nov 2022
- 2022Optimizing Closed-Loop Performance with Data from Similar Systems: A Bayesian Meta-Learning Approach31 Oct 2022
- 2022Graph Neural Network Expressivity and Meta-Learning for Molecular Property Regression24 Sep 2022
- 2022Neural-Rendezvous: Provably Robust Guidance and Control to Encounter Interstellar Objects9 Aug 2022
- 2022Adaptive Asynchronous Control Using Meta-learned Neural Ordinary Differential Equations25 Jul 2022
- 2022Meta-SysId: A Meta-Learning Approach for Simultaneous Identification and Prediction1 Jun 2022
- 2022Neural-Fly Enables Rapid Learning for Agile Flight in Strong Winds13 May 2022
- 2022Control-oriented meta-learning14 Apr 2022
- 2021Adaptive Control of SE(3) Hamiltonian Dynamics with Learned Disturbance Features21 Sep 2021
- 2021Meta-Adaptive Nonlinear Control: Theory and Algorithms11 Jun 2021
- 2021Online Algorithms and Policies Using Adaptive and Machine Learning Approaches13 May 2021
- 2021Adaptive Robust Model Predictive Control with Matched and Unmatched Uncertainty16 Apr 2021
- 2022Multi-Task Imitation Learning for Linear Dynamical Systemscited by 22
- 2023Finetuning Offline World Models in the Real Worldcited by 39
- 2023Finetuning Offline World Models in the Real World24 Oct 2023
- 2022Neural-Fly Enables Rapid Learning for Agile Flight in Strong Windscited by 80
- 2022A System-Level View on Out-of-Distribution Data in Roboticscited by 33
- 2023Physics-Informed Machine Learning for Modeling and Control of Dynamical Systemscited by 28
- 2024ASID: Active Exploration for System Identification in Robotic Manipulationcited by 27
- 2021Meta-Adaptive Nonlinear Control: Theory and Algorithmscited by 23
- 2022Control-oriented meta-learningcited by 17
- 2023Optimal Exploration for Model-Based RL in Nonlinear Systemscited by 17
- 2023Sample-Efficient Linear Representation Learning from Non-IID Non-Isotropic Datacited by 12
- 2022Meta-Learning of Neural State-Space Models Using Data From Similar Systemscited by 11
- 2021Adaptive Robust Model Predictive Control with Matched and Unmatched Uncertaintycited by 7
- 2021Adaptive Control of SE(3) Hamiltonian Dynamics with Learned Disturbance Featurescited by 6
- 2023Data-Driven Control with Inherent Lyapunov Stabilitycited by 6
12 most cited of 36 All 36 (JSON)
- 2026Neural ODEs Meet Concurrent Learning: Stable Online Learning with Lyapunov Guarantees26 Sep 2026
- 2026T2S-MPC: Time-Embedded Online Adaptive Model Predictive Control for Time-Varying Dynamics24 May 2026
- 2025Context-Aware Deep Lagrangian Networks for Model Predictive Control18 Jun 2025
- 2025Adaptive MPC-based quadrupedal robot control under periodic disturbances18 May 2025
- 2025Meta-Learning for Physically-Constrained Neural System Identification10 Jan 2025
- 2024LeARN: Learnable and Adaptive Representations for Nonlinear Dynamics in System Identification16 Dec 2024
- 2024Projected Neural Differential Equations for Learning Constrained Dynamics31 Oct 2024
- 2024Predictive Control and Regret Analysis of Non-Stationary MDP with Look-ahead Information13 Sep 2024
- 2024Combining Federated Learning and Control: A Survey12 Jul 2024
- 2024ASID: Active Exploration for System Identification in Robotic Manipulation18 Apr 2024
- 2024Extremum-Seeking Action Selection for Accelerating Policy Optimization2 Apr 2024
- 2024Proto-MPC: An Encoder-Prototype-Decoder Approach for Quadrotor Control in Challenging Winds27 Jan 2024
12 newest of 36 All 36 (JSON)