Control-oriented meta-learning
Not on the map. Why?
Abstract (arXiv)
Real-time adaptation is imperative to the control of robots operating in complex, dynamic environments. Adaptive control laws can endow even nonlinear systems with good trajectory tracking performance, provided that any uncertain dynamics terms are linearly parameterizable with known nonlinear features. However, it is often difficult to specify such features a priori, such as for aerodynamic disturbances on rotorcraft or interaction forces between a manipulator arm and various objects. In this paper, we turn to data-driven modeling with neural networks to learn, offline from past data, an adaptive controller with an internal parametric model of these nonlinear features. Our key insight is that we can better prepare the controller for deployment with control-oriented meta-learning of features in closed-loop simulation, rather than regression-oriented meta-learning of features to fit input-output data. Specifically, we meta-learn the adaptive controller with closed-loop tracking simulation as the base-learner and the average tracking error as the meta-objective. With both fully-actuated and underactuated nonlinear planar rotorcraft subject to wind, we demonstrate that our adaptive controller outperforms other controllers trained with regression-oriented meta-learning when deployed in closed-loop for trajectory tracking control.
Key facts. Cited by 17 papers in the map (data through 14 Oct 2026). Builds on 38 of its 110 references that are in the map. First posted on arXiv 14 Apr 2022.
Builds on
38 of 110 references.
References · 38
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2017Model-Agnostic Meta-Learning for Fast Adaptation of Deep Networkscited by 4,897
- 2016Simple and Scalable Predictive Uncertainty Estimation using Deep Ensemblescited by 3,926
- 2018Neural Ordinary Differential Equationscited by 3,779
- 2020Meta-Learning in Neural Networks: A Surveycited by 950
- 2019Meta-Learning with Implicit Gradientscited by 525
- 2019Meta-Learning with Differentiable Convex Optimizationcited by 461
- 2018Meta-learning with differentiable closed-form solverscited by 397
- 2018Learning to Adapt in Dynamic, Real-World Environments Through Meta-Reinforcement Learningcited by 276
- 2018Model-Ensemble Trust-Region Policy Optimizationcited by 219
- 2018Differentiable MPC for End-to-end Planning and Controlcited by 189
- 2020Neural Lyapunov Controlcited by 142
26 more
- 2016EPOpt: Learning Robust Neural Network Policies Using Model Ensemblescited by 138
- 2018Model-Based Reinforcement Learning via Meta-Policy Optimizationcited by 101
- 2018The Lyapunov Neural Network: Adaptive Stability Certification for Safe Learning of Dynamical Systemscited by 88
- 2020Adaptive Checkpoint Adjoint Method for Gradient Estimation in Neural ODEcited by 76
- 2020Learning Certified Control using Contraction Metriccited by 49
- 2018Meta-Learning Priors for Efficient Online Bayesian Regressioncited by 48
- 2020Learning Stability Certificates from Datacited by 45
- 2019Stochastic Mirror Descent on Overparameterized Nonlinear Models: Convergence, Implicit Regularization, and Generalizationcited by 40
- 2015Control Contraction Metrics: Convex and Intrinsic Criteria for Nonlinear Feedback Designcited by 39
- 2021Adaptive-Control-Oriented Meta-Learning for Nonlinear Systemscited by 39
- 2019Learning Stabilizable Nonlinear Dynamics with Contraction-Based Regularizationcited by 32
- 2019Learning Convex Optimization Control Policiescited by 31
- 2020Model-Based Meta-Reinforcement Learning for Flight with Suspended Payloadscited by 30
- 2018Stochastic Gradient/Mirror Descent: Minimax Optimality and Implicit Regularizationcited by 29
- 2018Beyond Convexity -- Contraction and Global Convergence of Gradient Descentcited by 17
- 2018Adaptive MPC for Iterative Taskscited by 15
- 2019Deep Model Reference Adaptive Controlcited by 14
- 2020Asynchronous Deep Model Reference Adaptive Controlcited by 13
- 2017Linear Matrix Inequalities for Physically-Consistent Inertial Parameter Identification: A Statistical Perspective on the Mass Distributioncited by 12
- 2021Meta-Learning-Based Robust Adaptive Flight Control Under Uncertain Wind Conditionscited by 8
- 2021Nonparametric adaptive control and prediction: theory and randomized algorithmscited by 8
- 2019A robust adaptive model predictive control framework for nonlinear uncertain systemscited by 7
- 2019Implicit Regularization and Momentum Algorithms in Nonlinearly Parameterized Adaptive Control and Predictioncited by 7
- 2021Adaptive Robust Model Predictive Control with Matched and Unmatched Uncertaintycited by 7
- 2018Voliro: An Omnidirectional Hexacopter With Tiltable Rotorscited by 6
- 2020Automatic Differentiation and Continuous Sensitivity Analysis of Rigid Body Dynamicscited by 4
Built on by
Citing papers per year: 2022: 4; 2023: 3; 2024: 5; 2025: 3; 2026: 2.
17 papers.
Sort:
By area:
- 2022Multi-Task Imitation Learning for Linear Dynamical Systemscited by 23
- 2024Meta-Learning Linear Quadratic Regulators: A Policy Gradient MAML Approach for Model-free LQRcited by 17
- 2024Feedback Favors the Generalization of Neural ODEscited by 8
- 2023Data-Driven Control with Inherent Lyapunov Stabilitycited by 6
- 2023Learning Control-Oriented Dynamical Structure from Datacited by 5
- 2024Decision Transformer as a Foundation Model for Partially Observable Continuous Controlcited by 5
- 2022Tractable Uncertainty-Aware Meta-Learningcited by 4
- 2022Meta-SysId: A Meta-Learning Approach for Simultaneous Identification and Predictioncited by 3
- 2024Combining Federated Learning and Control: A Surveycited by 3
- 2024First, Learn What You Don't Know: Active Information Gathering for Driving at the Limits of Handlingcited by 3
- 2025Meta-Learning Online Dynamics Model Adaptation in Off-Road Autonomous Drivingcited by 3
- 2022Adaptive Asynchronous Control Using Meta-learned Neural Ordinary Differential Equationscited by 2
5 more
- 2025DiffCoord: Differentiable Coordination for Distributed Multi-Agent Trajectory Optimizationcited by 2
- 2025Personalized Collaborative Learning with Affinity-Based Variance Reductioncited by 1
- 2023META-SMGO-Delta: similarity as a prior in black-box optimizationcited by 0
- 2026APEX: Adaptive Policy Execution for Precise Manipulationcited by 0
- 2026Latent Lie-Poisson Neural Networks (LLPNNs): Discovering the motion of Lie-Poisson systems through observable data and latent dynamicscited by 0
- 2026Latent Lie-Poisson Neural Networks (LLPNNs): Discovering the motion of Lie-Poisson systems through observable data and latent dynamics31 Jul 2026
- 2026APEX: Adaptive Policy Execution for Precise Manipulation15 Jun 2026
- 2025Personalized Collaborative Learning with Affinity-Based Variance Reduction17 Oct 2025
- 2025DiffCoord: Differentiable Coordination for Distributed Multi-Agent Trajectory Optimization1 Sep 2025
- 2025Meta-Learning Online Dynamics Model Adaptation in Off-Road Autonomous Driving23 Apr 2025
- 2024First, Learn What You Don't Know: Active Information Gathering for Driving at the Limits of Handling31 Oct 2024
- 2024Feedback Favors the Generalization of Neural ODEs14 Oct 2024
- 2024Combining Federated Learning and Control: A Survey12 Jul 2024
- 2024Decision Transformer as a Foundation Model for Partially Observable Continuous Control3 Apr 2024
- 2024Meta-Learning Linear Quadratic Regulators: A Policy Gradient MAML Approach for Model-free LQR25 Jan 2024
- 2023META-SMGO-Delta: similarity as a prior in black-box optimization30 Apr 2023
- 2023Data-Driven Control with Inherent Lyapunov Stability6 Mar 2023
5 more
- 2023Learning Control-Oriented Dynamical Structure from Data6 Feb 2023
- 2022Multi-Task Imitation Learning for Linear Dynamical Systems1 Dec 2022
- 2022Tractable Uncertainty-Aware Meta-Learning4 Oct 2022
- 2022Adaptive Asynchronous Control Using Meta-learned Neural Ordinary Differential Equations25 Jul 2022
- 2022Meta-SysId: A Meta-Learning Approach for Simultaneous Identification and Prediction1 Jun 2022
- 2026APEX: Adaptive Policy Execution for Precise Manipulationcited by 0
- 2026APEX: Adaptive Policy Execution for Precise Manipulation15 Jun 2026
- 2024Feedback Favors the Generalization of Neural ODEscited by 8
- 2023Data-Driven Control with Inherent Lyapunov Stabilitycited by 6
- 2023Learning Control-Oriented Dynamical Structure from Datacited by 5
- 2022Tractable Uncertainty-Aware Meta-Learningcited by 4
- 2022Meta-SysId: A Meta-Learning Approach for Simultaneous Identification and Predictioncited by 3
- 2024Combining Federated Learning and Control: A Surveycited by 3
- 2024First, Learn What You Don't Know: Active Information Gathering for Driving at the Limits of Handlingcited by 3
- 2025Meta-Learning Online Dynamics Model Adaptation in Off-Road Autonomous Drivingcited by 3
- 2022Adaptive Asynchronous Control Using Meta-learned Neural Ordinary Differential Equationscited by 2
- 2025DiffCoord: Differentiable Coordination for Distributed Multi-Agent Trajectory Optimizationcited by 2
- 2025Personalized Collaborative Learning with Affinity-Based Variance Reductioncited by 1
- 2023META-SMGO-Delta: similarity as a prior in black-box optimizationcited by 0
12 most cited of 13 All 13 (JSON)
- 2026Latent Lie-Poisson Neural Networks (LLPNNs): Discovering the motion of Lie-Poisson systems through observable data and latent dynamics31 Jul 2026
- 2025Personalized Collaborative Learning with Affinity-Based Variance Reduction17 Oct 2025
- 2025DiffCoord: Differentiable Coordination for Distributed Multi-Agent Trajectory Optimization1 Sep 2025
- 2025Meta-Learning Online Dynamics Model Adaptation in Off-Road Autonomous Driving23 Apr 2025
- 2024First, Learn What You Don't Know: Active Information Gathering for Driving at the Limits of Handling31 Oct 2024
- 2024Feedback Favors the Generalization of Neural ODEs14 Oct 2024
- 2024Combining Federated Learning and Control: A Survey12 Jul 2024
- 2023META-SMGO-Delta: similarity as a prior in black-box optimization30 Apr 2023
- 2023Data-Driven Control with Inherent Lyapunov Stability6 Mar 2023
- 2023Learning Control-Oriented Dynamical Structure from Data6 Feb 2023
- 2022Tractable Uncertainty-Aware Meta-Learning4 Oct 2022
- 2022Adaptive Asynchronous Control Using Meta-learned Neural Ordinary Differential Equations25 Jul 2022
12 newest of 13 All 13 (JSON)