mlsanityData to 14 Oct 2026

Optimization of the Model Predictive Control Meta-Parameters Through Reinforcement Learning

arXiv 2111.04146 ↗First posted 7 Nov 2021eess.SY cs.LG cs.ROcited by 7

Not on the map. Why?

Abstract (arXiv)

Model predictive control (MPC) is increasingly being considered for control of fast systems and embedded applications. However, the MPC has some significant challenges for such systems. Its high computational complexity results in high power consumption from the control algorithm, which could account for a significant share of the energy resources in battery-powered embedded systems. The MPC parameters must be tuned, which is largely a trial-and-error process that affects the control performance, the robustness and the computational complexity of the controller to a high degree. In this paper, we propose a novel framework in which any parameter of the control algorithm can be jointly tuned using reinforcement learning(RL), with the goal of simultaneously optimizing the control performance and the power usage of the control algorithm. We propose the novel idea of optimizing the meta-parameters of MPCwith RL, i.e. parameters affecting the structure of the MPCproblem as opposed to the solution to a given problem. Our control algorithm is based on an event-triggered MPC where we learn when the MPC should be re-computed, and a dual mode MPC and linear state feedback control law applied in between MPC computations. We formulate a novel mixture-distribution policy and show that with joint optimization we achieve improvements that do not present themselves when optimizing the same parameters in isolation. We demonstrate our framework on the inverted pendulum control task, reducing the total computation time of the control system by 36% while also improving the control performance by 18.4% over the best-performing MPC baseline.

Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 13 of its 49 references that are in the map. First posted on arXiv 7 Nov 2021.

Builds on

13 of 49 references.

References · 13

  1. 2017Proximal Policy Optimization Algorithmscited by 15,215
  2. 2018Differentiable MPC for End-to-end Planning and Controlcited by 189
  3. 2017A General Safety Framework for Learning-Based Control in Uncertain Robotic Systemscited by 163
  4. 2018Plan Online, Learn Offline: Efficient Learning and Exploration via Model-Based Controlcited by 113
  5. 2019Data-driven Economic NMPC using Reinforcement Learningcited by 68
  6. 2020Safe Reinforcement Learning via Projection on a Safe Set: How to Achieve Optimality?cited by 34
  7. 2019Performance-oriented model learning for data-driven MPC designcited by 22
  8. 2017Goal-Driven Dynamics Learning via Bayesian Optimizationcited by 19
  9. 2021An Analysis of Frame-skipping in Reinforcement Learningcited by 18
  10. 2021Reinforcement Learning of the Prediction Horizon in Model Predictive Controlcited by 10
  11. 2021Reinforcement Learning based on MPC/MHE for Unmodeled and Partially Observable Dynamicscited by 5
  12. 2016Adaptive Horizon Model Predictive Controlcited by 4
1 more
  1. 2020Optimization of the Model Predictive Control Update Interval Using Reinforcement Learningcited by 2

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2023: 3; 2024: 1; 2025: 1; 2026: 2.

7 papers.

  1. 2024A Safe Reinforcement Learning driven Weights-varying Model Predictive Control for Autonomous Vehicle Motion Controlcited by 7
  2. 2023Adaptive Stochastic Nonlinear Model Predictive Control with Look-ahead Deep Reinforcement Learning for Autonomous Vehicle Motion Controlcited by 6
  3. 2023Suboptimality analysis of receding horizon quadratic control with unknown linear systems and its applications in learning-based controlcited by 1
  4. 2023Combining model-predictive control and predictive reinforcement learning for stable quadrupedal robot locomotioncited by 0
  5. 2025Model-free Reinforcement Learning for Model-based Control: Towards Safe, Interpretable and Sample-efficient Agentscited by 0
  6. 2026A Systematic Review and Taxonomy of Reinforcement Learning-Model Predictive Control Integration for Linear Systemscited by 0
  7. 2026Accelerating Reinforcement Learning via MPC Solver-Gradient Guidance for Weights-varying MPCcited by 0