Learning-based MPC from Big Data Using Reinforcement Learning
Not on the map. Why?
Abstract (arXiv)
This paper presents an approach for learning Model Predictive Control (MPC) schemes directly from data using Reinforcement Learning (RL) methods. The state-of-the-art learning methods use RL to improve the performance of parameterized MPC schemes. However, these learning algorithms are often gradient-based methods that require frequent evaluations of computationally expensive MPC schemes, thereby restricting their use on big datasets. We propose to tackle this issue by using tools from RL to learn a parameterized MPC scheme directly from data in an offline fashion. Our approach derives an MPC scheme without having to solve it over the collected dataset, thereby eliminating the computational complexity of existing techniques for big data. We evaluate the proposed method on three simulated experiments of varying complexity.
Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 9 of its 16 references that are in the map. First posted on arXiv 4 Jan 2023.
Builds on
9 of 16 references.
References · 9
- 2015Continuous control with deep reinforcement learningcited by 3,279
- 2020Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problemscited by 1,873
- 2020Conservative Q-Learning for Offline Reinforcement Learningcited by 1,777
- 2020D4RL: Datasets for Deep Data-Driven Reinforcement Learningcited by 1,406
- 2020MOReL : Model-Based Offline Reinforcement Learningcited by 582
- 2019Data-driven Economic NMPC using Reinforcement Learningcited by 55
- 2021MPC-based Reinforcement Learning for Economic Problems with Application to Battery Storagecited by 7
- 2021MPC-based Reinforcement Learning for a Simplified Freight Mission of Autonomous Surface Vehiclescited by 5
- 2021Optimal Management of the Peak Power Penalty for Smart Grids Using MPC-based Reinforcement Learningcited by 3
Built on by
Citing papers per year: 2023: 1; 2024: 0; 2025: 2; 2026: 2.
5 papers.
- 2023Combining model-predictive control and predictive reinforcement learning for stable quadrupedal robot locomotioncited by 0
- 2025Mission-Aligned Learning-Informed Control of Autonomous Systems: Formulation and Foundationscited by 0
- 2025Model-free Reinforcement Learning for Model-based Control: Towards Safe, Interpretable and Sample-efficient Agentscited by 0
- 2026Towards Safe Learning-Based Non-Linear Model Predictive Control through Recurrent Neural Network Modelingcited by 0
- 2026Accelerating Reinforcement Learning via MPC Solver-Gradient Guidance for Weights-varying MPCcited by 0
- 2026Accelerating Reinforcement Learning via MPC Solver-Gradient Guidance for Weights-varying MPC1 Sep 2026
- 2026Towards Safe Learning-Based Non-Linear Model Predictive Control through Recurrent Neural Network Modeling25 Mar 2026
- 2025Model-free Reinforcement Learning for Model-based Control: Towards Safe, Interpretable and Sample-efficient Agents17 Jul 2025
- 2025Mission-Aligned Learning-Informed Control of Autonomous Systems: Formulation and Foundations6 Jul 2025
- 2023Combining model-predictive control and predictive reinforcement learning for stable quadrupedal robot locomotion15 Jul 2023