mlsanityData to 7 Oct 2026

Learning-based MPC from Big Data Using Reinforcement Learning

arXiv 2301.01667 ↗First posted 4 Jan 2023eess.SY cs.LG cs.SYcited by 5

Not on the map. Why?

Abstract (arXiv)

This paper presents an approach for learning Model Predictive Control (MPC) schemes directly from data using Reinforcement Learning (RL) methods. The state-of-the-art learning methods use RL to improve the performance of parameterized MPC schemes. However, these learning algorithms are often gradient-based methods that require frequent evaluations of computationally expensive MPC schemes, thereby restricting their use on big datasets. We propose to tackle this issue by using tools from RL to learn a parameterized MPC scheme directly from data in an offline fashion. Our approach derives an MPC scheme without having to solve it over the collected dataset, thereby eliminating the computational complexity of existing techniques for big data. We evaluate the proposed method on three simulated experiments of varying complexity.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Builds on 9 of its 16 references that are in the map. First posted on arXiv 4 Jan 2023.

Builds on

9 of 16 references.

References · 9

  1. 2015Continuous control with deep reinforcement learningcited by 3,279
  2. 2020Offline Reinforcement Learning: Tutorial, Review, and Perspectives on Open Problemscited by 1,873
  3. 2020Conservative Q-Learning for Offline Reinforcement Learningcited by 1,777
  4. 2020D4RL: Datasets for Deep Data-Driven Reinforcement Learningcited by 1,406
  5. 2020MOReL : Model-Based Offline Reinforcement Learningcited by 582
  6. 2019Data-driven Economic NMPC using Reinforcement Learningcited by 55
  7. 2021MPC-based Reinforcement Learning for Economic Problems with Application to Battery Storagecited by 7
  8. 2021MPC-based Reinforcement Learning for a Simplified Freight Mission of Autonomous Surface Vehiclescited by 5
  9. 2021Optimal Management of the Peak Power Penalty for Smart Grids Using MPC-based Reinforcement Learningcited by 3

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2023: 1; 2024: 0; 2025: 2; 2026: 2.

5 papers.