ReLU Networks for Model Predictive Control: Network Complexity and Performance Guarantees
Not on the map. Why?
Abstract (arXiv)
Recent years have witnessed a resurgence in using ReLU neural networks (NNs) to represent model predictive control (MPC) policies. However, determining the required network complexity to ensure closed-loop performance remains a fundamental open problem. This involves a critical precision-complexity trade-off: undersized networks may fail to capture the MPC policy, while oversized ones may outweigh the benefits of ReLU network approximation. In this work, we propose a projection-based method to enforce hard constraints and establish a state-dependent Lipschitz continuity property for the optimal MPC cost function, which enables sharp convergence analysis of the closed-loop system. For the first time, we derive explicit bounds on ReLU network width and depth for approximating MPC policies with guaranteed closed-loop performance. To further reduce network complexity and enhance closed-loop performance, we propose a non-uniform error framework with a state-aware scaling function to adaptively adjust both the input and output of the ReLU network. Our contributions provide a foundational step toward certifiable ReLU NN-based MPC.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 17 of its 42 references that are in the map. First posted on arXiv 23 Jan 2026.
Builds on
17 of 42 references.
References · 17
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2019Deep Network Approximation Characterized by Number of Neuronscited by 122
- 2017Universal Function Approximation by Deep Neural Nets with Bounded Width and ReLU Activationscited by 104
- 2021Optimal Approximation Rate of ReLU Networks in terms of Width and Depthcited by 96
- 2021The Modern Mathematics of Deep Learningcited by 63
- 2018Learning an Approximate Model Predictive Controller with Guaranteescited by 57
- 2019Large Scale Model Predictive Control with Neural Networks and Primal Active Setscited by 29
- 2019Safe and Fast Tracking on a Robot Manipulator: Robust MPC and Neural Network Controlcited by 17
- 2021Reliably-stabilizing piecewise-affine neural network controllerscited by 13
- 2023Automatic nonlinear MPC approximation with closed-loop guaranteescited by 12
- 2022Stability Verification of Neural Network Controllers using Mixed-Integer Programmingcited by 11
- 2023Neural Networks for Fast Optimisation in Model Predictive Control: A Reviewcited by 10
5 more
- 2023TinyMPC: Model-Predictive Control on Resource-Constrained Microcontrollerscited by 10
- 2020Approximation of Smoothness Classes by Deep Rectifier Networkscited by 6
- 2020A Sensitivity-based Data Augmentation Framework for Model Predictive Control Policy Approximationcited by 6
- 2018Deep Learning-Based Model Predictive Control for Resonant Power Converterscited by 5
- 2022Standoff Tracking Using DNN-Based MPC with Implementation on FPGAcited by 2
Built on by
Not cited yet.