A Hybrid End-to-End and Modular Control Architecture Toward Safe Vehicle Lateral Control: Combining Soft Actor-Critic with Model Predictive Control
On the map: Deep reinforcement learning methods → RL for autonomous driving and traffic
Abstract (arXiv)
Connected and automated vehicles demand lateral controllers that are simultaneously accurate, low-effort, and safe under model error and sensor noise. Modular controllers such as model predictive control (MPC) are interpretable and constraint-aware but rely on accurate models and hand-tuned weights. End-to-end learned policies, in particular continuous-action deep reinforcement learning, are adaptable and require no hand-designed control law, but offer no intrinsic safety guarantees and limited interpretability. This paper presents a hybrid architecture that combines an end-to-end Soft Actor-Critic (SAC) policy with a constrained linear MPC into a single steering command, using the MPC's first-step optimum as the model-based anchor and a single monotone blending coefficient that interpolates between the two paradigms. The architecture is evaluated on a linearized lateral bicycle model against a PID baseline, a tuned linear MPC, and a stand-alone SAC policy, across nominal, single-axis robustness, and multi-initial-condition ensemble experiments. The hybrid retains the tracking quality of stand-alone SAC while remaining inside the MPC's actuator envelope and preserving a deterministic, model-based contribution to every steering command. The architecture provides an actuator-envelope guarantee by construction but does not establish recursive feasibility or terminal invariance, and the closed-form blend does not prevent all corner-case divergences at the boundary of the training distribution. A corner-case analysis shows that the blend attenuates but cannot prevent failure under distribution shift, motivating a connectivity-aware extension in which the blending coefficient is scheduled by vehicle-to-everything (V2X) signals to restore model-based authority. Limitations and a path toward a constrained-QP predictive safety filter are discussed.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in RL for autonomous driving and traffic, one of 15 directions in Deep reinforcement learning methods. Builds on 14 of its 28 references that are in the map. First posted on arXiv 18 Aug 2026.
Builds on
14 of 28 references.
References · 14
- 2018Soft Actor-Critic: Off-Policy Maximum Entropy Deep Reinforcement Learning with a Stochastic Actorcited by 4,885
- 2015Continuous control with deep reinforcement learningcited by 3,407
- 2018Addressing Function Approximation Error in Actor-Critic Methodscited by 2,417
- 2018Soft Actor-Critic Algorithms and Applicationscited by 1,240
- 2016End to End Learning for Self-Driving Carscited by 1,009
- 2020Deep Reinforcement Learning for Autonomous Driving: A Surveycited by 721
- 2019End-to-End Safe Reinforcement Learning through Barrier Functions for Safety-Critical Continuous Control Taskscited by 289
- 2018Learning to Drive in a Daycited by 273
- 2017OSQP: An Operator Splitting Solver for Quadratic Programscited by 161
- 2018A predictive safety filter for learning-based control of constrained nonlinear dynamical systemscited by 118
- 2016Learning Model Predictive Control for iterative tasks. A Data-Driven Control Frameworkcited by 39
- 2018Linear model predictive safety certification for learning-based controlcited by 37
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Autonomous Vehicle Lateral Control Using Deep Reinforcement Learning with MPC-PID Demonstration
- 2021A predictive safety filter for learning-based racing control
- 2026Stability-Aware Imitation Learning from Model Predictive Control for Autonomous Vehicle Lateral Control: Exact Q-Loss and a Novel Training Procedure
- 2021Neural Network Based Model Predictive Control for an Autonomous Vehicle
- 2024Enhancing System-Level Safety in Mixed-Autonomy Platoon via Safe Reinforcement Learning
- 2025Actor-Critic Cooperative Compensation to Model Predictive Control for Off-Road Autonomous Vehicles Under Unknown Dynamics
- 2026Beyond Conservative Automated Driving in Multi-Agent Scenarios via Coupled Model Predictive Control and Deep Reinforcement Learning
- 2025Learning to Drive Safely with Hybrid Options