Learning Predictive Control with Deep Koopman Operators for Autonomous Vehicle Motion Planning
On the map: End-to-end autonomous driving → Reinforcement learning for driving
Abstract (arXiv)
Model Predictive Control (MPC) is widely used for autonomous-vehicle (AV) motion planning, but its real-time applicability is often limited by the need for accurate models and online solution of nonlinear, nonconvex optimization problems in dynamic road environments. Actor-critic reinforcement learning offers a promising alternative for online policy generation, yet its policy-learning process often lacks explicit control-theoretic structure. This article proposes a learning predictive control (LPC) framework with deep Koopman operators for efficient real-time motion planning under nonconvex constraints. To address nonlinear and uncertain vehicle dynamics, a deep-Koopman-based predictor is used to lift the system into an interpretable linear observable space in a data-driven manner. Unlike traditional MPC, which computes open-loop control sequences, the proposed LPC framework yields a closed-loop state-feedback policy within each prediction interval through receding-horizon actor-critic learning. To ensure safety under nonconvex environmental constraints, LPC constructs convex local surrogate representations of obstacles and defines corresponding potential-field functions. These functions and their gradients are directly embedded into the actor-critic structure, enabling efficient, safety-aware policy learning. Extensive simulations and real-world experiments on the HongQi-EHS3 platform demonstrate favorable performance in diverse obstacle-avoidance scenarios in terms of safety, computational efficiency, and driving comfort, compared with benchmark methods such as CBF-MPC and LMPCC.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Reinforcement learning for driving, one of 9 directions in End-to-end autonomous driving. Builds on 20 of its 49 references that are in the map. First posted on arXiv 6 Jun 2026.
Builds on
20 of 49 references.
References · 20
- 2020Deep Reinforcement Learning for Autonomous Driving: A Surveycited by 721
- 2023Drive Like a Human: Rethinking Autonomous Driving with Large Language Modelscited by 160
- 2016Linear predictors for nonlinear dynamical systems: Koopman operator meets model predictive controlcited by 140
- 2020Transformers for Modeling Physical Systemscited by 106
- 2020Interpretable End-to-end Urban Autonomous Driving with Latent Deep Reinforcement Learningcited by 103
- 2023Drive as You Speak: Enabling Human-Like Interaction with Large Language Models in Autonomous Vehiclescited by 100
- 2019Model-free Deep Reinforcement Learning for Urban Autonomous Drivingcited by 98
- 2020Safety-Critical Model Predictive Control with Discrete-Time Control Barrier Functioncited by 49
- 2020Model Predictive Contouring Control for Collision Avoidance in Unstructured Dynamic Environmentscited by 21
- 2019Deep Variational Koopman Models: Inferring Koopman Observations for Uncertainty-Aware Dynamics Modeling and Controlcited by 18
- 2019Safe and Fast Tracking on a Robot Manipulator: Robust MPC and Neural Network Controlcited by 17
- 2019Near-Optimal Rapid MPC using Neural Networks: A Primal-Dual Policy Learning Frameworkcited by 16
8 more
- 2020Deep Neural Networks with Koopman Operators for Modeling and Control of Autonomous Vehiclescited by 11
- 2017The Convex Feasible Set Algorithm for Real Time Optimization in Motion Planningcited by 9
- 2024Physically Analyzable AI-Based Nonlinear Platoon Dynamics Modeling During Traffic Oscillation: A Koopman Approachcited by 7
- 2020DeepKoCo: Efficient latent planning with a task-relevant Koopman representationcited by 5
- 2021Model-Based Safe Reinforcement Learning with Time-Varying State and Control Constraints: An Application to Intelligent Vehiclescited by 4
- 2019Robust Learning-based Predictive Control for Discrete-time Nonlinear Systems with Unknown Dynamics and State Constraintscited by 3
- 2019Accept Synthetic Objects as Real: End-to-End Training of Attentive Deep Visuomotor Policies for Manipulation in Cluttercited by 2
- 2024Safety-critical Control with Control Barrier Functions: A Hierarchical Optimization Frameworkcited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2025Leveraging Reinforcement Learning and Koopman Theory for Enhanced Model Predictive Control Performance
- 2023Model Predictive Inferential Control of Neural State-Space Models for Autonomous Vehicle Motion Planning
- 2024Model Predictive Control of Nonlinear Dynamics Using Online Adaptive Koopman Operators ↗
- 2024A Safe Reinforcement Learning driven Weights-varying Model Predictive Control for Autonomous Vehicle Motion Control
- 2023Adaptive Stochastic Nonlinear Model Predictive Control with Look-ahead Deep Reinforcement Learning for Autonomous Vehicle Motion Control
- 2025Actor-Critic Cooperative Compensation to Model Predictive Control for Off-Road Autonomous Vehicles Under Unknown Dynamics
- 2024Faster Model Predictive Control via Self-Supervised Initialization Learning
- 2025ZipMPC: Compressed Context-Dependent MPC Cost via Imitation Learning