Differentiable Constrained Imitation Learning for Robot Motion Planning and Control
On the map: Offline RL and imitation learning from data → Imitation and offline RL for driving
Abstract (arXiv)
Motion planning and control are crucial components of robotics applications like automated driving. Here, spatio-temporal hard constraints like system dynamics and safety boundaries (e.g., obstacles) restrict the robot's motions. Direct methods from optimal control solve a constrained optimization problem. However, in many applications finding a proper cost function is inherently difficult because of the weighting of partially conflicting objectives. On the other hand, Imitation Learning (IL) methods such as Behavior Cloning (BC) provide an intuitive framework for learning decision-making from offline demonstrations and constitute a promising avenue for planning and control in complex robot applications. Prior work primarily relied on soft constraint approaches, which use additional auxiliary loss terms describing the constraints. However, catastrophic safety-critical failures might occur in out-of-distribution (OOD) scenarios. This work integrates the flexibility of IL with hard constraint handling in optimal control. Our approach constitutes a general framework for constraint robotic motion planning and control, as well as traffic agent simulation, whereas we focus on mobile robot and automated driving applications. Hard constraints are integrated into the learning problem in a differentiable manner, via explicit completion and gradient-based correction. Simulated experiments of mobile robot navigation and automated driving provide evidence for the performance of the proposed method.
Key facts. Cited by 7 papers in the map (data through 7 Oct 2026). Placed in Imitation and offline RL for driving, one of 13 directions in Offline RL and imitation learning from data. Builds on 21 of its 36 references that are in the map. First posted on arXiv 21 Oct 2022.
Builds on
21 of 36 references.
Closest ancestors · 4
Same direction, newest first
- 2022Driving in Real Life with Inverse Reinforcement Learning7 Jun
- 2021UMBRELLA: Uncertainty-Aware Model-Based Offline Reinforcement Learning Leveraging Planning22 Nov
- 2021Exploring Imitation Learning for Autonomous Driving with Feedback Synthesizer and Differentiable Rasterization2 Mar
- 2018ChauffeurNet: Learning to Drive by Imitating the Best and Synthesizing the Worst7 Dec
Other references · 17
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
- 2017OptNet: Differentiable Optimization as a Layer in Neural Networkscited by 588
- 2019Differentiable Convex Optimization Layerscited by 458
- 2019Exploring the Limitations of Behavior Cloning for Autonomous Drivingcited by 343
- 2021End-to-end Interpretable Neural Motion Plannercited by 240
- 2021End-to-End Urban Driving by Imitating a Reinforcement Learning Coachcited by 191
- 2021DC3: A learning method for optimization with hard constraintscited by 181
- 2022Learning from All Vehiclescited by 135
- 2021Reward (Mis)design for Autonomous Drivingcited by 102
- 2021SafetyNet: Safe planning for real-world self-driving vehicles using machine-learned policiescited by 68
- 2019Jointly Learnable Behavior and Trajectory Planning for Self-Driving Vehiclescited by 51
5 more
- 2022Semi-Supervised Trajectory-Feedback Controller Synthesis for Signal Temporal Logic Specificationscited by 11
- 2022Differentiable Control Barrier Functions for Vision-based End-to-End Autonomous Drivingcited by 10
- 2021Self-Supervised Action-Space Prediction for Automated Drivingcited by 9
- 2020Sample-Specific Output Constraints for Neural Networkscited by 7
- 2020Online Motion Planning based on Nonlinear Model Predictive Control with Non-Euclidean Rotation Groupscited by 4
Built on by
Citing papers per year: 2023: 2; 2024: 2; 2025: 1; 2026: 2.
7 papers.
- 2023Energy-based Potential Games for Joint Motion Forecasting and Controlcited by 9
- 2023On a Connection between Differential Games, Optimal Control, and Energy-based Models for Multi-Agent Interactionscited by 4
- 2024LoRD: Adapting Differentiable Driving Policies to Distribution Shiftscited by 4
- 2025Non-differentiable Reward Optimization for Diffusion-based Autonomous Motion Planningcited by 3
- 2024Integrating Decision-Making Into Differentiable Optimization Guided Learning for End-to-End Planning of Autonomous Vehiclescited by 2
- 2026Zero-shot adaptable task planning for autonomous construction robots: a comparative study of lightweight single and multi-AI agent systemscited by 0
- 2026Infeasible optimization problems and the hierarchical augmented Lagrangian method in imitation learningcited by 0
- 2026Infeasible optimization problems and the hierarchical augmented Lagrangian method in imitation learning30 May 2026
- 2026Zero-shot adaptable task planning for autonomous construction robots: a comparative study of lightweight single and multi-AI agent systems20 Jan 2026
- 2025Non-differentiable Reward Optimization for Diffusion-based Autonomous Motion Planning17 Jul 2025
- 2024Integrating Decision-Making Into Differentiable Optimization Guided Learning for End-to-End Planning of Autonomous Vehicles2 Dec 2024
- 2024LoRD: Adapting Differentiable Driving Policies to Distribution Shifts13 Oct 2024
- 2023Energy-based Potential Games for Joint Motion Forecasting and Control4 Dec 2023
- 2023On a Connection between Differential Games, Optimal Control, and Energy-based Models for Multi-Agent Interactions31 Aug 2023
Similar, not cited
Close in wording, no citation either way
- 2021How To Not Drive: Learning Driving Constraints from Demonstration
- 2025A Simple Approach to Constraint-Aware Imitation Learning with Application to Autonomous Racing
- 2024Imitating Cost-Constrained Behaviors in Reinforcement Learning
- 2025From Imitation to Optimization: A Comparative Study of Offline Learning for Autonomous Driving
- 2024Constrained Behavior Cloning for Robotic Learning
- 2025Action-Constrained Imitation Learning
- 2024Learning Soft Driving Constraints from Vectorized Scene Embeddings while Imitating Expert Trajectories
- 2021EKMP: Generalized Imitation Learning with Adaptation, Nonlinear Hard Constraints and Obstacle Avoidance