Deep Imitation Learning for Autonomous Driving in Generic Urban Scenarios with Enhanced Safety
On the map: Offline RL and imitation learning from data → Imitation and offline RL for driving
Abstract (arXiv)
The decision and planning system for autonomous driving in urban environments is hard to design. Most current methods manually design the driving policy, which can be expensive to develop and maintain at scale. Instead, with imitation learning we only need to collect data and the computer will learn and improve the driving policy automatically. However, existing imitation learning methods for autonomous driving are hardly performing well for complex urban scenarios. Moreover, the safety is not guaranteed when we use a deep neural network policy. In this paper, we proposed a framework to learn the driving policy in urban scenarios efficiently given offline connected driving data, with a safety controller incorporated to guarantee safety at test time. The experiments show that our method can achieve high performance in realistic simulations of urban driving scenarios.
Key facts. Cited by 48 papers in the map (data through 7 Oct 2026). Placed in Imitation and offline RL for driving, one of 13 directions in Offline RL and imitation learning from data. Builds on 15 of its 25 references that are in the map. First posted on arXiv 2 Mar 2019.
Builds on
15 of 25 references.
Closest ancestors · 2
Same direction, newest first
- 2018ChauffeurNet: Learning to Drive by Imitating the Best and Synthesizing the Worst7 Dec
- 2018Conditional Affordance Learning for Driving in Urban Environments18 Jun
Other references · 13
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
- 2016End to End Learning for Self-Driving Carscited by 1,000
- 2017End-to-end Driving via Conditional Imitation Learningcited by 479
- 2018Multimodal Trajectory Predictions for Autonomous Driving using Deep Convolutional Networkscited by 289
- 2016A Survey of Motion Planning and Control Techniques for Self-driving Urban Vehiclescited by 251
- 2017Inverse Reward Designcited by 246
- 2016End-to-end Learning of Driving Models from Large-scale Video Datasetscited by 147
- 2018Uncertainty-aware Short-term Motion Prediction of Traffic Actors for Autonomous Drivingcited by 90
- 2017Explaining How a Deep Neural Network Trained with End-to-End Learning Steers a Carcited by 65
- 2018Deep Object-Centric Policies for Autonomous Drivingcited by 41
Built on by
Citing papers per year: 2020: 1; 2021: 8; 2022: 8; 2023: 15; 2024: 8; 2025: 5; 2026: 3.
48 papers.
Sort:
By area:
- 2021A Survey of Deep RL and IL for Autonomous Driving Policy Learningcited by 59
- 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Reviewcited by 29
- 2022Augmenting Reinforcement Learning with Transformer-based Scene Representation Learning for Decision-making of Autonomous Drivingcited by 24
- 2021Contingencies from Observations: Tractable Contingency Planning with Learned Behavior Modelscited by 22
- 2021A Safe Hierarchical Planning Framework for Complex Driving Scenarios based on Reinforcement Learningcited by 18
- 2021DQ-GAT: Towards Safe and Efficient Autonomous Driving with Deep Q-Learning and Graph Attention Networkscited by 13
- 2024Gaussian Splatting to Real World Flight Navigation Transfer with Liquid Networkscited by 12
- 2020PILOT: Efficient Planning by Imitation Learning and Optimisation for Safe Autonomous Drivingcited by 11
- 2021Explainable Hierarchical Imitation Learning for Robotic Drink Pouringcited by 11
- 2024VIEW: Visual Imitation Learning with Waypointscited by 10
- 2022Cooperative Behavior Planning for Automated Driving using Graph Neural Networkscited by 8
- 2023End-to-end Autonomous Driving using Deep Learning: A Systematic Reviewcited by 7
36 more
- 2023Parameterized Decision-making with Multi-modal Perception for Autonomous Drivingcited by 7
- 2024Efficient and Generalized end-to-end Autonomous Driving System with Latent Deep Reinforcement Learning and Demonstrationscited by 7
- 2023Learning Interaction-aware Motion Prediction Model for Decision-making in Autonomous Drivingcited by 6
- 2023Efficient Learning of Urban Driving Policies Using Bird's-Eye-View State Representationscited by 6
- 2021Safe Imitation Learning on Real-Life Highway Data for Human-like Autonomous Drivingcited by 5
- 2022Tackling Real-World Autonomous Driving using Deep Reinforcement Learningcited by 5
- 2024RAIL: Reachability-Aided Imitation Learning for Safe Policy Executioncited by 5
- 2023Interpretable Motion Planner for Urban Driving via Hierarchical Imitation Learningcited by 4
- 2023Integration of Reinforcement Learning Based Behavior Planning With Sampling Based Motion Planning for Automated Drivingcited by 4
- 2023IIFL: Implicit Interactive Fleet Learning from Heterogeneous Human Supervisorscited by 4
- 2023Data-efficient Deep Reinforcement Learning for Vehicle Trajectory Controlcited by 4
- 2024Long and Short-Term Constraints Driven Safe Reinforcement Learning for Autonomous Drivingcited by 4
- 2022Vision-based Autonomous Driving for Unstructured Environments Using Imitation Learningcited by 3
- 2023Automatic Intersection Management in Mixed Traffic Using Reinforcement Learning and Graph Neural Networkscited by 3
- 2023NLOS Dies Twice: Challenges and Solutions of V2X for Cooperative Perceptioncited by 3
- 2025Non-differentiable Reward Optimization for Diffusion-based Autonomous Motion Planningcited by 3
- 2021Learning robust driving policies without online explorationcited by 2
- 2022Fail-Safe Adversarial Generative Imitation Learningcited by 2
- 2022Speeding up deep neural network-based planning of local car maneuvers via efficient B-spline path constructioncited by 2
- 2021Towards Defensive Autonomous Driving: Collecting and Probing Driving Demonstrations of Mixed Qualitiescited by 1
- 2022MPC-based Imitation Learning for Safe and Human-like Autonomous Drivingcited by 1
- 2023Perception Imitation: Towards Synthesis-free Simulator for Autonomous Vehiclescited by 1
- 2024Deep Attention Driven Reinforcement Learning (DAD-RL) for Autonomous Decision-Making in Dynamic Environmentcited by 1
- 2025ADReFT: Adaptive Decision Repair for Safe Autonomous Driving via Reinforcement Fine-Tuningcited by 1
- 2025An Evolving Scenario Generation Method based on Dual-modal Driver Model Trained by Multi-Agent Reinforcement Learningcited by 1
- 2025Follow-Me in Micro-Mobility with End-to-End Imitation Learningcited by 1
- 2026AppleVLM: End-to-end Autonomous Driving with Advanced Perception and Planning-Enhanced Vision-Language Modelscited by 1
- 2022Enhanced Behavioral Cloning with Environmental Losses for Self-Driving Vehiclescited by 0
- 2023Specification-Guided Data Aggregation for Semantically Aware Imitation Learningcited by 0
- 2023SuperDriverAI: Towards Design and Implementation for End-to-End Learning-based Autonomous Drivingcited by 0
- 2023Imitator Learning: Achieve Out-of-the-Box Imitation Ability in Variable Environmentscited by 0
- 2024Collision Probability Distribution Estimation via Temporal Difference Learningcited by 0
- 20243CSim: CARLA Corner Case Simulation for Control Assessment in Autonomous Drivingcited by 0
- 2025Energy-Efficient Autonomous Driving with Adaptive Perception and Robust Decisioncited by 0
- 2026Imitation Learning from Human Motion Alone Does Not Guarantee Biomechanically Plausible Gait Kineticscited by 0
- 2026End-to-End Learning vs. Modular Architectures: Comparative Insights into Autonomous Driving Systemscited by 0
- 2026End-to-End Learning vs. Modular Architectures: Comparative Insights into Autonomous Driving Systems1 Oct 2026
- 2026Imitation Learning from Human Motion Alone Does Not Guarantee Biomechanically Plausible Gait Kinetics12 Mar 2026
- 2026AppleVLM: End-to-end Autonomous Driving with Advanced Perception and Planning-Enhanced Vision-Language Models4 Feb 2026
- 2025Follow-Me in Micro-Mobility with End-to-End Imitation Learning7 Nov 2025
- 2025Energy-Efficient Autonomous Driving with Adaptive Perception and Robust Decision29 Oct 2025
- 2025An Evolving Scenario Generation Method based on Dual-modal Driver Model Trained by Multi-Agent Reinforcement Learning4 Aug 2025
- 2025Non-differentiable Reward Optimization for Diffusion-based Autonomous Motion Planning17 Jul 2025
- 2025ADReFT: Adaptive Decision Repair for Safe Autonomous Driving via Reinforcement Fine-Tuning30 Jun 2025
- 2024RAIL: Reachability-Aided Imitation Learning for Safe Policy Execution28 Sep 2024
- 20243CSim: CARLA Corner Case Simulation for Control Assessment in Autonomous Driving30 Aug 2024
- 2024Collision Probability Distribution Estimation via Temporal Difference Learning29 Jul 2024
- 2024Deep Attention Driven Reinforcement Learning (DAD-RL) for Autonomous Decision-Making in Dynamic Environment12 Jul 2024
36 more
- 2024Gaussian Splatting to Real World Flight Navigation Transfer with Liquid Networks21 Jun 2024
- 2024VIEW: Visual Imitation Learning with Waypoints27 Apr 2024
- 2024Long and Short-Term Constraints Driven Safe Reinforcement Learning for Autonomous Driving27 Mar 2024
- 2024Efficient and Generalized end-to-end Autonomous Driving System with Latent Deep Reinforcement Learning and Demonstrations22 Jan 2024
- 2023Parameterized Decision-making with Multi-modal Perception for Autonomous Driving19 Dec 2023
- 2023Data-efficient Deep Reinforcement Learning for Vehicle Trajectory Control30 Nov 2023
- 2023Imitator Learning: Achieve Out-of-the-Box Imitation Ability in Variable Environments9 Oct 2023
- 2023End-to-end Autonomous Driving using Deep Learning: A Systematic Review27 Aug 2023
- 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Review10 Aug 2023
- 2023NLOS Dies Twice: Challenges and Solutions of V2X for Cooperative Perception13 Jul 2023
- 2023IIFL: Implicit Interactive Fleet Learning from Heterogeneous Human Supervisors27 Jun 2023
- 2023Efficient Learning of Urban Driving Policies Using Bird's-Eye-View State Representations31 May 2023
- 2023SuperDriverAI: Towards Design and Implementation for End-to-End Learning-based Autonomous Driving14 May 2023
- 2023Perception Imitation: Towards Synthesis-free Simulator for Autonomous Vehicles19 Apr 2023
- 2023Integration of Reinforcement Learning Based Behavior Planning With Sampling Based Motion Planning for Automated Driving17 Apr 2023
- 2023Specification-Guided Data Aggregation for Semantically Aware Imitation Learning29 Mar 2023
- 2023Interpretable Motion Planner for Urban Driving via Hierarchical Imitation Learning24 Mar 2023
- 2023Learning Interaction-aware Motion Prediction Model for Decision-making in Autonomous Driving8 Feb 2023
- 2023Automatic Intersection Management in Mixed Traffic Using Reinforcement Learning and Graph Neural Networks30 Jan 2023
- 2022Augmenting Reinforcement Learning with Transformer-based Scene Representation Learning for Decision-making of Autonomous Driving24 Aug 2022
- 2022Tackling Real-World Autonomous Driving using Deep Reinforcement Learning5 Jul 2022
- 2022MPC-based Imitation Learning for Safe and Human-like Autonomous Driving24 Jun 2022
- 2022Speeding up deep neural network-based planning of local car maneuvers via efficient B-spline path construction14 Mar 2022
- 2022Fail-Safe Adversarial Generative Imitation Learning3 Mar 2022
- 2022Cooperative Behavior Planning for Automated Driving using Graph Neural Networks23 Feb 2022
- 2022Vision-based Autonomous Driving for Unstructured Environments Using Imitation Learning21 Feb 2022
- 2022Enhanced Behavioral Cloning with Environmental Losses for Self-Driving Vehicles4 Feb 2022
- 2021Safe Imitation Learning on Real-Life Highway Data for Human-like Autonomous Driving8 Oct 2021
- 2021Towards Defensive Autonomous Driving: Collecting and Probing Driving Demonstrations of Mixed Qualities16 Sep 2021
- 2021DQ-GAT: Towards Safe and Efficient Autonomous Driving with Deep Q-Learning and Graph Attention Networks11 Aug 2021
- 2021Explainable Hierarchical Imitation Learning for Robotic Drink Pouring16 May 2021
- 2021Contingencies from Observations: Tractable Contingency Planning with Learned Behavior Models21 Apr 2021
- 2021Learning robust driving policies without online exploration15 Mar 2021
- 2021A Safe Hierarchical Planning Framework for Complex Driving Scenarios based on Reinforcement Learning17 Jan 2021
- 2021A Survey of Deep RL and IL for Autonomous Driving Policy Learning6 Jan 2021
- 2020PILOT: Efficient Planning by Imitation Learning and Optimisation for Safe Autonomous Driving1 Nov 2020
- 2021A Survey of Deep RL and IL for Autonomous Driving Policy Learningcited by 59
- 2022Augmenting Reinforcement Learning with Transformer-based Scene Representation Learning for Decision-making of Autonomous Drivingcited by 24
- 2021A Safe Hierarchical Planning Framework for Complex Driving Scenarios based on Reinforcement Learningcited by 18
- 2021DQ-GAT: Towards Safe and Efficient Autonomous Driving with Deep Q-Learning and Graph Attention Networkscited by 13
- 2022Cooperative Behavior Planning for Automated Driving using Graph Neural Networkscited by 8
- 2023End-to-end Autonomous Driving using Deep Learning: A Systematic Reviewcited by 7
- 2023Parameterized Decision-making with Multi-modal Perception for Autonomous Drivingcited by 7
- 2024Efficient and Generalized end-to-end Autonomous Driving System with Latent Deep Reinforcement Learning and Demonstrationscited by 7
- 2023Learning Interaction-aware Motion Prediction Model for Decision-making in Autonomous Drivingcited by 6
- 2023Efficient Learning of Urban Driving Policies Using Bird's-Eye-View State Representationscited by 6
- 2021Safe Imitation Learning on Real-Life Highway Data for Human-like Autonomous Drivingcited by 5
- 2022Tackling Real-World Autonomous Driving using Deep Reinforcement Learningcited by 5
12 most cited of 24 All 24 (JSON)
- 2026End-to-End Learning vs. Modular Architectures: Comparative Insights into Autonomous Driving Systems1 Oct 2026
- 2025Energy-Efficient Autonomous Driving with Adaptive Perception and Robust Decision29 Oct 2025
- 2025ADReFT: Adaptive Decision Repair for Safe Autonomous Driving via Reinforcement Fine-Tuning30 Jun 2025
- 2024Long and Short-Term Constraints Driven Safe Reinforcement Learning for Autonomous Driving27 Mar 2024
- 2024Efficient and Generalized end-to-end Autonomous Driving System with Latent Deep Reinforcement Learning and Demonstrations22 Jan 2024
- 2023Parameterized Decision-making with Multi-modal Perception for Autonomous Driving19 Dec 2023
- 2023End-to-end Autonomous Driving using Deep Learning: A Systematic Review27 Aug 2023
- 2023Efficient Learning of Urban Driving Policies Using Bird's-Eye-View State Representations31 May 2023
- 2023SuperDriverAI: Towards Design and Implementation for End-to-End Learning-based Autonomous Driving14 May 2023
- 2023Integration of Reinforcement Learning Based Behavior Planning With Sampling Based Motion Planning for Automated Driving17 Apr 2023
- 2023Interpretable Motion Planner for Urban Driving via Hierarchical Imitation Learning24 Mar 2023
- 2023Learning Interaction-aware Motion Prediction Model for Decision-making in Autonomous Driving8 Feb 2023
12 newest of 24 All 24 (JSON)
- 2020PILOT: Efficient Planning by Imitation Learning and Optimisation for Safe Autonomous Drivingcited by 11
- 2021Explainable Hierarchical Imitation Learning for Robotic Drink Pouringcited by 11
- 2024VIEW: Visual Imitation Learning with Waypointscited by 10
- 2024RAIL: Reachability-Aided Imitation Learning for Safe Policy Executioncited by 5
- 2023IIFL: Implicit Interactive Fleet Learning from Heterogeneous Human Supervisorscited by 4
- 2022Fail-Safe Adversarial Generative Imitation Learningcited by 2
- 2025Follow-Me in Micro-Mobility with End-to-End Imitation Learningcited by 1
- 2023Specification-Guided Data Aggregation for Semantically Aware Imitation Learningcited by 0
- 2023Imitator Learning: Achieve Out-of-the-Box Imitation Ability in Variable Environmentscited by 0
- 2026Imitation Learning from Human Motion Alone Does Not Guarantee Biomechanically Plausible Gait Kineticscited by 0
- 2026Imitation Learning from Human Motion Alone Does Not Guarantee Biomechanically Plausible Gait Kinetics12 Mar 2026
- 2025Follow-Me in Micro-Mobility with End-to-End Imitation Learning7 Nov 2025
- 2024RAIL: Reachability-Aided Imitation Learning for Safe Policy Execution28 Sep 2024
- 2024VIEW: Visual Imitation Learning with Waypoints27 Apr 2024
- 2023Imitator Learning: Achieve Out-of-the-Box Imitation Ability in Variable Environments9 Oct 2023
- 2023IIFL: Implicit Interactive Fleet Learning from Heterogeneous Human Supervisors27 Jun 2023
- 2023Specification-Guided Data Aggregation for Semantically Aware Imitation Learning29 Mar 2023
- 2022Fail-Safe Adversarial Generative Imitation Learning3 Mar 2022
- 2021Explainable Hierarchical Imitation Learning for Robotic Drink Pouring16 May 2021
- 2020PILOT: Efficient Planning by Imitation Learning and Optimisation for Safe Autonomous Driving1 Nov 2020
- 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Reviewcited by 29
- 2021Contingencies from Observations: Tractable Contingency Planning with Learned Behavior Modelscited by 22
- 2024Gaussian Splatting to Real World Flight Navigation Transfer with Liquid Networkscited by 12
- 2023Data-efficient Deep Reinforcement Learning for Vehicle Trajectory Controlcited by 4
- 2023Automatic Intersection Management in Mixed Traffic Using Reinforcement Learning and Graph Neural Networkscited by 3
- 2023NLOS Dies Twice: Challenges and Solutions of V2X for Cooperative Perceptioncited by 3
- 2022Speeding up deep neural network-based planning of local car maneuvers via efficient B-spline path constructioncited by 2
- 2023Perception Imitation: Towards Synthesis-free Simulator for Autonomous Vehiclescited by 1
- 2024Deep Attention Driven Reinforcement Learning (DAD-RL) for Autonomous Decision-Making in Dynamic Environmentcited by 1
- 2025An Evolving Scenario Generation Method based on Dual-modal Driver Model Trained by Multi-Agent Reinforcement Learningcited by 1
- 2024Collision Probability Distribution Estimation via Temporal Difference Learningcited by 0
- 20243CSim: CARLA Corner Case Simulation for Control Assessment in Autonomous Drivingcited by 0
- 2025An Evolving Scenario Generation Method based on Dual-modal Driver Model Trained by Multi-Agent Reinforcement Learning4 Aug 2025
- 20243CSim: CARLA Corner Case Simulation for Control Assessment in Autonomous Driving30 Aug 2024
- 2024Collision Probability Distribution Estimation via Temporal Difference Learning29 Jul 2024
- 2024Deep Attention Driven Reinforcement Learning (DAD-RL) for Autonomous Decision-Making in Dynamic Environment12 Jul 2024
- 2024Gaussian Splatting to Real World Flight Navigation Transfer with Liquid Networks21 Jun 2024
- 2023Data-efficient Deep Reinforcement Learning for Vehicle Trajectory Control30 Nov 2023
- 2023The Integration of Prediction and Planning in Deep Learning Automated Driving Systems: A Review10 Aug 2023
- 2023NLOS Dies Twice: Challenges and Solutions of V2X for Cooperative Perception13 Jul 2023
- 2023Perception Imitation: Towards Synthesis-free Simulator for Autonomous Vehicles19 Apr 2023
- 2023Automatic Intersection Management in Mixed Traffic Using Reinforcement Learning and Graph Neural Networks30 Jan 2023
- 2022Speeding up deep neural network-based planning of local car maneuvers via efficient B-spline path construction14 Mar 2022
- 2021Contingencies from Observations: Tractable Contingency Planning with Learned Behavior Models21 Apr 2021
Similar, not cited
Close in wording, no citation either way
- 2022SHAIL: Safety-Aware Hierarchical Adversarial Imitation Learning for Autonomous Driving in Urban Environments
- 2021Urban Driver: Learning to Drive from Real-world Demonstrations Using Policy Gradients
- 2022Imitation Is Not Enough: Robustifying Imitation with Reinforcement Learning for Challenging Driving Scenarios
- 2021Improved Deep Reinforcement Learning with Expert Demonstrations for Urban Autonomous Driving
- 2019Urban Driving with Conditional Imitation Learning
- 2022Learning from Demonstrations of Critical Driving Behaviours Using Driver's Risk Field
- 2019Model-free Deep Reinforcement Learning for Urban Autonomous Driving
- 2023Symbolic Imitation Learning: From Black-Box to Explainable Driving Policies