Imitation Learning for End to End Vehicle Longitudinal Control with Forward Camera
On the map: Offline RL and imitation learning from data → Imitation and offline RL for driving
Abstract (arXiv)
In this paper we present a complete study of an end-to-end imitation learning system for speed control of a real car, based on a neural network with a Long Short Term Memory (LSTM). To achieve robustness and generalization from expert demonstrations, we propose data augmentation and label augmentation that are relevant for imitation learning in longitudinal control context. Based on front camera image only, our system is able to correctly control the speed of a car in simulation environment, and in a real car on a challenging test track. The system also shows promising results in open road context.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Placed in Imitation and offline RL for driving, one of 13 directions in Offline RL and imitation learning from data. Builds on 7 of its 14 references that are in the map. First posted on arXiv 14 Dec 2018.
Builds on
7 of 14 references.
References · 7
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
- 2016End to End Learning for Self-Driving Carscited by 1,009
- 2015DeepDriving: Learning Affordance for Direct Perception in Autonomous Drivingcited by 231
- 2016End-to-end Learning of Driving Models from Large-scale Video Datasetscited by 148
- 2018End-to-end Multi-Modal Multi-Task Vehicle Control for Self-Driving Cars with Visual Perceptioncited by 27
- 2018End to End Vehicle Lateral Control Using a Single Fisheye Cameracited by 13
- 2016VisualBackProp: efficient visualization of CNNscited by 10
Built on by
Citing papers per year: 2021: 3; 2022: 1; 2023: 0; 2024: 1.
5 papers.
- 2021Imitation Learning: Progress, Taxonomies and Challengescited by 58
- 2021Adversarial Imitation Learning with Trajectorial Augmentation and Correctioncited by 11
- 2021Raising context awareness in motion forecastingcited by 6
- 2022Data augmentation for efficient learning from parametric expertscited by 5
- 2024Guiding Attention in End-to-End Driving Modelscited by 1
- 2024Guiding Attention in End-to-End Driving Models30 Apr 2024
- 2022Data augmentation for efficient learning from parametric experts23 May 2022
- 2021Raising context awareness in motion forecasting16 Sep 2021
- 2021Imitation Learning: Progress, Taxonomies and Challenges23 Jun 2021
- 2021Adversarial Imitation Learning with Trajectorial Augmentation and Correction25 Mar 2021
Similar, not cited
Close in wording, no citation either way
- 2025Imitation Learning for Autonomous Driving: Insights from Real-World Testing
- 2022Model-Based Imitation Learning for Urban Driving
- 2025Learning to Drive by Imitating Surrounding Vehicles
- 2019Urban Driving with Conditional Imitation Learning
- 2019Safer End-to-End Autonomous Driving via Conditional Imitation Learning and Command Augmentation
- 2021Vision-Based Autonomous Car Racing Using Deep Imitative Reinforcement Learning
- 2021Semi-Supervised Imitation Learning with Mixed Qualities of Demonstrations for Autonomous Driving
- 2023Long-term Microscopic Traffic Simulation with History-Masked Multi-agent Imitation Learning