A Low-Cost, Open Platform for End-to-End Autonomous Driving on a Miniature Ackermann Vehicle
On the map: End-to-end autonomous driving → Imitation-learning end-to-end planners
Abstract (arXiv)
This paper presents a low-cost, open experimental platform for research in end-to-end autonomous driving with miniature Ackermann vehicles. The platform combines a physical vehicle, a printed urban track, data collection tools, trajectory registration, and a Webots digital twin, enabling controlled experiments that connect simulation-based autonomous-driving methods to real-world execution. As a first baseline, we implement command-conditioned behavior cloning, in which a neural policy receives an on-board camera image and a high-level navigation command and outputs steering and speed. The system is evaluated both on the physical vehicle and in simulation. In real closed-loop experiments, the learned policy follows lanes and executes commanded turns, reaching a mean cross-track error of 6.1 cm with respect to the reference route, close to the 4.7 cm observed in human demonstrations. In the digital twin, camera field of view has a strong effect on performance, reducing the mean cross-track error from 35.6 to 3.3 cm when widened from 58 to 120 degrees. Using the digital twin to generate synthetic driving data and a learned sim-to-real image translator to reduce the appearance gap, we further show that a higher-capacity policy trained on this synthetic data combined with real demonstrations is the only configuration that completes all four track routes in closed loop, whereas the compact baseline and the same network trained on real data alone complete fewer. These results establish the open platform as a practical testbed for sim-to-real studies and provide an initial command-conditioned imitation-learning baseline; we release it to support reproducible research.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Imitation-learning end-to-end planners, one of 9 directions in End-to-end autonomous driving. Builds on 13 of its 21 references that are in the map. First posted on arXiv 3 Sep 2026.
Builds on
13 of 21 references.
References · 13
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
- 2017End-to-end Driving via Conditional Imitation Learningcited by 479
- 2021Implicit Behavioral Cloningcited by 442
- 2019Learning by Cheatingcited by 361
- 2019Exploring the Limitations of Behavior Cloning for Autonomous Drivingcited by 343
- 2016Learning from Simulated and Unsupervised Images through Adversarial Trainingcited by 287
- 2016A Survey of Motion Planning and Control Techniques for Self-driving Urban Vehiclescited by 251
- 2022Robot Operating System 2: Design, Architecture, and Uses In The Wildcited by 190
- 2017DeepPicar: A Low-cost Deep Neural Network-based Autonomous Carcited by 11
1 more
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026A Survey on End-to-End Autonomous Driving Training from the Perspectives of Data, Strategy, and Platform
- 2022Reinforcement Learning from Simulation to Real World Autonomous Driving using Digital Twin
- 2026DriveZero: End-to-End Driving Beyond Human Demonstrations
- 2026Imitation Learning for Autonomous Driving in CARLA
- 2025RoaD: Rollouts as Demonstrations for Closed-Loop Supervised Fine-Tuning of Autonomous Driving Policies
- 2021Urban Driver: Learning to Drive from Real-world Demonstrations Using Policy Gradients
- 2026Scaling Self-Play for End-to-End Driving
- 2026Planning-Oriented End-to-End Autonomous Driving: Architectures, Evaluation, and Emerging Paradigms