Sim-to-Real Aware End-to-End Learning Environment for Micromobility
On the map: End-to-end autonomous driving → Imitation-learning end-to-end planners also fits: Reinforcement learning for driving
Abstract (arXiv)
While end-to-end autonomous driving systems show promise, their application to micromobility vehicles is hindered by simulators failing to capture specific kinematics, such as differential drives and omni-wheels. This paper pro- poses a sim-to-real-aware, vehicle-specific end-to-end learning environment for the WHILL Model CR on AWSIM and ROS 2. To minimize the sim-to-real gap, physical parameters are optimized via Bayesian optimization using real-world data, reducing trajectory errors across various driving scenarios. Additionally, this study introduces a synchronized architecture tailored for the stable training of world model-based agents. An end-to-end policy trained with DreamerV3 exhibited learning progress and achieved task completion in a simulated obstacle avoidance setting. Furthermore, this policy demonstrated direct sim-to-real transfer to the physical vehicle, enabling the vehicle to navigate around a cardboard box in a real-world corridor replica without fine-tuning. This paper provides a practical foundation for sim-to-real micromobility policy studies.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Imitation-learning end-to-end planners, one of 9 directions in End-to-end autonomous driving. Builds on 19 of its 24 references that are in the map. First posted on arXiv 24 Sep 2026.
Builds on
19 of 24 references.
References · 19
- 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
- 2023Mastering Diverse Domains through World Modelscited by 1,193
- 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 618
- 2017AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehiclescited by 517
- 2023End-to-end Autonomous Driving: Challenges and Frontierscited by 485
- 2022DayDreamer: World Models for Physical Robot Learningcited by 372
- 2024EMMA: End-to-End Multimodal Model for Autonomous Drivingcited by 226
- 2022KISS-ICP: In Defense of Point-to-Point ICP -- Simple, Accurate, and Robust Registration If Done the Right Waycited by 132
- 2024World Models for Autonomous Driving: An Initial Surveycited by 79
- 2025A Survey of World Models for Autonomous Drivingcited by 60
7 more
- 2024End-to-End Autonomous Driving through V2X Cooperationcited by 42
- 2024MetaUrban: An Embodied AI Simulation Platform for Urban Micromobilitycited by 19
- 2025Towards Autonomous Micromobility through Scalable Urban Simulationcited by 16
- 2024CarDreamer: Open-Source Learning Platform for World Model based Autonomous Drivingcited by 13
- 2025Sim-to-Real Transfer for Mobile Robots with Reinforcement Learning: from NVIDIA Isaac Sim to Gazebo and Real ROS 2 Robotscited by 6
- 2025D-AWSIM: Distributed Autonomous Driving Simulator for Dynamic Map Generation Frameworkcited by 2
- 2025Follow-Me in Micro-Mobility with End-to-End Imitation Learningcited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Sim2Real-AD: A Modular Sim-to-Real Framework for Deploying VLM-Guided Reinforcement Learning in Real-World Autonomous Driving
- 2026A Survey on End-to-End Autonomous Driving Training from the Perspectives of Data, Strategy, and Platform
- 2025RAD: Training an End-to-End Driving Policy via Large-Scale 3DGS-based Reinforcement Learning
- 2022Sim-to-Real via Sim-to-Seg: End-to-end Off-road Autonomous Driving Without Real Data
- 2025Model-Based Policy Adaptation for Closed-Loop End-to-End Autonomous Driving
- 2026From Virtual Environments to Real-World Trials: Emerging Trends in Autonomous Driving
- 2026MILER: Semantic Mid-Level Representation for Sim-to-Real Reinforcement Learning in Unstructured Autonomous Driving
- 2025Sim2Real Diffusion: Leveraging Foundation Vision Language Models for Adaptive Automated Driving