mlsanityData to 7 Oct 2026

Sim-to-Real Aware End-to-End Learning Environment for Micromobility

arXiv 2609.28969 ↗First posted 24 Sep 2026cs.ROcited by 0

On the map: End-to-end autonomous driving → Imitation-learning end-to-end planners also fits: Reinforcement learning for driving

Abstract (arXiv)

While end-to-end autonomous driving systems show promise, their application to micromobility vehicles is hindered by simulators failing to capture specific kinematics, such as differential drives and omni-wheels. This paper pro- poses a sim-to-real-aware, vehicle-specific end-to-end learning environment for the WHILL Model CR on AWSIM and ROS 2. To minimize the sim-to-real gap, physical parameters are optimized via Bayesian optimization using real-world data, reducing trajectory errors across various driving scenarios. Additionally, this study introduces a synchronized architecture tailored for the stable training of world model-based agents. An end-to-end policy trained with DreamerV3 exhibited learning progress and achieved task completion in a simulated obstacle avoidance setting. Furthermore, this policy demonstrated direct sim-to-real transfer to the physical vehicle, enabling the vehicle to navigate around a cardboard box in a real-world corridor replica without fine-tuning. This paper provides a practical foundation for sim-to-real micromobility policy studies.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in Imitation-learning end-to-end planners, one of 9 directions in End-to-end autonomous driving. Builds on 19 of its 24 references that are in the map. First posted on arXiv 24 Sep 2026.

Builds on

19 of 24 references.

References · 19

  1. 2019Optuna: A Next-generation Hyperparameter Optimization Frameworkcited by 2,455
  2. 2017CARLA: An Open Urban Driving Simulatorcited by 2,431
  3. 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,401
  4. 2023Mastering Diverse Domains through World Modelscited by 1,193
  5. 2023GAIA-1: A Generative World Model for Autonomous Drivingcited by 618
  6. 2017AirSim: High-Fidelity Visual and Physical Simulation for Autonomous Vehiclescited by 517
  7. 2023End-to-end Autonomous Driving: Challenges and Frontierscited by 485
  8. 2022DayDreamer: World Models for Physical Robot Learningcited by 372
  9. 2024EMMA: End-to-End Multimodal Model for Autonomous Drivingcited by 226
  10. 2022KISS-ICP: In Defense of Point-to-Point ICP -- Simple, Accurate, and Robust Registration If Done the Right Waycited by 132
  11. 2024World Models for Autonomous Driving: An Initial Surveycited by 79
  12. 2025A Survey of World Models for Autonomous Drivingcited by 60
7 more
  1. 2024End-to-End Autonomous Driving through V2X Cooperationcited by 42
  2. 2024MetaUrban: An Embodied AI Simulation Platform for Urban Micromobilitycited by 19
  3. 2025Towards Autonomous Micromobility through Scalable Urban Simulationcited by 16
  4. 2024CarDreamer: Open-Source Learning Platform for World Model based Autonomous Drivingcited by 13
  5. 2025Sim-to-Real Transfer for Mobile Robots with Reinforcement Learning: from NVIDIA Isaac Sim to Gazebo and Real ROS 2 Robotscited by 6
  6. 2025D-AWSIM: Distributed Autonomous Driving Simulator for Dynamic Map Generation Frameworkcited by 2
  7. 2025Follow-Me in Micro-Mobility with End-to-End Imitation Learningcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2026Sim2Real-AD: A Modular Sim-to-Real Framework for Deploying VLM-Guided Reinforcement Learning in Real-World Autonomous Driving
  2. 2026A Survey on End-to-End Autonomous Driving Training from the Perspectives of Data, Strategy, and Platform
  3. 2025RAD: Training an End-to-End Driving Policy via Large-Scale 3DGS-based Reinforcement Learning
  4. 2022Sim-to-Real via Sim-to-Seg: End-to-end Off-road Autonomous Driving Without Real Data
  5. 2025Model-Based Policy Adaptation for Closed-Loop End-to-End Autonomous Driving
  6. 2026From Virtual Environments to Real-World Trials: Emerging Trends in Autonomous Driving
  7. 2026MILER: Semantic Mid-Level Representation for Sim-to-Real Reinforcement Learning in Unstructured Autonomous Driving
  8. 2025Sim2Real Diffusion: Leveraging Foundation Vision Language Models for Adaptive Automated Driving