Sim2Dust: Mastering Dynamic Waypoint Tracking on Granular Media
On the map: Deep reinforcement learning methods → RL for robot navigation and UAV control
Abstract (arXiv)
Reliable autonomous navigation across the unstructured terrains of distant planetary surfaces is a critical enabler for future space exploration. However, the deployment of learning-based controllers is hindered by the inherent sim-to-real gap, particularly for the complex dynamics of wheel interactions with granular media. This work presents a complete sim-to-real framework for developing and validating robust control policies for dynamic waypoint tracking on such challenging surfaces. We leverage massively parallel simulation to train reinforcement learning agents across a vast distribution of procedurally generated environments with randomized physics. These policies are then transferred zero-shot to a physical wheeled rover operating in a lunar-analogue facility. Our experiments systematically compare multiple reinforcement learning algorithms and action smoothing filters to identify the most effective combinations for real-world deployment. Crucially, we provide strong empirical evidence that agents trained with procedural diversity achieve superior zero-shot performance compared to those trained on static scenarios. We also analyze the trade-offs of fine-tuning with high-fidelity particle physics, which offers minor gains in low-speed precision at a significant computational cost. Together, these contributions establish a validated workflow for creating reliable learning-based navigation systems, marking a substantial step towards deploying autonomous robots in the final frontier.
Key facts. Cited by 3 papers in the map (data through 14 Oct 2026). Placed in RL for robot navigation and UAV control, one of 15 directions in Deep reinforcement learning methods. Builds on 10 of its 33 references that are in the map. First posted on arXiv 15 Aug 2025.
Builds on
10 of 33 references.
References · 10
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2018Addressing Function Approximation Error in Actor-Critic Methodscited by 2,417
- 2017Domain Randomization for Transferring Deep Neural Networks from Simulation to the Real Worldcited by 1,498
- 2019Leveraging Procedural Generation to Benchmark Reinforcement Learningcited by 483
- 2023Orbit: A Unified Simulation Framework for Interactive Robot Learning Environmentscited by 295
- 2022Robot Operating System 2: Design, Architecture, and Uses In The Wildcited by 199
- 2017Using Simulation and Domain Adaptation to Improve Efficiency of Deep Robotic Graspingcited by 144
- 2024Reinforcement Learning for Wheeled Mobility on Vertically Challenging Terraincited by 7
- 2023RANS: Highly-Parallelised Simulator for Reinforcement Learning based Autonomous Navigating Spacecraftscited by 6
- 2021MarsExplorer: Exploration of Unknown Terrains via Deep Reinforcement Learning and Procedurally Generated Environmentscited by 4
Built on by
Citing papers per year: 2025: 2; 2026: 1.
3 papers.
Similar, not cited
Close in wording, no citation either way
- 2025Space Robotics Bench: Robot Learning Beyond Earth
- 2025Transferable Deep Reinforcement Learning for Cross-Domain Navigation: from Farmland to the Moon
- 2026Latent Space Reinforcement Learning for Multi-Robot Exploration
- 2025Abstracting Geo-specific Terrains to Scale Up Reinforcement Learning
- 2023Learning whom to trust in navigation: dynamically switching between classical and neural planning
- 2024Back to Newton's Laws: Learning Vision-based Agile Flight via Differentiable Physics
- 2026End-to-End Vision-Language-Action Policies for Autonomous Lunar Rover Docking
- 2025Multi-Modal Decentralized Reinforcement Learning for Modular Reconfigurable Lunar Robots