FusionPlanner: A Multi-task Motion Planner for Mining Trucks via Multi-sensor Fusion
Not on the map. Why?
Abstract (arXiv)
In recent years, significant achievements have been made in motion planning for intelligent vehicles. However, as a typical unstructured environment, open-pit mining attracts limited attention due to its complex operational conditions and adverse environmental factors. A comprehensive paradigm for unmanned transportation in open-pit mines is proposed in this research. Firstly, we propose a multi-task motion planning algorithm, called FusionPlanner, for autonomous mining trucks by the multi-sensor fusion method to adapt both lateral and longitudinal control tasks for unmanned transportation. Then, we develop a novel benchmark called MiningNav, which offers three validation approaches to evaluate the trustworthiness and robustness of well-trained algorithms in transportation roads of open-pit mines. Finally, we introduce the Parallel Mining Simulator (PMS), a new high-fidelity simulator specifically designed for open-pit mining scenarios. PMS enables the users to manage and control open-pit mine transportation from both the single-truck control and multi-truck scheduling perspectives. The performance of FusionPlanner is tested by MiningNav in PMS, and the empirical results demonstrate a significant reduction in the number of collisions and takeovers of our planner. We anticipate our unmanned transportation paradigm will bring mining trucks one step closer to trustworthiness and robustness in continuous round-the-clock unmanned transportation.
Key facts. Cited by 7 papers in the map (data through 14 Oct 2026). Builds on 37 of its 74 references that are in the map. First posted on arXiv 14 Aug 2023.
Builds on
37 of 74 references.
References · 37
- 2017CARLA: An Open Urban Driving Simulatorcited by 2,449
- 2017Multi-Task Learning Using Uncertainty to Weigh Losses for Scene Geometry and Semanticscited by 1,358
- 20194D Spatio-Temporal ConvNets: Minkowski Convolutional Neural Networkscited by 1,208
- 2022Planning-oriented Autonomous Drivingcited by 1,087
- 2016End to End Learning for Self-Driving Carscited by 1,009
- 2022BEVFusion: Multi-Task Multi-Sensor Fusion with Unified Bird's-Eye View Representationcited by 850
- 2017A Survey on Multi-Task Learningcited by 840
- 2017Channel Pruning for Accelerating Very Deep Neural Networkscited by 702
- 2017End-to-end Driving via Conditional Imitation Learningcited by 485
- 2022TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Drivingcited by 485
- 2019Learning by Cheatingcited by 383
- 2018AMC: AutoML for Model Compression and Acceleration on Mobile Devicescited by 378
25 more
- 2021Multi-Modal Fusion Transformer for End-to-End Autonomous Drivingcited by 377
- 2019Deep Evidential Regressioncited by 355
- 2019Exploring the Limitations of Behavior Cloning for Autonomous Drivingcited by 346
- 2019Point-Voxel CNN for Efficient 3D Deep Learningcited by 343
- 2019Causal Confusion in Imitation Learningcited by 288
- 2021End-to-End Urban Driving by Imitating a Reinforcement Learning Coachcited by 194
- 2023V2V4Real: A Real-world Large-scale Dataset for Vehicle-to-Vehicle Cooperative Perceptioncited by 155
- 2022Learning from All Vehiclescited by 135
- 2020SMARTS: Scalable Multi-Agent Reinforcement Learning Training School for Autonomous Drivingcited by 121
- 2019CityFlow: A Multi-Agent Reinforcement Learning Environment for Large Scale City Traffic Scenariocited by 115
- 2023Motion Planning for Autonomous Driving: The State of the Art and Future Perspectivescited by 114
- 2023Milestones in Autonomous Driving and Intelligent Vehicles: Survey of Surveyscited by 75
- 2022TorchSparse: Efficient Point Cloud Inference Enginecited by 73
- 2018On Offline Evaluation of Vision-based Driving Modelscited by 64
- 2019Multi-Agent Connected Autonomous Driving using Deep Reinforcement Learningcited by 53
- 2019SUMMIT: A Simulator for Urban Driving in Massive Mixed Trafficcited by 40
- 2017Sim4CV: A Photo-Realistic Simulator for Computer Vision Applicationscited by 31
- 2017Beyond Grand Theft Auto V for Training, Testing and Enhancing Deep Learning in Self Driving Carscited by 26
- 2023Milestones in Autonomous Driving and Intelligent Vehicles Part I: Control, Computing System Design, Communication, HD Map, Testing, and Human Behaviorscited by 25
- 2021DriverGym: Democratising Reinforcement Learning for Autonomous Drivingcited by 23
- 2021Efficient and Robust LiDAR-Based End-to-End Navigationcited by 22
- 2020MADRaS : Multi Agent Driving Simulatorcited by 15
- 2022Robustness and Adaptability of Reinforcement Learning based Cooperative Autonomous Driving in Mixed-autonomy Trafficcited by 15
- 2023Milestones in Autonomous Driving and Intelligent Vehicles Part II: Perception and Planningcited by 9
- 2022On robust risk-based active-learning algorithms for enhanced decision supportcited by 8
Built on by
Citing papers per year: 2023: 1; 2024: 4; 2025: 2.
7 papers.
- 2023Enhancing Traffic Object Detection in Variable Illumination with RGB-Event Fusioncited by 16
- 2024Boosting Visual Recognition in Real-world Degradations via Unsupervised Feature Enhancement Module with Deep Channel Priorcited by 5
- 2024Leveraging Anchor-based LiDAR 3D Object Detection via Point Assisted Sample Selectioncited by 1
- 2024Scenario Engineering for Autonomous Transportation: A New Stage in Open-Pit Minescited by 1
- 2024Scenarios Engineering driven Autonomous Transportation in Open-Pit Minescited by 0
- 2025DCReg: Decoupled Characterization for Efficient Degenerate LiDAR Registrationcited by 0
- 2025CGoT: A Novel Inference Mechanism for Embodied Multi-Agent Systems Using Composable Graphs of Thoughtscited by 0
- 2025CGoT: A Novel Inference Mechanism for Embodied Multi-Agent Systems Using Composable Graphs of Thoughts25 Oct 2025
- 2025DCReg: Decoupled Characterization for Efficient Degenerate LiDAR Registration8 Sep 2025
- 2024Boosting Visual Recognition in Real-world Degradations via Unsupervised Feature Enhancement Module with Deep Channel Prior2 Apr 2024
- 2024Scenario Engineering for Autonomous Transportation: A New Stage in Open-Pit Mines15 Mar 2024
- 2024Scenarios Engineering driven Autonomous Transportation in Open-Pit Mines15 Mar 2024
- 2024Leveraging Anchor-based LiDAR 3D Object Detection via Point Assisted Sample Selection4 Mar 2024
- 2023Enhancing Traffic Object Detection in Variable Illumination with RGB-Event Fusion1 Nov 2023