URA*: Uncertainty-aware Path Planning using Image-based Aerial-to-Ground Traversability Estimation for Off-road Environments
Not on the map. Why?
Abstract (arXiv)
A major challenge with off-road autonomous navigation is the lack of maps or road markings that can be used to plan a path for autonomous robots. Classical path planning methods mostly assume a perfectly known environment without accounting for the inherent perception and sensing uncertainty from detecting terrain and obstacles in off-road environments. Recent work in computer vision and deep neural networks has advanced the capability of terrain traversability segmentation from raw images; however, the feasibility of using these noisy segmentation maps for navigation and path planning has not been adequately explored. To address this problem, this research proposes an uncertainty-aware path planning method, URA* using aerial images for autonomous navigation in off-road environments. An ensemble convolutional neural network (CNN) model is first used to perform pixel-level traversability estimation from aerial images of the region of interest. The traversability predictions are represented as a grid of traversal probability values. An uncertainty-aware planner is then applied to compute the best path from a start point to a goal point given these noisy traversal probability estimates. The proposed planner also incorporates replanning techniques to allow rapid replanning during online robot operation. The proposed method is evaluated on the Massachusetts Road Dataset, the DeepGlobe dataset, as well as a dataset of aerial images from off-road proving grounds at Mississippi State University. Results show that the proposed image segmentation and planning methods outperform conventional planning algorithms in terms of the quality and feasibility of the initial path, as well as the quality of replanned paths.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 22 of its 60 references that are in the map. First posted on arXiv 15 Sep 2023.
Builds on
22 of 60 references.
References · 22
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
- 2022Planning-oriented Autonomous Drivingcited by 1,087
- 2017Generalised Dice overlap as a deep learning loss function for highly unbalanced segmentationscited by 620
- 2021KITTI-360: A Novel Dataset and Benchmarks for Urban Scene Understanding in 2D and 3Dcited by 575
- 2017Road Extraction by Deep Residual U-Netcited by 333
- 2018DeepGlobe 2018: A Challenge to Parse the Earth through Satellite Imagescited by 277
- 2020Perceive, Predict, and Plan: Safe Motion Planning Through Interpretable Semantic Representationscited by 153
- 2020SegFix: Model-Agnostic Boundary Refinement for Segmentationcited by 97
10 more
- 2021LookOut: Diverse Multi-Future Prediction and Planning for Self-Drivingcited by 96
- 2022Deep Hierarchical Semantic Segmentationcited by 84
- 2021Topology Preserving Local Road Network Estimation from Single Onboard Camera Imagecited by 34
- 2022ORFD: A Dataset and Benchmark for Off-Road Freespace Detectioncited by 33
- 2018Search-based optimal motion planning for automated drivingcited by 24
- 2022On the Road to Online Adaptation for Semantic Image Segmentationcited by 23
- 2017Learning Ground Traversability from Simulationscited by 20
- 2021SPIN Road Mapper: Extracting Roads from Aerial Images via Spatial and Interaction Space Graph Reasoning for Autonomous Drivingcited by 18
- 2021DG-Labeler and DGL-MOTS Dataset: Boost the Autonomous Driving Perceptioncited by 10
- 2021Multi-Objective Path-Based D* Litecited by 7
Built on by
Citing papers per year: 2023: 1; 2024: 1.
2 papers.