Fast Road Segmentation via Uncertainty-aware Symmetric Network
Not on the map. Why?
Abstract (arXiv)
The high performance of RGB-D based road segmentation methods contrasts with their rare application in commercial autonomous driving, which is owing to two reasons: 1) the prior methods cannot achieve high inference speed and high accuracy in both ways; 2) the different properties of RGB and depth data are not well-exploited, limiting the reliability of predicted road. In this paper, based on the evidence theory, an uncertainty-aware symmetric network (USNet) is proposed to achieve a trade-off between speed and accuracy by fully fusing RGB and depth data. Firstly, cross-modal feature fusion operations, which are indispensable in the prior RGB-D based methods, are abandoned. We instead separately adopt two light-weight subnetworks to learn road representations from RGB and depth inputs. The light-weight structure guarantees the real-time inference of our method. Moreover, a multiscale evidence collection (MEC) module is designed to collect evidence in multiple scales for each modality, which provides sufficient evidence for pixel class determination. Finally, in uncertainty-aware fusion (UAF) module, the uncertainty of each modality is perceived to guide the fusion of the two subnetworks. Experimental results demonstrate that our method achieves a state-of-the-art accuracy with real-time inference speed of 43+ FPS. The source code is available at https://github.com/morancyc/USNet.
Key facts. Cited by 17 papers in the map (data through 7 Oct 2026). Builds on 28 of its 42 references that are in the map. First posted on arXiv 9 Mar 2022.
Builds on
28 of 42 references.
References · 28
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,617
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2017Squeeze-and-Excitation Networkscited by 4,763
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,427
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
- 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,483
- 2018Evidential Deep Learning to Quantify Classification Uncertaintycited by 728
- 2015Holistically-Nested Edge Detectioncited by 590
- 2020Bi-directional Cross-Modality Feature Propagation with Separation-and-Aggregation Gate for RGB-D Semantic Segmentationcited by 120
- 2019TANet: Robust 3D Object Detection from Point Clouds with Triple Attentioncited by 108
16 more
- 2019ACNet: Attention Based Network to Exploit Complementary Features for RGBD Semantic Segmentationcited by 105
- 2021Trusted Multi-View Classificationcited by 94
- 2016MultiNet: Real-time Joint Semantic Reasoning for Autonomous Drivingcited by 90
- 2020SNE-RoadSeg: Incorporating Surface Normal Information into Semantic Segmentation for Accurate Freespace Detectioncited by 66
- 2018LIDAR-Camera Fusion for Road Detection Using Fully Convolutional Neural Networkscited by 41
- 2019Progressive LiDAR Adaptation for Road Detectioncited by 37
- 2020Real-time Fusion Network for RGB-D Semantic Segmentation Incorporating Unexpected Obstacle Detection for Road-driving Imagescited by 36
- 2021Dynamic Fusion Module Evolves Drivable Area and Road Anomaly Detection: A Benchmark and Algorithmscited by 23
- 2021SNE-RoadSeg+: Rethinking Depth-Normal Translation and Deep Supervision for Freespace Detectioncited by 23
- 2020Applying Surface Normal Information in Drivable Area and Road Anomaly Detection for Ground Mobile Robotscited by 20
- 2019Occlusion-shared and Feature-separated Network for Occlusion Relationship Reasoningcited by 16
- 2019A Novel Multi-layer Framework for Tiny Obstacle Discoverycited by 14
- 2021Video Text Tracking With a Spatio-Temporal Complementary Modelcited by 10
- 2021Tiny Obstacle Discovery by Occlusion-Aware Multilayer Regressioncited by 9
- 2019Embedding Structured Contour and Location Prior in Siamesed Fully Convolutional Networks for Road Detectioncited by 7
- 2019RoadTrack: Realtime Tracking of Road Agents in Dense and Heterogeneous Environmentscited by 3
Built on by
Citing papers per year: 2022: 1; 2023: 4; 2024: 10; 2025: 1; 2026: 1.
17 papers.
Sort:
By area:
- 2023Provable Dynamic Fusion for Low-Quality Multimodal Datacited by 81
- 2024Multimodal Fusion on Low-quality Data: A Comprehensive Surveycited by 48
- 2024A Comprehensive Survey on Evidential Deep Learning and Its Applicationscited by 25
- 2024AnomalyNCD: Towards Novel Anomaly Class Discovery in Industrial Scenarioscited by 9
- 2024SNE-RoadSegV2: Advancing Heterogeneous Feature Fusion and Fallibility Awareness for Freespace Detectioncited by 8
- 2023Multi-Modal Multi-Task (3MT) Road Segmentationcited by 6
- 2024Evidential Semantic Mapping in Off-road Environments with Uncertainty-aware Bayesian Kernel Inferencecited by 6
- 2023Polarimetric Imaging for Perceptioncited by 3
- 2023SkipcrossNets: Adaptive Skip-cross Fusion for Road Detectioncited by 3
- 2024Depth Matters: Exploring Deep Interactions of RGB-D for Semantic Segmentation in Traffic Scenescited by 3
- 2024SM4Depth: Seamless Monocular Metric Depth Estimation across Multiple Cameras and Scenes by One Modelcited by 2
- 2024Uncertainty-aware Semantic Mapping in Off-road Environments with Dempster-Shafer Theory of Evidencecited by 2
5 more
- 2022Cross-Modality Domain Adaptation for Freespace Detection: A Simple yet Effective Baselinecited by 1
- 2024Erase, then Redraw: A Novel Data Augmentation Approach for Free Space Detection Using Diffusion Modelcited by 1
- 2024Task-Oriented Pre-Training for Drivable Area Detectioncited by 1
- 2026LiteViLNet: Lightweight Vision-LiDAR Fusion Network for Efficient Road Segmentationcited by 1
- 2025Towards Reliable Detection of Empty Space: Conditional Marked Point Processes for Object Detectioncited by 0
- 2026LiteViLNet: Lightweight Vision-LiDAR Fusion Network for Efficient Road Segmentation20 May 2026
- 2025Towards Reliable Detection of Empty Space: Conditional Marked Point Processes for Object Detection26 Jun 2025
- 2024AnomalyNCD: Towards Novel Anomaly Class Discovery in Industrial Scenarios18 Oct 2024
- 2024Task-Oriented Pre-Training for Drivable Area Detection30 Sep 2024
- 2024Erase, then Redraw: A Novel Data Augmentation Approach for Free Space Detection Using Diffusion Model30 Sep 2024
- 2024Depth Matters: Exploring Deep Interactions of RGB-D for Semantic Segmentation in Traffic Scenes12 Sep 2024
- 2024A Comprehensive Survey on Evidential Deep Learning and Its Applications7 Sep 2024
- 2024Uncertainty-aware Semantic Mapping in Off-road Environments with Dempster-Shafer Theory of Evidence10 May 2024
- 2024Multimodal Fusion on Low-quality Data: A Comprehensive Survey27 Apr 2024
- 2024Evidential Semantic Mapping in Off-road Environments with Uncertainty-aware Bayesian Kernel Inference21 Mar 2024
- 2024SM4Depth: Seamless Monocular Metric Depth Estimation across Multiple Cameras and Scenes by One Model13 Mar 2024
- 2024SNE-RoadSegV2: Advancing Heterogeneous Feature Fusion and Fallibility Awareness for Freespace Detection29 Feb 2024
5 more
- 2023SkipcrossNets: Adaptive Skip-cross Fusion for Road Detection24 Aug 2023
- 2023Multi-Modal Multi-Task (3MT) Road Segmentation23 Aug 2023
- 2023Provable Dynamic Fusion for Low-Quality Multimodal Data3 Jun 2023
- 2023Polarimetric Imaging for Perception24 May 2023
- 2022Cross-Modality Domain Adaptation for Freespace Detection: A Simple yet Effective Baseline6 Oct 2022
- 2023Provable Dynamic Fusion for Low-Quality Multimodal Datacited by 81
- 2024Multimodal Fusion on Low-quality Data: A Comprehensive Surveycited by 48
- 2024A Comprehensive Survey on Evidential Deep Learning and Its Applicationscited by 25
- 2024AnomalyNCD: Towards Novel Anomaly Class Discovery in Industrial Scenarioscited by 9
- 2024SNE-RoadSegV2: Advancing Heterogeneous Feature Fusion and Fallibility Awareness for Freespace Detectioncited by 8
- 2023Multi-Modal Multi-Task (3MT) Road Segmentationcited by 6
- 2024Evidential Semantic Mapping in Off-road Environments with Uncertainty-aware Bayesian Kernel Inferencecited by 6
- 2023Polarimetric Imaging for Perceptioncited by 3
- 2023SkipcrossNets: Adaptive Skip-cross Fusion for Road Detectioncited by 3
- 2024Depth Matters: Exploring Deep Interactions of RGB-D for Semantic Segmentation in Traffic Scenescited by 3
- 2024SM4Depth: Seamless Monocular Metric Depth Estimation across Multiple Cameras and Scenes by One Modelcited by 2
- 2024Uncertainty-aware Semantic Mapping in Off-road Environments with Dempster-Shafer Theory of Evidencecited by 2
12 most cited of 16 All 16 (JSON)
- 2026LiteViLNet: Lightweight Vision-LiDAR Fusion Network for Efficient Road Segmentation20 May 2026
- 2025Towards Reliable Detection of Empty Space: Conditional Marked Point Processes for Object Detection26 Jun 2025
- 2024AnomalyNCD: Towards Novel Anomaly Class Discovery in Industrial Scenarios18 Oct 2024
- 2024Task-Oriented Pre-Training for Drivable Area Detection30 Sep 2024
- 2024Depth Matters: Exploring Deep Interactions of RGB-D for Semantic Segmentation in Traffic Scenes12 Sep 2024
- 2024A Comprehensive Survey on Evidential Deep Learning and Its Applications7 Sep 2024
- 2024Uncertainty-aware Semantic Mapping in Off-road Environments with Dempster-Shafer Theory of Evidence10 May 2024
- 2024Multimodal Fusion on Low-quality Data: A Comprehensive Survey27 Apr 2024
- 2024Evidential Semantic Mapping in Off-road Environments with Uncertainty-aware Bayesian Kernel Inference21 Mar 2024
- 2024SM4Depth: Seamless Monocular Metric Depth Estimation across Multiple Cameras and Scenes by One Model13 Mar 2024
- 2024SNE-RoadSegV2: Advancing Heterogeneous Feature Fusion and Fallibility Awareness for Freespace Detection29 Feb 2024
- 2023SkipcrossNets: Adaptive Skip-cross Fusion for Road Detection24 Aug 2023
12 newest of 16 All 16 (JSON)