SNE-RoadSeg+: Rethinking Depth-Normal Translation and Deep Supervision for Freespace Detection
Not on the map. Why?
Abstract (arXiv)
Freespace detection is a fundamental component of autonomous driving perception. Recently, deep convolutional neural networks (DCNNs) have achieved impressive performance for this task. In particular, SNE-RoadSeg, our previously proposed method based on a surface normal estimator (SNE) and a data-fusion DCNN (RoadSeg), has achieved impressive performance in freespace detection. However, SNE-RoadSeg is computationally intensive, and it is difficult to execute in real time. To address this problem, we introduce SNE-RoadSeg+, an upgraded version of SNE-RoadSeg. SNE-RoadSeg+ consists of 1) SNE+, a module for more accurate surface normal estimation, and 2) RoadSeg+, a data-fusion DCNN that can greatly minimize the trade-off between accuracy and efficiency with the use of deep supervision. Extensive experimental results have demonstrated the effectiveness of our SNE+ for surface normal estimation and the superior performance of our SNE-RoadSeg+ over all other freespace detection approaches. Specifically, our SNE-RoadSeg+ runs in real time, and meanwhile, achieves the state-of-the-art performance on the KITTI road benchmark. Our project page is at https://www.sne-roadseg.site/sne-roadseg-plus.
Key facts. Cited by 23 papers in the map (data through 7 Oct 2026). Builds on 25 of its 36 references that are in the map. First posted on arXiv 30 Jul 2021.
Builds on
25 of 36 references.
References · 25
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
- 2017ScanNet: Richly-annotated 3D Reconstructions of Indoor Scenescited by 3,088
- 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,483
- 2019UNet++: Redesigning Skip Connections to Exploit Multiscale Features in Image Segmentationcited by 583
- 2014Deeply-Supervised Netscited by 364
- 2019DIODE: A Dense Indoor and Outdoor DEpth Datasetcited by 236
- 2019Gated-SCNN: Gated Shape CNNs for Semantic Segmentationcited by 165
- 2018Depth-aware CNN for RGB-D Segmentationcited by 73
- 2020SNE-RoadSeg: Incorporating Surface Normal Information into Semantic Segmentation for Accurate Freespace Detectioncited by 66
- 2018LIDAR-Camera Fusion for Road Detection Using Fully Convolutional Neural Networkscited by 41
13 more
- 2019Progressive LiDAR Adaptation for Road Detectioncited by 37
- 2016Marr Revisited: 2D-3D Alignment via Surface Normal Predictioncited by 34
- 2021PVStereo: Pyramid Voting Module for End-to-End Self-Supervised Stereo Matchingcited by 28
- 2019FrameNet: Learning Local Canonical Frames of 3D Surfaces from a Single RGB Imagecited by 26
- 2021Learning Interpretable End-to-End Vision-Based Motion Planning for Autonomous Driving with Optical Flow Distillationcited by 25
- 2019Road Damage Detection Based on Unsupervised Disparity Map Segmentationcited by 24
- 2021Dynamic Fusion Module Evolves Drivable Area and Road Anomaly Detection: A Benchmark and Algorithmscited by 23
- 2020Applying Surface Normal Information in Drivable Area and Road Anomaly Detection for Ground Mobile Robotscited by 20
- 2020Learning Collision-Free Space Detection from Stereo Images: Homography Matrix Brings Better Data Augmentationcited by 19
- 2020Self-Supervised Drivable Area and Road Anomaly Segmentation using RGB-D Data for Robotic Wheelchairscited by 18
- 2021End-to-End Interactive Prediction and Planning with Optical Flow Distillation for Autonomous Drivingcited by 17
- 2020Three-Filters-to-Normal: An Accurate and Ultrafast Surface Normal Estimatorcited by 14
- 2020CoT-AMFlow: Adaptive Modulation Network with Co-Teaching Strategy for Unsupervised Optical Flow Estimationcited by 10
Built on by
Citing papers per year: 2022: 6; 2023: 7; 2024: 7; 2025: 1; 2026: 2.
23 papers.
Sort:
- 2023Radar-Camera Fusion for Object Detection and Semantic Segmentation in Autonomous Driving: A Comprehensive Reviewcited by 57
- 2023RoadFormer: Duplex Transformer for RGB-Normal Semantic Road Scene Parsingcited by 27
- 2022Computer Vision for Road Imaging and Pothole Detection: A State-of-the-Art Review of Systems and Algorithmscited by 19
- 2022Fast Road Segmentation via Uncertainty-aware Symmetric Networkcited by 17
- 2024S3M-Net: Joint Learning of Semantic Segmentation and Stereo Matching for Autonomous Drivingcited by 14
- 2022A Comprehensive Review on Deep Supervision: Theories and Applicationscited by 10
- 2023D2NT: A High-Performing Depth-to-Normal Translatorcited by 10
- 2024RoadFormer+: Delivering RGB-X Scene Parsing through Scale-Aware Information Decoupling and Advanced Heterogeneous Feature Fusioncited by 9
- 2024SNE-RoadSegV2: Advancing Heterogeneous Feature Fusion and Fallibility Awareness for Freespace Detectioncited by 8
- 2024LIX: Implicitly Infusing Spatial Geometric Prior Knowledge into Visual Semantic Segmentation for Autonomous Drivingcited by 8
- 2023Multi-Modal Multi-Task (3MT) Road Segmentationcited by 6
- 2025ROD: RGB-Only Fast and Efficient Off-road Freespace Detectioncited by 5
11 more
- 2022SDA-SNE: Spatial Discontinuity-Aware Surface Normal Estimation via Multi-Directional Dynamic Programmingcited by 3
- 2023Polarimetric Imaging for Perceptioncited by 3
- 2023SkipcrossNets: Adaptive Skip-cross Fusion for Road Detectioncited by 3
- 2024TiCoSS: Tightening the Coupling between Semantic Segmentation and Stereo Matching within A Joint Learning Frameworkcited by 3
- 2024Depth Matters: Exploring Deep Interactions of RGB-D for Semantic Segmentation in Traffic Scenescited by 3
- 2022Computer-Aided Road Inspection: Systems and Algorithmscited by 2
- 2023Three-Filters-to-Normal+: Revisiting Discontinuity Discrimination in Depth-to-Normal Translationcited by 2
- 2022Cross-Modality Domain Adaptation for Freespace Detection: A Simple yet Effective Baselinecited by 1
- 2024TEDNet: Twin Encoder Decoder Neural Network for 2D Camera and LiDAR Road Detectioncited by 0
- 2026OT-Drive: Out-of-Distribution Off-Road Traversable Area Segmentation via Optimal Transportcited by 0
- 2026Towards All-Day Perception for Off-Road Driving: A Large-Scale Multispectral Dataset and Comprehensive Benchmarkcited by 0
- 2026Towards All-Day Perception for Off-Road Driving: A Large-Scale Multispectral Dataset and Comprehensive Benchmark30 Apr 2026
- 2026OT-Drive: Out-of-Distribution Off-Road Traversable Area Segmentation via Optimal Transport15 Jan 2026
- 2025ROD: RGB-Only Fast and Efficient Off-road Freespace Detection12 Aug 2025
- 2024Depth Matters: Exploring Deep Interactions of RGB-D for Semantic Segmentation in Traffic Scenes12 Sep 2024
- 2024RoadFormer+: Delivering RGB-X Scene Parsing through Scale-Aware Information Decoupling and Advanced Heterogeneous Feature Fusion31 Jul 2024
- 2024TiCoSS: Tightening the Coupling between Semantic Segmentation and Stereo Matching within A Joint Learning Framework25 Jul 2024
- 2024TEDNet: Twin Encoder Decoder Neural Network for 2D Camera and LiDAR Road Detection14 May 2024
- 2024LIX: Implicitly Infusing Spatial Geometric Prior Knowledge into Visual Semantic Segmentation for Autonomous Driving13 Mar 2024
- 2024SNE-RoadSegV2: Advancing Heterogeneous Feature Fusion and Fallibility Awareness for Freespace Detection29 Feb 2024
- 2024S3M-Net: Joint Learning of Semantic Segmentation and Stereo Matching for Autonomous Driving21 Jan 2024
- 2023Three-Filters-to-Normal+: Revisiting Discontinuity Discrimination in Depth-to-Normal Translation13 Dec 2023
- 2023RoadFormer: Duplex Transformer for RGB-Normal Semantic Road Scene Parsing19 Sep 2023
11 more
- 2023SkipcrossNets: Adaptive Skip-cross Fusion for Road Detection24 Aug 2023
- 2023Multi-Modal Multi-Task (3MT) Road Segmentation23 Aug 2023
- 2023Polarimetric Imaging for Perception24 May 2023
- 2023D2NT: A High-Performing Depth-to-Normal Translator24 Apr 2023
- 2023Radar-Camera Fusion for Object Detection and Semantic Segmentation in Autonomous Driving: A Comprehensive Review20 Apr 2023
- 2022Cross-Modality Domain Adaptation for Freespace Detection: A Simple yet Effective Baseline6 Oct 2022
- 2022SDA-SNE: Spatial Discontinuity-Aware Surface Normal Estimation via Multi-Directional Dynamic Programming18 Aug 2022
- 2022A Comprehensive Review on Deep Supervision: Theories and Applications6 Jul 2022
- 2022Computer Vision for Road Imaging and Pothole Detection: A State-of-the-Art Review of Systems and Algorithms28 Apr 2022
- 2022Fast Road Segmentation via Uncertainty-aware Symmetric Network9 Mar 2022
- 2022Computer-Aided Road Inspection: Systems and Algorithms4 Mar 2022
- 2023Radar-Camera Fusion for Object Detection and Semantic Segmentation in Autonomous Driving: A Comprehensive Reviewcited by 57
- 2023RoadFormer: Duplex Transformer for RGB-Normal Semantic Road Scene Parsingcited by 27
- 2022Computer Vision for Road Imaging and Pothole Detection: A State-of-the-Art Review of Systems and Algorithmscited by 19
- 2022Fast Road Segmentation via Uncertainty-aware Symmetric Networkcited by 17
- 2024S3M-Net: Joint Learning of Semantic Segmentation and Stereo Matching for Autonomous Drivingcited by 14
- 2022A Comprehensive Review on Deep Supervision: Theories and Applicationscited by 10
- 2023D2NT: A High-Performing Depth-to-Normal Translatorcited by 10
- 2024RoadFormer+: Delivering RGB-X Scene Parsing through Scale-Aware Information Decoupling and Advanced Heterogeneous Feature Fusioncited by 9
- 2024SNE-RoadSegV2: Advancing Heterogeneous Feature Fusion and Fallibility Awareness for Freespace Detectioncited by 8
- 2024LIX: Implicitly Infusing Spatial Geometric Prior Knowledge into Visual Semantic Segmentation for Autonomous Drivingcited by 8
- 2023Multi-Modal Multi-Task (3MT) Road Segmentationcited by 6
- 2025ROD: RGB-Only Fast and Efficient Off-road Freespace Detectioncited by 5
12 most cited of 23 All 23 (JSON)
- 2026Towards All-Day Perception for Off-Road Driving: A Large-Scale Multispectral Dataset and Comprehensive Benchmark30 Apr 2026
- 2026OT-Drive: Out-of-Distribution Off-Road Traversable Area Segmentation via Optimal Transport15 Jan 2026
- 2025ROD: RGB-Only Fast and Efficient Off-road Freespace Detection12 Aug 2025
- 2024Depth Matters: Exploring Deep Interactions of RGB-D for Semantic Segmentation in Traffic Scenes12 Sep 2024
- 2024RoadFormer+: Delivering RGB-X Scene Parsing through Scale-Aware Information Decoupling and Advanced Heterogeneous Feature Fusion31 Jul 2024
- 2024TiCoSS: Tightening the Coupling between Semantic Segmentation and Stereo Matching within A Joint Learning Framework25 Jul 2024
- 2024TEDNet: Twin Encoder Decoder Neural Network for 2D Camera and LiDAR Road Detection14 May 2024
- 2024LIX: Implicitly Infusing Spatial Geometric Prior Knowledge into Visual Semantic Segmentation for Autonomous Driving13 Mar 2024
- 2024SNE-RoadSegV2: Advancing Heterogeneous Feature Fusion and Fallibility Awareness for Freespace Detection29 Feb 2024
- 2024S3M-Net: Joint Learning of Semantic Segmentation and Stereo Matching for Autonomous Driving21 Jan 2024
- 2023Three-Filters-to-Normal+: Revisiting Discontinuity Discrimination in Depth-to-Normal Translation13 Dec 2023
- 2023RoadFormer: Duplex Transformer for RGB-Normal Semantic Road Scene Parsing19 Sep 2023
12 newest of 23 All 23 (JSON)