DooDLeNet: Double DeepLab Enhanced Feature Fusion for Thermal-color Semantic Segmentation
Not on the map. Why?
Abstract (arXiv)
In this paper we present a new approach for feature fusion between RGB and LWIR Thermal images for the task of semantic segmentation for driving perception. We propose DooDLeNet, a double DeepLab architecture with specialized encoder-decoders for thermal and color modalities and a shared decoder for final segmentation. We combine two strategies for feature fusion: confidence weighting and correlation weighting. We report state-of-the-art mean IoU results on the MF dataset.
Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 21 of its 30 references that are in the map. First posted on arXiv 21 Apr 2022.
Builds on
21 of 30 references.
References · 21
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2019PyTorch: An Imperative Style, High-Performance Deep Learning Librarycited by 20,305
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,859
- 2016The Cityscapes Dataset for Semantic Urban Scene Understandingcited by 4,444
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,241
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,223
- 2021SegFormer: Simple and Efficient Design for Semantic Segmentation with Transformerscited by 2,940
- 2016Pyramid Scene Parsing Networkcited by 2,479
- 2015SegNet: A Deep Convolutional Encoder-Decoder Architecture for Image Segmentationcited by 1,487
- 2018BDD100K: A Diverse Driving Dataset for Heterogeneous Multitask Learningcited by 1,288
- 2018Dual Attention Network for Scene Segmentationcited by 1,003
9 more
- 2018BiSeNet: Bilateral Segmentation Network for Real-time Semantic Segmentationcited by 645
- 2015Learning Deconvolution Network for Semantic Segmentationcited by 365
- 2019High-Resolution Representations for Labeling Pixels and Regionscited by 211
- 2017Convolutional neural network architecture for geometric matchingcited by 138
- 2020Context Prior for Scene Segmentationcited by 121
- 2018Learning a Discriminative Feature Network for Semantic Segmentationcited by 114
- 2018Depth-aware CNN for RGB-D Segmentationcited by 74
- 2016Full-Resolution Residual Networks for Semantic Segmentation in Street Scenescited by 71
- 2021FEANet: Feature-Enhanced Attention Network for RGB-Thermal Real-time Semantic Segmentationcited by 45
Built on by
Citing papers per year: 2023: 4; 2024: 4; 2025: 2; 2026: 3.
13 papers.
Sort:
By area:
- 2023Delivering Arbitrary-Modal Semantic Segmentationcited by 117
- 2023DFormer: Rethinking RGBD Representation Learning for Semantic Segmentationcited by 60
- 2024Context-Aware Interaction Network for RGB-T Semantic Segmentationcited by 21
- 2024Visible-Thermal Multiple Object Tracking: Large-scale Video Dataset and Progressive Fusion Approachcited by 13
- 2024A Multispectral Automated Transfer Technique (MATT) for machine-driven image labeling utilizing the Segment Anything Model (SAM)cited by 8
- 2023SpiderMesh: Spatial-aware Demand-guided Recursive Meshing for RGB-T Semantic Segmentationcited by 7
- 2023Variational Probabilistic Fusion Network for RGB-T Semantic Segmentationcited by 7
- 2024FLAME 3 Dataset: Unleashing the Power of Radiometric Thermal UAV Imagery for Wildfire Managementcited by 6
- 2025OmniSegmentor: A Flexible Multi-Modal Learning Framework for Semantic Segmentationcited by 5
- 2025BIMII-Net: Brain-Inspired Multi-Iterative Interactive Network for RGB-T Road Scene Semantic Segmentationcited by 0
- 2026Seeing Roads Through Words: A Language-Guided Framework for RGB-T Driving Scene Segmentationcited by 0
- 2026No Calibration, No Depth, No Problem: Cross-Sensor View Synthesis with 3D Consistencycited by 0
1 more
- 2026Multimodal Fusion of RGB and Complementary Modalities for Semantic Segmentation13 Oct 2026
- 2026No Calibration, No Depth, No Problem: Cross-Sensor View Synthesis with 3D Consistency27 Feb 2026
- 2026Seeing Roads Through Words: A Language-Guided Framework for RGB-T Driving Scene Segmentation7 Feb 2026
- 2025OmniSegmentor: A Flexible Multi-Modal Learning Framework for Semantic Segmentation18 Sep 2025
- 2025BIMII-Net: Brain-Inspired Multi-Iterative Interactive Network for RGB-T Road Scene Semantic Segmentation25 Mar 2025
- 2024FLAME 3 Dataset: Unleashing the Power of Radiometric Thermal UAV Imagery for Wildfire Management3 Dec 2024
- 2024Visible-Thermal Multiple Object Tracking: Large-scale Video Dataset and Progressive Fusion Approach2 Aug 2024
- 2024A Multispectral Automated Transfer Technique (MATT) for machine-driven image labeling utilizing the Segment Anything Model (SAM)18 Feb 2024
- 2024Context-Aware Interaction Network for RGB-T Semantic Segmentation3 Jan 2024
- 2023DFormer: Rethinking RGBD Representation Learning for Semantic Segmentation18 Sep 2023
- 2023Variational Probabilistic Fusion Network for RGB-T Semantic Segmentation17 Jul 2023
- 2023SpiderMesh: Spatial-aware Demand-guided Recursive Meshing for RGB-T Semantic Segmentation15 Mar 2023
1 more
- 2023Delivering Arbitrary-Modal Semantic Segmentation2 Mar 2023
- 2023Delivering Arbitrary-Modal Semantic Segmentationcited by 117
- 2023DFormer: Rethinking RGBD Representation Learning for Semantic Segmentationcited by 60
- 2024Context-Aware Interaction Network for RGB-T Semantic Segmentationcited by 21
- 2024Visible-Thermal Multiple Object Tracking: Large-scale Video Dataset and Progressive Fusion Approachcited by 13
- 2024A Multispectral Automated Transfer Technique (MATT) for machine-driven image labeling utilizing the Segment Anything Model (SAM)cited by 8
- 2023SpiderMesh: Spatial-aware Demand-guided Recursive Meshing for RGB-T Semantic Segmentationcited by 7
- 2023Variational Probabilistic Fusion Network for RGB-T Semantic Segmentationcited by 7
- 2024FLAME 3 Dataset: Unleashing the Power of Radiometric Thermal UAV Imagery for Wildfire Managementcited by 6
- 2025OmniSegmentor: A Flexible Multi-Modal Learning Framework for Semantic Segmentationcited by 5
- 2025BIMII-Net: Brain-Inspired Multi-Iterative Interactive Network for RGB-T Road Scene Semantic Segmentationcited by 0
- 2026No Calibration, No Depth, No Problem: Cross-Sensor View Synthesis with 3D Consistencycited by 0
- 2026Multimodal Fusion of RGB and Complementary Modalities for Semantic Segmentationcited by 0
- 2026Multimodal Fusion of RGB and Complementary Modalities for Semantic Segmentation13 Oct 2026
- 2026No Calibration, No Depth, No Problem: Cross-Sensor View Synthesis with 3D Consistency27 Feb 2026
- 2025OmniSegmentor: A Flexible Multi-Modal Learning Framework for Semantic Segmentation18 Sep 2025
- 2025BIMII-Net: Brain-Inspired Multi-Iterative Interactive Network for RGB-T Road Scene Semantic Segmentation25 Mar 2025
- 2024FLAME 3 Dataset: Unleashing the Power of Radiometric Thermal UAV Imagery for Wildfire Management3 Dec 2024
- 2024Visible-Thermal Multiple Object Tracking: Large-scale Video Dataset and Progressive Fusion Approach2 Aug 2024
- 2024A Multispectral Automated Transfer Technique (MATT) for machine-driven image labeling utilizing the Segment Anything Model (SAM)18 Feb 2024
- 2024Context-Aware Interaction Network for RGB-T Semantic Segmentation3 Jan 2024
- 2023DFormer: Rethinking RGBD Representation Learning for Semantic Segmentation18 Sep 2023
- 2023Variational Probabilistic Fusion Network for RGB-T Semantic Segmentation17 Jul 2023
- 2023SpiderMesh: Spatial-aware Demand-guided Recursive Meshing for RGB-T Semantic Segmentation15 Mar 2023
- 2023Delivering Arbitrary-Modal Semantic Segmentation2 Mar 2023