Algorithms for Semantic Segmentation of Multispectral Remote Sensing Imagery using Deep Learning
Not on the map. Why?
Abstract (arXiv)
Deep convolutional neural networks (DCNNs) have been used to achieve state-of-the-art performance on many computer vision tasks (e.g., object recognition, object detection, semantic segmentation) thanks to a large repository of annotated image data. Large labeled datasets for other sensor modalities, e.g., multispectral imagery (MSI), are not available due to the large cost and manpower required. In this paper, we adapt state-of-the-art DCNN frameworks in computer vision for semantic segmentation for MSI imagery. To overcome label scarcity for MSI data, we substitute real MSI for generated synthetic MSI in order to initialize a DCNN framework. We evaluate our network initialization scheme on the new RIT-18 dataset that we present in this paper. This dataset contains very-high resolution MSI collected by an unmanned aircraft system. The models initialized with synthetic imagery were less prone to over-fitting and provide a state-of-the-art baseline for future work.
Key facts. Cited by 37 papers in the map (data through 7 Oct 2026). First posted on arXiv 19 Mar 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 6; 2022: 7; 2023: 9; 2024: 9; 2025: 5; 2026: 1.
37 papers.
Sort:
- 2021UNetFormer: A UNet-like Transformer for Efficient Semantic Segmentation of Remote Sensing Urban Scene Imagerycited by 166
- 2023Cross-City Matters: A Multimodal Remote Sensing Benchmark Dataset for Cross-City Semantic Segmentation using High-Resolution Domain Adaptation Networkscited by 55
- 2022EarthNets: Empowering AI in Earth Observationcited by 40
- 2021Geographical Knowledge-driven Representation Learning for Remote Sensing Imagescited by 37
- 2022Enabling Country-Scale Land Cover Mapping with Meter-Resolution Satellite Imagerycited by 31
- 2021GaNDLF: A Generally Nuanced Deep Learning Framework for Scalable End-to-End Clinical Workflows in Medical Imagingcited by 25
- 2021ABCNet: Attentive Bilateral Contextual Network for Efficient Semantic Segmentation of Fine-Resolution Remote Sensing Imagescited by 22
- 2024SG-BEV: Satellite-Guided BEV Fusion for Cross-View Semantic Segmentationcited by 18
- 2022Semantic Segmentation with Active Semi-Supervised Learningcited by 16
- 2022Distilling Inter-Class Distance for Semantic Segmentationcited by 16
- 2024SFFNet: A Wavelet-Based Spatial and Frequency Domain Fusion Network for Remote Sensing Segmentationcited by 16
- 2023GeoMultiTaskNet: remote sensing unsupervised domain adaptation using geographical coordinatescited by 12
25 more
- 2023Deep Learning Techniques for Hyperspectral Image Analysis in Agriculture: A Reviewcited by 12
- 2021Oriented Bounding Boxes for Small and Freely Rotated Objectscited by 8
- 2022Adaptive Path Planning for UAVs for Multi-Resolution Semantic Segmentationcited by 8
- 2023An Informative Path Planning Framework for Active Learning in UAV-based Semantic Mappingcited by 8
- 2023Hi-ResNet: Edge Detail Enhancement for High-Resolution Remote Sensing Segmentationcited by 8
- 2021An Attention-Fused Network for Semantic Segmentation of Very-High-Resolution Remote Sensing Imagerycited by 7
- 2024Enhancing Environmental Monitoring through Multispectral Imaging: The WasteMS Dataset for Semantic Segmentation of Lakeside Wastecited by 3
- 2023OSTA: One-shot Task-adaptive Channel Selection for Semantic Segmentation of Multichannel Imagescited by 2
- 2024Semantic Segmentation of Unmanned Aerial Vehicle Remote Sensing Images using SegFormercited by 2
- 2024Designing a Classifier for Active Fire Detection from Multispectral Satellite Imagery Using Neural Architecture Searchcited by 2
- 2022Evaluation of Dirichlet Process Gaussian Mixtures for Segmentation on Noisy Hyperspectral Imagescited by 1
- 2022Exploration of Convolutional Neural Network Architectures for Large Region Map Automationcited by 1
- 2024BD-MSA: Body decouple VHR Remote Sensing Image Change Detection method guided by multi-scale feature information aggregationcited by 1
- 2024C3DG: Conditional Domain Generalization for Hyperspectral Imagery Classification with Convergence and Constrained-risk Theoriescited by 1
- 2025ClassWise-CRF: Category-Specific Fusion for Enhanced Semantic Segmentation of Remote Sensing Imagerycited by 1
- 2023SILOP: An Automated Framework for Semantic Segmentation Using Image Labels Based on Object Perimeterscited by 0
- 2023Bidirectional recurrent imputation and abundance estimation of LULC classes with MODIS multispectral time series and geo-topographic and climatic datacited by 0
- 2023Few-shot Multispectral Segmentation with Representations Generated by Reinforcement Learningcited by 0
- 2024Deep Learning Meets OBIA: Tasks, Challenges, Strategies, and Perspectivescited by 0
- 2024Segment Using Just One Examplecited by 0
- 2025Transferability of labels between multilens camerascited by 0
- 2025FADConv: A Frequency-Aware Dynamic Convolution for Farmland Non-agriculturalization Identification and Segmentationcited by 0
- 2025From Pixels to Images: A Structural Survey of Deep Learning Paradigms in Remote Sensing Image Semantic Segmentationcited by 0
- 2025An U-Net-Based Deep Neural Network for Cloud Shadow and Sun-Glint Correction of Unmanned Aerial System (UAS) Imagerycited by 0
- 2026MPerS: Dynamic MLLM MixExperts Perception-Guided Remote Sensing Scene Segmentationcited by 0
- 2026MPerS: Dynamic MLLM MixExperts Perception-Guided Remote Sensing Scene Segmentation11 May 2026
- 2025An U-Net-Based Deep Neural Network for Cloud Shadow and Sun-Glint Correction of Unmanned Aerial System (UAS) Imagery10 Sep 2025
- 2025From Pixels to Images: A Structural Survey of Deep Learning Paradigms in Remote Sensing Image Semantic Segmentation21 May 2025
- 2025ClassWise-CRF: Category-Specific Fusion for Enhanced Semantic Segmentation of Remote Sensing Imagery30 Apr 2025
- 2025FADConv: A Frequency-Aware Dynamic Convolution for Farmland Non-agriculturalization Identification and Segmentation4 Apr 2025
- 2025Transferability of labels between multilens cameras20 Jan 2025
- 2024Designing a Classifier for Active Fire Detection from Multispectral Satellite Imagery Using Neural Architecture Search7 Oct 2024
- 2024Semantic Segmentation of Unmanned Aerial Vehicle Remote Sensing Images using SegFormer1 Oct 2024
- 2024Segment Using Just One Example14 Aug 2024
- 2024Deep Learning Meets OBIA: Tasks, Challenges, Strategies, and Perspectives2 Aug 2024
- 2024Enhancing Environmental Monitoring through Multispectral Imaging: The WasteMS Dataset for Semantic Segmentation of Lakeside Waste24 Jul 2024
- 2024C3DG: Conditional Domain Generalization for Hyperspectral Imagery Classification with Convergence and Constrained-risk Theories4 Jul 2024
25 more
- 2024SFFNet: A Wavelet-Based Spatial and Frequency Domain Fusion Network for Remote Sensing Segmentation3 May 2024
- 2024SG-BEV: Satellite-Guided BEV Fusion for Cross-View Semantic Segmentation3 Apr 2024
- 2024BD-MSA: Body decouple VHR Remote Sensing Image Change Detection method guided by multi-scale feature information aggregation9 Jan 2024
- 2023Few-shot Multispectral Segmentation with Representations Generated by Reinforcement Learning20 Nov 2023
- 2023Bidirectional recurrent imputation and abundance estimation of LULC classes with MODIS multispectral time series and geo-topographic and climatic data11 Oct 2023
- 2023Cross-City Matters: A Multimodal Remote Sensing Benchmark Dataset for Cross-City Semantic Segmentation using High-Resolution Domain Adaptation Networks26 Sep 2023
- 2023Hi-ResNet: Edge Detail Enhancement for High-Resolution Remote Sensing Segmentation22 May 2023
- 2023OSTA: One-shot Task-adaptive Channel Selection for Semantic Segmentation of Multichannel Images8 May 2023
- 2023Deep Learning Techniques for Hyperspectral Image Analysis in Agriculture: A Review26 Apr 2023
- 2023GeoMultiTaskNet: remote sensing unsupervised domain adaptation using geographical coordinates16 Apr 2023
- 2023SILOP: An Automated Framework for Semantic Segmentation Using Image Labels Based on Object Perimeters14 Mar 2023
- 2023An Informative Path Planning Framework for Active Learning in UAV-based Semantic Mapping7 Feb 2023
- 2022Exploration of Convolutional Neural Network Architectures for Large Region Map Automation7 Nov 2022
- 2022EarthNets: Empowering AI in Earth Observation10 Oct 2022
- 2022Enabling Country-Scale Land Cover Mapping with Meter-Resolution Satellite Imagery1 Sep 2022
- 2022Distilling Inter-Class Distance for Semantic Segmentation7 May 2022
- 2022Semantic Segmentation with Active Semi-Supervised Learning21 Mar 2022
- 2022Evaluation of Dirichlet Process Gaussian Mixtures for Segmentation on Noisy Hyperspectral Images5 Mar 2022
- 2022Adaptive Path Planning for UAVs for Multi-Resolution Semantic Segmentation3 Mar 2022
- 2021UNetFormer: A UNet-like Transformer for Efficient Semantic Segmentation of Remote Sensing Urban Scene Imagery18 Sep 2021
- 2021Geographical Knowledge-driven Representation Learning for Remote Sensing Images12 Jul 2021
- 2021An Attention-Fused Network for Semantic Segmentation of Very-High-Resolution Remote Sensing Imagery10 May 2021
- 2021Oriented Bounding Boxes for Small and Freely Rotated Objects24 Apr 2021
- 2021GaNDLF: A Generally Nuanced Deep Learning Framework for Scalable End-to-End Clinical Workflows in Medical Imaging26 Feb 2021
- 2021ABCNet: Attentive Bilateral Contextual Network for Efficient Semantic Segmentation of Fine-Resolution Remote Sensing Images4 Feb 2021
- 2021UNetFormer: A UNet-like Transformer for Efficient Semantic Segmentation of Remote Sensing Urban Scene Imagerycited by 166
- 2023Cross-City Matters: A Multimodal Remote Sensing Benchmark Dataset for Cross-City Semantic Segmentation using High-Resolution Domain Adaptation Networkscited by 55
- 2022EarthNets: Empowering AI in Earth Observationcited by 40
- 2021Geographical Knowledge-driven Representation Learning for Remote Sensing Imagescited by 37
- 2022Enabling Country-Scale Land Cover Mapping with Meter-Resolution Satellite Imagerycited by 31
- 2021GaNDLF: A Generally Nuanced Deep Learning Framework for Scalable End-to-End Clinical Workflows in Medical Imagingcited by 25
- 2021ABCNet: Attentive Bilateral Contextual Network for Efficient Semantic Segmentation of Fine-Resolution Remote Sensing Imagescited by 22
- 2024SG-BEV: Satellite-Guided BEV Fusion for Cross-View Semantic Segmentationcited by 18
- 2022Semantic Segmentation with Active Semi-Supervised Learningcited by 16
- 2022Distilling Inter-Class Distance for Semantic Segmentationcited by 16
- 2024SFFNet: A Wavelet-Based Spatial and Frequency Domain Fusion Network for Remote Sensing Segmentationcited by 16
- 2023GeoMultiTaskNet: remote sensing unsupervised domain adaptation using geographical coordinatescited by 12
12 most cited of 37 All 37 (JSON)
- 2026MPerS: Dynamic MLLM MixExperts Perception-Guided Remote Sensing Scene Segmentation11 May 2026
- 2025An U-Net-Based Deep Neural Network for Cloud Shadow and Sun-Glint Correction of Unmanned Aerial System (UAS) Imagery10 Sep 2025
- 2025From Pixels to Images: A Structural Survey of Deep Learning Paradigms in Remote Sensing Image Semantic Segmentation21 May 2025
- 2025ClassWise-CRF: Category-Specific Fusion for Enhanced Semantic Segmentation of Remote Sensing Imagery30 Apr 2025
- 2025FADConv: A Frequency-Aware Dynamic Convolution for Farmland Non-agriculturalization Identification and Segmentation4 Apr 2025
- 2025Transferability of labels between multilens cameras20 Jan 2025
- 2024Designing a Classifier for Active Fire Detection from Multispectral Satellite Imagery Using Neural Architecture Search7 Oct 2024
- 2024Semantic Segmentation of Unmanned Aerial Vehicle Remote Sensing Images using SegFormer1 Oct 2024
- 2024Segment Using Just One Example14 Aug 2024
- 2024Deep Learning Meets OBIA: Tasks, Challenges, Strategies, and Perspectives2 Aug 2024
- 2024Enhancing Environmental Monitoring through Multispectral Imaging: The WasteMS Dataset for Semantic Segmentation of Lakeside Waste24 Jul 2024
- 2024C3DG: Conditional Domain Generalization for Hyperspectral Imagery Classification with Convergence and Constrained-risk Theories4 Jul 2024
12 newest of 37 All 37 (JSON)