High-resolution semantically-consistent image-to-image translation
Not on the map. Why?
Abstract (arXiv)
Deep learning has become one of remote sensing scientists' most efficient computer vision tools in recent years. However, the lack of training labels for the remote sensing datasets means that scientists need to solve the domain adaptation problem to narrow the discrepancy between satellite image datasets. As a result, image segmentation models that are then trained, could better generalize and use an existing set of labels instead of requiring new ones. This work proposes an unsupervised domain adaptation model that preserves semantic consistency and per-pixel quality for the images during the style-transferring phase. This paper's major contribution is proposing the improved architecture of the SemI2I model, which significantly boosts the proposed model's performance and makes it competitive with the state-of-the-art CyCADA model. A second contribution is testing the CyCADA model on the remote sensing multi-band datasets such as WorldView-2 and SPOT-6. The proposed model preserves semantic consistency and per-pixel quality for the images during the style-transferring phase. Thus, the semantic segmentation model, trained on the adapted images, shows substantial performance gain compared to the SemI2I model and reaches similar results as the state-of-the-art CyCADA model. The future development of the proposed method could include ecological domain transfer, em a priori evaluation of dataset quality in terms of data distribution, or exploration of the inner architecture of the domain adaptation model.
Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 21 of its 37 references that are in the map. First posted on arXiv 13 Sep 2022.
Builds on
21 of 37 references.
References · 21
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2022Generative Adversarial Networkscited by 5,603
- 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
- 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,239
- 2018Encoder-Decoder with Atrous Separable Convolution for Semantic Image Segmentationcited by 3,210
- 2015Domain-Adversarial Training of Neural Networkscited by 3,023
- 2017Arbitrary Style Transfer in Real-time with Adaptive Instance Normalizationcited by 1,998
- 2014Unsupervised Domain Adaptation by Backpropagationcited by 1,906
- 2017Adversarial Discriminative Domain Adaptationcited by 1,309
- 2017CyCADA: Cycle-Consistent Adversarial Domain Adaptationcited by 1,079
- 2014Deep Domain Confusion: Maximizing for Domain Invariancecited by 597
- 2018Learning to Adapt Structured Output Space for Semantic Segmentationcited by 584
9 more
- 2019Bidirectional Learning for Domain Adaptation of Semantic Segmentationcited by 308
- 2015Simultaneous Deep Transfer Across Domains and Taskscited by 205
- 2017Deep Image Harmonizationcited by 120
- 2015Efficient piecewise training of deep structured models for semantic segmentationcited by 71
- 2015Semantic Image Segmentation via Deep Parsing Networkcited by 44
- 2019ColorMapGAN: Unsupervised Domain Adaptation for Semantic Segmentation Using Color Mapping Generative Adversarial Networkscited by 26
- 2021SPatchGAN: A Statistical Feature Based Discriminator for Unsupervised Image-to-Image Translationcited by 17
- 2020DAugNet: Unsupervised, Multi-source, Multi-target, and Life-long Domain Adaptation for Semantic Segmentation of Satellite Imagescited by 13
- 2020SemI2I: Semantically Consistent Image-to-Image Translation for Domain Adaptation of Remote Sensing Datacited by 4
Built on by
Citing papers per year: 2022: 1; 2023: 1; 2024: 1.
3 papers.
- 2023Integrating Multiple Sources Knowledge for Class Asymmetry Domain Adaptation Segmentation of Remote Sensing Imagescited by 6
- 2022Semantically-consistent Landsat 8 image to Sentinel-2 image translation for alpine areascited by 0
- 2024Multi-Sensor Diffusion-Driven Optical Image Translation for Large-Scale Applicationscited by 0
- 2024Multi-Sensor Diffusion-Driven Optical Image Translation for Large-Scale Applications17 Apr 2024
- 2023Integrating Multiple Sources Knowledge for Class Asymmetry Domain Adaptation Segmentation of Remote Sensing Images17 May 2023
- 2022Semantically-consistent Landsat 8 image to Sentinel-2 image translation for alpine areas22 Dec 2022