Unsupervised Discovery of Semantic Concepts in Satellite Imagery with Style-based Wavelet-driven Generative Models
Not on the map. Why?
Abstract (arXiv)
In recent years, considerable advancements have been made in the area of Generative Adversarial Networks (GANs), particularly with the advent of style-based architectures that address many key shortcomings - both in terms of modeling capabilities and network interpretability. Despite these improvements, the adoption of such approaches in the domain of satellite imagery is not straightforward. Typical vision datasets used in generative tasks are well-aligned and annotated, and exhibit limited variability. In contrast, satellite imagery exhibits great spatial and spectral variability, wide presence of fine, high-frequency details, while the tedious nature of annotating satellite imagery leads to annotation scarcity - further motivating developments in unsupervised learning. In this light, we present the first pre-trained style- and wavelet-based GAN model that can readily synthesize a wide gamut of realistic satellite images in a variety of settings and conditions - while also preserving high-frequency information. Furthermore, we show that by analyzing the intermediate activations of our network, one can discover a multitude of interpretable semantic directions that facilitate the guided synthesis of satellite images in terms of high-level concepts (e.g., urbanization) without using any form of supervision. Via a set of qualitative and quantitative experiments we demonstrate the efficacy of our framework, in terms of suitability for downstream tasks (e.g., data augmentation), quality of synthetic imagery, as well as generalization capabilities to unseen datasets.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 46 of its 71 references that are in the map. First posted on arXiv 3 Aug 2022.
Builds on
46 of 71 references.
References · 46
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Generative Adversarial Networkscited by 5,627
- 2014Deep Learning Face Attributes in the Wildcited by 3,693
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,588
- 2017Progressive Growing of GANs for Improved Quality, Stability, and Variationcited by 2,988
- 2020Fourier Features Let Networks Learn High Frequency Functions in Low Dimensional Domainscited by 2,200
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,908
- 2015LSUN: Construction of a Large-scale Image Dataset using Deep Learning with Humans in the Loopcited by 1,355
- 2019Semantic Image Synthesis with Spatially-Adaptive Normalizationcited by 1,299
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,179
- 2020Encoding in Style: a StyleGAN Encoder for Image-to-Image Translationcited by 727
34 more
- 2019Interpreting the Latent Space of GANs for Semantic Face Editingcited by 695
- 2019MaskGAN: Towards Diverse and Interactive Facial Image Manipulationcited by 628
- 2020GANSpace: Discovering Interpretable GAN Controlscited by 614
- 2017Unsupervised Image-to-Image Translation Networkscited by 603
- 2017MoCoGAN: Decomposing Motion and Content for Video Generationcited by 524
- 2020Closed-Form Factorization of Latent Semantics in GANscited by 408
- 2020PULSE: Self-Supervised Photo Upsampling via Latent Space Exploration of Generative Modelscited by 358
- 2016AID: A Benchmark Dataset for Performance Evaluation of Aerial Scene Classificationcited by 347
- 2020StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generationcited by 332
- 2020Deep Learning Techniques for Inverse Problems in Imagingcited by 291
- 2020Unsupervised Discovery of Interpretable Directions in the GAN Latent Spacecited by 289
- 2019Deferred Neural Rendering: Image Synthesis using Neural Texturescited by 253
- 2019On the "steerability" of generative adversarial networkscited by 248
- 2020Swapping Autoencoder for Deep Image Manipulationcited by 215
- 2019GANalyze: Toward Visual Definitions of Cognitive Image Propertiescited by 193
- 2019Image Processing Using Multi-Code GAN Priorcited by 185
- 2019Semantic Hierarchy Emerges in Deep Generative Representations for Scene Synthesiscited by 106
- 2021GANcraft: Unsupervised 3D Neural Rendering of Minecraft Worldscited by 98
- 2020Controlling generative models with continuous factors of variationscited by 93
- 2020The Hessian Penalty: A Weak Prior for Unsupervised Disentanglementcited by 92
- 2021Only a Matter of Style: Age Transformation Using a Style-Based Regression Modelcited by 92
- 2019Image inpainting: A reviewcited by 89
- 2020Remote Sensing Image Scene Classification Meets Deep Learning: Challenges, Methods, Benchmarks, and Opportunitiescited by 71
- 2020Deep Learning Meets SARcited by 60
- 2019Multi-level Wavelet Convolutional Neural Networkscited by 59
- 2018Attribute-aware Face Aging with Wavelet-based Generative Adversarial Networkscited by 34
- 2020Multi-level Wavelet-based Generative Adversarial Network for Perceptual Quality Enhancement of Compressed Videocited by 26
- 2018Spatially Controllable Image Synthesis with Internal Representation Collagingcited by 23
- 2021SWAGAN: A Style-based Wavelet-driven Generative Modelcited by 17
- 2016MARTA GANs: Unsupervised Representation Learning for Remote Sensing Image Classificationcited by 16
- 2018What Is It Like Down There? Generating Dense Ground-Level Views and Image Features From Overhead Imagery Using Conditional Generative Adversarial Networkscited by 6
- 2019Image Super-Resolution Using a Wavelet-based Generative Adversarial Networkcited by 6
- 2018SiftingGAN: Generating and Sifting Labeled Samples to Improve the Remote Sensing Image Scene Classification Baseline in vitrocited by 4
- 2021Deep Learning based Novel View Synthesiscited by 2
Built on by
Citing papers per year: 2023: 1.
1 paper.