Spatial-Temporal Super-Resolution of Satellite Imagery via Conditional Pixel Synthesis
Not on the map. Why?
Abstract (arXiv)
High-resolution satellite imagery has proven useful for a broad range of tasks, including measurement of global human population, local economic livelihoods, and biodiversity, among many others. Unfortunately, high-resolution imagery is both infrequently collected and expensive to purchase, making it hard to efficiently and effectively scale these downstream tasks over both time and space. We propose a new conditional pixel synthesis model that uses abundant, low-cost, low-resolution imagery to generate accurate high-resolution imagery at locations and times in which it is unavailable. We show that our model attains photo-realistic sample quality and outperforms competing baselines on a key downstream task -- object counting -- particularly in geographic locations where conditions on the ground are changing rapidly.
Key facts. Cited by 20 papers in the map (data through 7 Oct 2026). Builds on 29 of its 54 references that are in the map. First posted on arXiv 22 Jun 2021.
Builds on
29 of 54 references.
References · 29
- 2017Attention Is All You Needcited by 59,932
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2019Analyzing and Improving the Image Quality of StyleGANcited by 3,580
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,898
- 2020pixelNeRF: Neural Radiance Fields from One or Few Imagescited by 1,574
- 2014Image Super-Resolution Using Deep Convolutional Networkscited by 1,218
- 2016Colorful Image Colorizationcited by 1,113
- 2017Deep Image Priorcited by 1,097
- 2018Self-Attention Generative Adversarial Networkscited by 809
- 2020Neural Scene Flow Fields for Space-Time View Synthesis of Dynamic Scenescited by 750
17 more
- 2020GRAF: Generative Radiance Fields for 3D-Aware Image Synthesiscited by 688
- 2020Space-time Neural Irradiance Fields for Free-Viewpoint Videocited by 414
- 2018Deep Learning for Generic Object Detection: A Surveycited by 392
- 2017Functional Map of the Worldcited by 338
- 2018Unprocessing Images for Learned Raw Denoisingcited by 250
- 2018Deep Back-Projection Networks For Super-Resolutioncited by 224
- 2019EdgeConnect: Generative Image Inpainting with Adversarial Edge Learningcited by 161
- 2019xBD: A Dataset for Assessing Building Damage from Satellite Imagerycited by 138
- 2019Image Super-Resolution by Neural Texture Transfercited by 119
- 2020Image Generators with Conditionally-Independent Pixel Synthesiscited by 105
- 2020Using satellite imagery to understand and promote sustainable developmentcited by 71
- 2018The Effects of Super-Resolution on Object Detection Performance in Satellite Imagerycited by 57
- 2020Generating Interpretable Poverty Maps using Object Detection in Satellite Imagescited by 27
- 2020Comparison of Image Quality Models for Optimization of Image Processing Systemscited by 7
- 2017TensorLayer: A Versatile Library for Efficient Deep Learning Developmentcited by 6
- 2020Predicting Landsat Reflectance with Deep Generative Fusioncited by 2
- 2020Single Image Super-resolution with a Switch Guided Hybrid Network for Satellite Imagescited by 2
Built on by
Citing papers per year: 2022: 3; 2023: 9; 2024: 3; 2025: 3; 2026: 2.
20 papers.
Sort:
By area:
- 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 402
- 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 302
- 2023DiffusionSat: A Generative Foundation Model for Satellite Imagerycited by 130
- 2023On the Opportunities and Challenges of Foundation Models for Geospatial Artificial Intelligencecited by 88
- 2023CSP: Self-Supervised Contrastive Spatial Pre-Training for Geospatial-Visual Representationscited by 67
- 2023Sphere2Vec: A General-Purpose Location Representation Learning over a Spherical Surface for Large-Scale Geospatial Predictionscited by 38
- 2024GeoSynth: Contextually-Aware High-Resolution Satellite Image Synthesiscited by 32
- 2024Large Language Models for Manufacturingcited by 24
- 2023Multimodality of AI for Education: Towards Artificial General Intelligencecited by 21
- 2023Towards Artificial General Intelligence (AGI) in the Internet of Things (IoT): Opportunities and Challengescited by 14
- 2024S4: Self-Supervised Sensing Across the Spectrumcited by 5
- 2025VectorSynth: Fine-Grained Satellite Image Synthesis with Structured Semanticscited by 5
8 more
- 2023Zooming Out on Zooming In: Advancing Super-Resolution for Remote Sensingcited by 3
- 2022Tracking Urbanization in Developing Regions with Remote Sensing Spatial-Temporal Super-Resolutioncited by 2
- 2023SSIF: Learning Continuous Image Representation for Spatial-Spectral Super-Resolutioncited by 2
- 2023TSGAN: An Optical-to-SAR Dual Conditional GAN for Optical based SAR Temporal Shiftingcited by 2
- 2026TerraDiT-Omega: Unified Spatial Control for Satellite Image Synthesis with Any Geospatial Primitivecited by 2
- 2025Resolution Revolution: A Physics-Guided Deep Learning Framework for Spatiotemporal Temperature Reconstructioncited by 1
- 2026Beyond Visual Fidelity: Benchmarking Super-Resolution Models for Large-Scale Remote Sensing Imagery via Downstream Task Integrationcited by 1
- 2025Controllable Reference Guided Diffusion with Local Global Fusion for Real World Remote Sensing Image Super Resolutioncited by 0
- 2026TerraDiT-Omega: Unified Spatial Control for Satellite Image Synthesis with Any Geospatial Primitive30 Jun 2026
- 2026Beyond Visual Fidelity: Benchmarking Super-Resolution Models for Large-Scale Remote Sensing Imagery via Downstream Task Integration1 May 2026
- 2025VectorSynth: Fine-Grained Satellite Image Synthesis with Structured Semantics11 Nov 2025
- 2025Resolution Revolution: A Physics-Guided Deep Learning Framework for Spatiotemporal Temperature Reconstruction14 Jul 2025
- 2025Controllable Reference Guided Diffusion with Local Global Fusion for Real World Remote Sensing Image Super Resolution30 Jun 2025
- 2024Large Language Models for Manufacturing28 Oct 2024
- 2024S4: Self-Supervised Sensing Across the Spectrum2 May 2024
- 2024GeoSynth: Contextually-Aware High-Resolution Satellite Image Synthesis9 Apr 2024
- 2023TSGAN: An Optical-to-SAR Dual Conditional GAN for Optical based SAR Temporal Shifting31 Dec 2023
- 2023Multimodality of AI for Education: Towards Artificial General Intelligence10 Dec 2023
- 2023DiffusionSat: A Generative Foundation Model for Satellite Imagery6 Dec 2023
- 2023Zooming Out on Zooming In: Advancing Super-Resolution for Remote Sensing29 Nov 2023
8 more
- 2023SSIF: Learning Continuous Image Representation for Spatial-Spectral Super-Resolution30 Sep 2023
- 2023Towards Artificial General Intelligence (AGI) in the Internet of Things (IoT): Opportunities and Challenges14 Sep 2023
- 2023Sphere2Vec: A General-Purpose Location Representation Learning over a Spherical Surface for Large-Scale Geospatial Predictions30 Jun 2023
- 2023CSP: Self-Supervised Contrastive Spatial Pre-Training for Geospatial-Visual Representations1 May 2023
- 2023On the Opportunities and Challenges of Foundation Models for Geospatial Artificial Intelligence13 Apr 2023
- 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learning30 Dec 2022
- 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagery17 Jul 2022
- 2022Tracking Urbanization in Developing Regions with Remote Sensing Spatial-Temporal Super-Resolution4 Apr 2022
- 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 402
- 2022Scale-MAE: A Scale-Aware Masked Autoencoder for Multiscale Geospatial Representation Learningcited by 302
- 2023On the Opportunities and Challenges of Foundation Models for Geospatial Artificial Intelligencecited by 88
- 2023CSP: Self-Supervised Contrastive Spatial Pre-Training for Geospatial-Visual Representationscited by 67
- 2023Sphere2Vec: A General-Purpose Location Representation Learning over a Spherical Surface for Large-Scale Geospatial Predictionscited by 38
- 2024GeoSynth: Contextually-Aware High-Resolution Satellite Image Synthesiscited by 32
- 2024Large Language Models for Manufacturingcited by 24
- 2023Multimodality of AI for Education: Towards Artificial General Intelligencecited by 21
- 2023Towards Artificial General Intelligence (AGI) in the Internet of Things (IoT): Opportunities and Challengescited by 14
- 2024S4: Self-Supervised Sensing Across the Spectrumcited by 5
- 2025VectorSynth: Fine-Grained Satellite Image Synthesis with Structured Semanticscited by 5
- 2023Zooming Out on Zooming In: Advancing Super-Resolution for Remote Sensingcited by 3
12 most cited of 18 All 18 (JSON)
- 2026TerraDiT-Omega: Unified Spatial Control for Satellite Image Synthesis with Any Geospatial Primitive30 Jun 2026
- 2026Beyond Visual Fidelity: Benchmarking Super-Resolution Models for Large-Scale Remote Sensing Imagery via Downstream Task Integration1 May 2026
- 2025VectorSynth: Fine-Grained Satellite Image Synthesis with Structured Semantics11 Nov 2025
- 2025Resolution Revolution: A Physics-Guided Deep Learning Framework for Spatiotemporal Temperature Reconstruction14 Jul 2025
- 2024Large Language Models for Manufacturing28 Oct 2024
- 2024S4: Self-Supervised Sensing Across the Spectrum2 May 2024
- 2024GeoSynth: Contextually-Aware High-Resolution Satellite Image Synthesis9 Apr 2024
- 2023TSGAN: An Optical-to-SAR Dual Conditional GAN for Optical based SAR Temporal Shifting31 Dec 2023
- 2023Multimodality of AI for Education: Towards Artificial General Intelligence10 Dec 2023
- 2023Zooming Out on Zooming In: Advancing Super-Resolution for Remote Sensing29 Nov 2023
- 2023SSIF: Learning Continuous Image Representation for Spatial-Spectral Super-Resolution30 Sep 2023
- 2023Towards Artificial General Intelligence (AGI) in the Internet of Things (IoT): Opportunities and Challenges14 Sep 2023
12 newest of 18 All 18 (JSON)