EarthGen: Generating the World from Top-Down Views
Not on the map. Why?
Abstract (arXiv)
In this work, we present a novel method for extensive multi-scale generative terrain modeling. At the core of our model is a cascade of superresolution diffusion models that can be combined to produce consistent images across multiple resolutions. Pairing this concept with a tiled generation method yields a scalable system that can generate thousands of square kilometers of realistic Earth surfaces at high resolution. We evaluate our method on a dataset collected from Bing Maps and show that it outperforms super-resolution baselines on the extreme super-resolution task of 1024x zoom. We also demonstrate its ability to create diverse and coherent scenes via an interactive gigapixel-scale generated map. Finally, we demonstrate how our system can be extended to enable novel content creation applications including controllable world generation and 3D scene generation.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 58 of its 95 references that are in the map. First posted on arXiv 2 Sep 2024.
Builds on
58 of 95 references.
References · 58
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
- 2020Denoising Diffusion Probabilistic Modelscited by 20,851
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
- 2020Denoising Diffusion Implicit Modelscited by 9,655
- 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
- 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
- 2022Classifier-Free Diffusion Guidancecited by 5,717
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
38 more
- 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
- 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
- 2016Pyramid Scene Parsing Networkcited by 2,472
- 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
- 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
- 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
- 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,417
- 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
- 2018Demystifying MMD GANscited by 1,268
- 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
- 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
- 2022MaskGIT: Masked Generative Image Transformercited by 1,082
- 2018Residual Dense Network for Image Super-Resolutioncited by 796
- 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684
- 2022Compositional Visual Generation with Composable Diffusion Modelscited by 619
- 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 589
- 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 550
- 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 529
- 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
- 2022Activating More Pixels in Image Super-Resolution Transformercited by 433
- 2017"Zero-Shot" Super-Resolution using Deep Internal Learningcited by 285
- 2020Single Image Super-Resolution via a Holistic Attention Networkcited by 265
- 2020Infinite Nature: Perpetual View Generation of Natural Scenes from a Single Imagecited by 239
- 2019Blind Super-Resolution With Iterative Kernel Correctioncited by 203
- 2017Exploring Models and Data for Remote Sensing Image Caption Generationcited by 195
- 2023Foundation Models for Generalist Geospatial Artificial Intelligencecited by 143
- 2023DiffusionSat: A Generative Foundation Model for Satellite Imagerycited by 130
- 2020Unfolding the Alternating Optimization for Blind Super Resolutioncited by 129
- 2023GEO-Bench: Toward Foundation Models for Earth Monitoringcited by 122
- 2020Meta-Transfer Learning for Zero-Shot Super-Resolutioncited by 116
- 2022InfiniteNature-Zero: Learning Perpetual View Generation of Natural Scenes from Single Imagescited by 82
- 2023CityDreamer: Compositional Generative Model of Unbounded 3D Citiescited by 75
- 2023InfiniCity: Infinite-Scale City Synthesiscited by 68
- 2021Real-World Single Image Super-Resolution: A Brief Reviewcited by 65
- 2021On Efficient Transformer-Based Image Pre-training for Low-Level Visioncited by 64
- 2021InfinityGAN: Towards Infinite-Pixel Image Synthesiscited by 61
50 most cited of 58 All 58 (JSON)
Built on by
Citing papers per year: 2025: 2.
2 papers.
Similar, not cited
Close in wording, no citation either way
- 2025EarthCrafter: Scalable 3D Earth Generation via Dual-Sparse Latent Diffusion
- 2025Geodiffussr: Generative Terrain Texturing with Elevation Fidelity
- 2024MetaEarth: A Generative Foundation Model for Global-Scale Remote Sensing Image Generation
- 2026WorldWeave: Growing Persistent Geometric Worlds for Video Generation
- 2025WorldGrow: Generating Infinite 3D World
- 2022HORIZON: High-Resolution Semantically Controlled Panorama Synthesis
- 2025TerraFusion: Joint Generation of Terrain Geometry and Texture Using Latent Diffusion Models
- 2025TRELLISWorld: Training-Free World Generation from Object Generators