mlsanityData to 7 Oct 2026

EarthGen: Generating the World from Top-Down Views

arXiv 2409.01491 ↗First posted 2 Sep 2024cs.CV cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

In this work, we present a novel method for extensive multi-scale generative terrain modeling. At the core of our model is a cascade of superresolution diffusion models that can be combined to produce consistent images across multiple resolutions. Pairing this concept with a tiled generation method yields a scalable system that can generate thousands of square kilometers of realistic Earth surfaces at high resolution. We evaluate our method on a dataset collected from Bing Maps and show that it outperforms super-resolution baselines on the extreme super-resolution task of 1024x zoom. We also demonstrate its ability to create diverse and coherent scenes via an interactive gigapixel-scale generated map. Finally, we demonstrate how our system can be extended to enable novel content creation applications including controllable world generation and 3D scene generation.

Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 58 of its 95 references that are in the map. First posted on arXiv 2 Sep 2024.

Builds on

58 of 95 references.

References · 58

  1. 2014Adam: A Method for Stochastic Optimizationcited by 36,960
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2020Denoising Diffusion Probabilistic Modelscited by 20,851
  4. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,694
  5. 2020Denoising Diffusion Implicit Modelscited by 9,655
  6. 2020Score-Based Generative Modeling through Stochastic Differential Equationscited by 8,964
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,185
  8. 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,005
  9. 2022Photorealistic Text-to-Image Diffusion Models with Deep Language Understandingcited by 6,322
  10. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 5,986
  11. 2022Classifier-Free Diffusion Guidancecited by 5,717
  12. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
38 more
  1. 2019Generative Modeling by Estimating Gradients of the Data Distributioncited by 4,067
  2. 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,736
  3. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,595
  4. 2022DreamFusion: Text-to-3D using 2D Diffusioncited by 3,006
  5. 2016Pyramid Scene Parsing Networkcited by 2,472
  6. 2022DPM-Solver: A Fast ODE Solver for Diffusion Probabilistic Model Sampling in Around 10 Stepscited by 1,961
  7. 2022Make-A-Video: Text-to-Video Generation without Text-Video Datacited by 1,725
  8. 2023AnimateDiff: Animate Your Personalized Text-to-Image Diffusion Models without Specific Tuningcited by 1,418
  9. 2019Deep High-Resolution Representation Learning for Visual Recognitioncited by 1,417
  10. 2024Depth Anything: Unleashing the Power of Large-Scale Unlabeled Datacited by 1,346
  11. 2018Demystifying MMD GANscited by 1,268
  12. 2018ESRGAN: Enhanced Super-Resolution Generative Adversarial Networkscited by 1,250
  13. 2021Cascaded Diffusion Models for High Fidelity Image Generationcited by 1,155
  14. 2022MaskGIT: Masked Generative Image Transformercited by 1,082
  15. 2018Residual Dense Network for Image Super-Resolutioncited by 796
  16. 2023Fantasia3D: Disentangling Geometry and Appearance for High-quality Text-to-3D Content Creationcited by 684
  17. 2022Compositional Visual Generation with Composable Diffusion Modelscited by 619
  18. 2023Structure and Content-Guided Video Synthesis with Diffusion Modelscited by 589
  19. 2020Learning Continuous Image Representation with Local Implicit Image Functioncited by 550
  20. 2023MultiDiffusion: Fusing Diffusion Paths for Controlled Image Generationcited by 529
  21. 2023Scaling up GANs for Text-to-Image Synthesiscited by 492
  22. 2022Activating More Pixels in Image Super-Resolution Transformercited by 433
  23. 2017"Zero-Shot" Super-Resolution using Deep Internal Learningcited by 285
  24. 2020Single Image Super-Resolution via a Holistic Attention Networkcited by 265
  25. 2020Infinite Nature: Perpetual View Generation of Natural Scenes from a Single Imagecited by 239
  26. 2019Blind Super-Resolution With Iterative Kernel Correctioncited by 203
  27. 2017Exploring Models and Data for Remote Sensing Image Caption Generationcited by 195
  28. 2023Foundation Models for Generalist Geospatial Artificial Intelligencecited by 143
  29. 2023DiffusionSat: A Generative Foundation Model for Satellite Imagerycited by 130
  30. 2020Unfolding the Alternating Optimization for Blind Super Resolutioncited by 129
  31. 2023GEO-Bench: Toward Foundation Models for Earth Monitoringcited by 122
  32. 2020Meta-Transfer Learning for Zero-Shot Super-Resolutioncited by 116
  33. 2022InfiniteNature-Zero: Learning Perpetual View Generation of Natural Scenes from Single Imagescited by 82
  34. 2023CityDreamer: Compositional Generative Model of Unbounded 3D Citiescited by 75
  35. 2023InfiniCity: Infinite-Scale City Synthesiscited by 68
  36. 2021Real-World Single Image Super-Resolution: A Brief Reviewcited by 65
  37. 2021On Efficient Transformer-Based Image Pre-training for Low-Level Visioncited by 64
  38. 2021InfinityGAN: Towards Infinite-Pixel Image Synthesiscited by 61

50 most cited of 58 All 58 (JSON)

Built on by

Cited by year

Citing papers per year: 2025: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025EarthCrafter: Scalable 3D Earth Generation via Dual-Sparse Latent Diffusion
  2. 2025Geodiffussr: Generative Terrain Texturing with Elevation Fidelity
  3. 2024MetaEarth: A Generative Foundation Model for Global-Scale Remote Sensing Image Generation
  4. 2026WorldWeave: Growing Persistent Geometric Worlds for Video Generation
  5. 2025WorldGrow: Generating Infinite 3D World
  6. 2022HORIZON: High-Resolution Semantically Controlled Panorama Synthesis
  7. 2025TerraFusion: Joint Generation of Terrain Geometry and Texture Using Latent Diffusion Models
  8. 2025TRELLISWorld: Training-Free World Generation from Object Generators