mlsanityData to 14 Oct 2026

EarthMapper: Visual Autoregressive Models for Controllable Bidirectional Satellite-Map Translation

arXiv 2504.19432 ↗First posted 28 Apr 2025cs.CV cs.AIcited by 2

Not on the map. Why?

Abstract (arXiv)

Satellite imagery and maps, as two fundamental data modalities in remote sensing, offer direct observations of the Earth's surface and human-interpretable geographic abstractions, respectively. The task of bidirectional translation between satellite images and maps (BSMT) holds significant potential for applications in urban planning and disaster response. However, this task presents two major challenges: first, the absence of precise pixel-wise alignment between the two modalities substantially complicates the translation process; second, it requires achieving both high-level abstraction of geographic features and high-quality visual synthesis, which further elevates the technical complexity. To address these limitations, we introduce EarthMapper, a novel autoregressive framework for controllable bidirectional satellite-map translation. EarthMapper employs geographic coordinate embeddings to anchor generation, ensuring region-specific adaptability, and leverages multi-scale feature alignment within a geo-conditioned joint scale autoregression (GJSA) process to unify bidirectional translation in a single training cycle. A semantic infusion (SI) mechanism is introduced to enhance feature-level consistency, while a key point adaptive guidance (KPAG) mechanism is proposed to dynamically balance diversity and precision during inference. We further contribute CNSatMap, a large-scale dataset comprising 302,132 precisely aligned satellite-map pairs across 38 Chinese cities, enabling robust benchmarking. Extensive experiments on CNSatMap and the New York dataset demonstrate EarthMapper's superior performance, achieving significant improvements in visual realism, semantic consistency, and structural fidelity over state-of-the-art methods. Additionally, EarthMapper excels in zero-shot tasks like in-painting, out-painting and coordinate-conditional generation, underscoring its versatility.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 46 of its 62 references that are in the map. First posted on arXiv 28 Apr 2025.

Builds on

46 of 62 references.

References · 46

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  5. 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
  6. 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
  7. 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
  8. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  9. 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
  10. 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
  11. 2022Classifier-Free Diffusion Guidancecited by 5,847
  12. 2022Generative Adversarial Networkscited by 5,627
34 more
  1. 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
  2. 2017Neural Discrete Representation Learningcited by 4,712
  3. 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
  4. 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
  5. 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
  6. 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
  7. 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
  8. 2014Conditional Generative Adversarial Netscited by 2,162
  9. 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,387
  10. 2018Demystifying MMD GANscited by 1,293
  11. 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
  12. 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 944
  13. 2016Conditional Image Generation with PixelCNN Decoderscited by 862
  14. 2016Pixel Recurrent Neural Networkscited by 816
  15. 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 781
  16. 2018Image Transformercited by 772
  17. 2022Autoregressive Image Generation using Residual Quantizationcited by 722
  18. 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 394
  19. 2022VQGAN-CLIP: Open Domain Image Generation and Editing with Natural Language Guidancecited by 285
  20. 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 225
  21. 2023Any-to-Any Generation via Composable Diffusioncited by 204
  22. 2023UniControl: A Unified Diffusion Model for Controllable Visual Generation In the Wildcited by 200
  23. 2023DiffusionSat: A Generative Foundation Model for Satellite Imagerycited by 131
  24. 2017Parallel Multiscale Autoregressive Density Estimationcited by 71
  25. 2024ControlVAR: Exploring Controllable Visual Autoregressive Modelingcited by 58
  26. 2024ControlAR: Controllable Image Generation with Autoregressive Modelscited by 48
  27. 2024MetaEarth: A Generative Foundation Model for Global-Scale Remote Sensing Image Generationcited by 42
  28. 2023Generate Your Own Scotland: Satellite Image Generation Conditioned on Mapscited by 30
  29. 2024CAR: Controllable Autoregressive Modeling for Visual Generationcited by 30
  30. 2023RSDiff: Remote Sensing Image Generation from Text Using Diffusion Modelcited by 29
  31. 2024HSIGene: A Foundation Model For Hyperspectral Image Generationcited by 22
  32. 2024StegoGAN: Leveraging Steganography for Non-Bijective Image-to-Image Translationcited by 18
  33. 2022Outpainting by Queriescited by 12
  34. 2021Image to Image Translation : Generating maps from satellite imagescited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 1; 2026: 1.

2 papers.