EarthMapper: Visual Autoregressive Models for Controllable Bidirectional Satellite-Map Translation
Not on the map. Why?
Abstract (arXiv)
Satellite imagery and maps, as two fundamental data modalities in remote sensing, offer direct observations of the Earth's surface and human-interpretable geographic abstractions, respectively. The task of bidirectional translation between satellite images and maps (BSMT) holds significant potential for applications in urban planning and disaster response. However, this task presents two major challenges: first, the absence of precise pixel-wise alignment between the two modalities substantially complicates the translation process; second, it requires achieving both high-level abstraction of geographic features and high-quality visual synthesis, which further elevates the technical complexity. To address these limitations, we introduce EarthMapper, a novel autoregressive framework for controllable bidirectional satellite-map translation. EarthMapper employs geographic coordinate embeddings to anchor generation, ensuring region-specific adaptability, and leverages multi-scale feature alignment within a geo-conditioned joint scale autoregression (GJSA) process to unify bidirectional translation in a single training cycle. A semantic infusion (SI) mechanism is introduced to enhance feature-level consistency, while a key point adaptive guidance (KPAG) mechanism is proposed to dynamically balance diversity and precision during inference. We further contribute CNSatMap, a large-scale dataset comprising 302,132 precisely aligned satellite-map pairs across 38 Chinese cities, enabling robust benchmarking. Extensive experiments on CNSatMap and the New York dataset demonstrate EarthMapper's superior performance, achieving significant improvements in visual realism, semantic consistency, and structural fidelity over state-of-the-art methods. Additionally, EarthMapper excels in zero-shot tasks like in-painting, out-painting and coordinate-conditional generation, underscoring its versatility.
Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Builds on 46 of its 62 references that are in the map. First posted on arXiv 28 Apr 2025.
Builds on
46 of 62 references.
References · 46
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,177
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2022Classifier-Free Diffusion Guidancecited by 5,847
- 2022Generative Adversarial Networkscited by 5,627
34 more
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2017Neural Discrete Representation Learningcited by 4,712
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2021GLIDE: Towards Photorealistic Image Generation and Editing with Text-Guided Diffusion Modelscited by 3,614
- 2022DreamBooth: Fine Tuning Text-to-Image Diffusion Models for Subject-Driven Generationcited by 3,300
- 2020Taming Transformers for High-Resolution Image Synthesiscited by 3,253
- 2022An Image is Worth One Word: Personalizing Text-to-Image Generation using Textual Inversioncited by 2,245
- 2014Conditional Generative Adversarial Netscited by 2,162
- 2019Generating Diverse High-Fidelity Images with VQ-VAE-2cited by 1,387
- 2018Demystifying MMD GANscited by 1,293
- 2024Visual Autoregressive Modeling: Scalable Image Generation via Next-Scale Predictioncited by 1,023
- 2019Improved Precision and Recall Metric for Assessing Generative Modelscited by 944
- 2016Conditional Image Generation with PixelCNN Decoderscited by 862
- 2016Pixel Recurrent Neural Networkscited by 816
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 781
- 2018Image Transformercited by 772
- 2022Autoregressive Image Generation using Residual Quantizationcited by 722
- 2020InterFaceGAN: Interpreting the Disentangled Face Representation Learned by GANscited by 394
- 2022VQGAN-CLIP: Open Domain Image Generation and Editing with Natural Language Guidancecited by 285
- 2022BBDM: Image-to-image Translation with Brownian Bridge Diffusion Modelscited by 225
- 2023Any-to-Any Generation via Composable Diffusioncited by 204
- 2023UniControl: A Unified Diffusion Model for Controllable Visual Generation In the Wildcited by 200
- 2023DiffusionSat: A Generative Foundation Model for Satellite Imagerycited by 131
- 2017Parallel Multiscale Autoregressive Density Estimationcited by 71
- 2024ControlVAR: Exploring Controllable Visual Autoregressive Modelingcited by 58
- 2024ControlAR: Controllable Image Generation with Autoregressive Modelscited by 48
- 2024MetaEarth: A Generative Foundation Model for Global-Scale Remote Sensing Image Generationcited by 42
- 2023Generate Your Own Scotland: Satellite Image Generation Conditioned on Mapscited by 30
- 2024CAR: Controllable Autoregressive Modeling for Visual Generationcited by 30
- 2023RSDiff: Remote Sensing Image Generation from Text Using Diffusion Modelcited by 29
- 2024HSIGene: A Foundation Model For Hyperspectral Image Generationcited by 22
- 2024StegoGAN: Leveraging Steganography for Non-Bijective Image-to-Image Translationcited by 18
- 2022Outpainting by Queriescited by 12
- 2021Image to Image Translation : Generating maps from satellite imagescited by 4
Built on by
Citing papers per year: 2025: 1; 2026: 1.
2 papers.