VectorSynth: Fine-Grained Satellite Image Synthesis with Structured Semantics
Not on the map. Why?
Abstract (arXiv)
We introduce VectorSynth, a diffusion-based framework for pixel-accurate satellite image synthesis conditioned on polygonal geographic annotations with semantic attributes. Unlike prior text- or layout-conditioned models, VectorSynth learns dense cross-modal correspondences that align imagery and semantic vector geometry, enabling fine-grained, spatially grounded edits. A vision language alignment module produces pixel-level embeddings from polygon semantics; these embeddings guide a conditional image generation framework to respect both spatial extents and semantic cues. VectorSynth supports interactive workflows that mix language prompts with geometry-aware conditioning, allowing rapid what-if simulations, spatial edits, and map-informed content generation. For training and evaluation, we assemble a collection of satellite scenes paired with pixel-registered polygon annotations spanning diverse urban scenes with both built and natural features. We observe strong improvements over prior methods in semantic fidelity and structural realism, and show that our trained vision language model demonstrates fine-grained spatial grounding. The code and data are available at https://github.com/mvrl/VectorSynth.
Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 38 of its 54 references that are in the map. First posted on arXiv 11 Nov 2025.
Builds on
38 of 54 references.
References · 38
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2021High-Resolution Image Synthesis with Latent Diffusion Modelscited by 18,863
- 2023Segment Anythingcited by 8,234
- 2023Visual Instruction Tuningcited by 7,869
- 2022Hierarchical Text-Conditional Image Generation with CLIP Latentscited by 6,585
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,503
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
- 2022InstructPix2Pix: Learning to Follow Image Editing Instructionscited by 2,611
- 2022RePaint: Inpainting using Denoising Diffusion Probabilistic Modelscited by 1,430
26 more
- 2022Text Embeddings by Weakly-Supervised Contrastive Pre-trainingcited by 1,253
- 2022Imagic: Text-Based Real Image Editing with Diffusion Modelscited by 1,178
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 781
- 2021FILIP: Fine-grained Interactive Language-Image Pre-Trainingcited by 627
- 2021RegionCLIP: Region-based Language-Image Pretrainingcited by 616
- 2021Extract Free Dense Labels from CLIPcited by 583
- 2021Image Segmentation Using Text and Image Promptscited by 512
- 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensingcited by 363
- 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensingcited by 328
- 2022SatlasPretrain: A Large-Scale Dataset for Remote Sensing Image Understandingcited by 167
- 2023DiffusionSat: A Generative Foundation Model for Satellite Imagerycited by 131
- 2023SkyScript: A Large and Semantically Diverse Vision-Language Dataset for Remote Sensingcited by 125
- 2024FeatUp: A Model-Agnostic Framework for Features at Any Resolutioncited by 116
- 2024ClearCLIP: Decomposing CLIP Representations for Dense Vision-Language Inferencecited by 113
- 2022Fine-Grained Semantically Aligned Vision-Language Pre-Trainingcited by 68
- 2025GeoPixel: Pixel Grounding Large Multimodal Model in Remote Sensingcited by 57
- 2024MetaEarth: A Generative Foundation Model for Global-Scale Remote Sensing Image Generationcited by 42
- 2024SatSynth: Augmenting Image-Mask Pairs through Diffusion Models for Aerial Semantic Segmentationcited by 41
- 2025RemoteSAM: Towards Segment Anything for Earth Observationcited by 39
- 2023Revisiting Multimodal Representation in Contrastive Learning: From Patch and Token Embeddings to Finite Discrete Tokenscited by 35
- 2024GeoSynth: Contextually-Aware High-Resolution Satellite Image Synthesiscited by 32
- 2021Spatial-Temporal Super-Resolution of Satellite Imagery via Conditional Pixel Synthesiscited by 20
- 2023Sat2Cap: Mapping Fine-Grained Textual Descriptions from Satellite Imagescited by 19
- 2025The Change You Want To Detect: Semantic Change Detection In Earth Observation With Hybrid Data Generationcited by 12
- 2025Learning from Streaming Video with Orthogonal Gradientscited by 9
- 2023DiffUCD:Unsupervised Hyperspectral Image Change Detection with Semantic Correlation Diffusion Modelcited by 8
Built on by
Citing papers per year: 2026: 5.
5 papers.
- 2026Tessellating The Earthcited by 2
- 2026TerraDiT-Omega: Unified Spatial Control for Satellite Image Synthesis with Any Geospatial Primitivecited by 2
- 2026TerraDiT: Point-Conditioned Diffusion Transformer for Satellite Image Synthesiscited by 0
- 2026Genesis: A Generative Engine for Hierarchical Satellite Image Synthesiscited by 0
- 2026From Pixels to Policy: A Multi-Agent System for Intervention and Geo-Spatial Decision Supportcited by 0
- 2026From Pixels to Policy: A Multi-Agent System for Intervention and Geo-Spatial Decision Support1 Oct 2026
- 2026Genesis: A Generative Engine for Hierarchical Satellite Image Synthesis2 Sep 2026
- 2026TerraDiT-Omega: Unified Spatial Control for Satellite Image Synthesis with Any Geospatial Primitive30 Jun 2026
- 2026Tessellating The Earth25 Jun 2026
- 2026TerraDiT: Point-Conditioned Diffusion Transformer for Satellite Image Synthesis2 Mar 2026
Similar, not cited
Close in wording, no citation either way
- 2026Vector Map as Language: Toward Unified Remote Sensing Vector Mapping
- 2025Satellite to GroundScape -- Large-scale Consistent Ground View Generation from Satellite Views
- 2025Few-Shot Vision-Language Reasoning for Satellite Imagery via Verifiable Rewards
- 2024Geometry-guided Cross-view Diffusion for One-to-many Cross-view Image Synthesis
- 2023SatDM: Synthesizing Realistic Satellite Image with Semantic Layout Conditioning using Diffusion Models
- 2024Geospecific View Generation -- Geometry-Context Aware High-resolution Ground View Inference from Satellite Views
- 2025SATGround: A Spatially-Aware Approach for Visual Grounding in Remote Sensing
- 2026GeoAlignCLIP: Enhancing Fine-Grained Vision-Language Alignment in Remote Sensing via Multi-Granular Consistency Learning