TerraDiT-Omega: Unified Spatial Control for Satellite Image Synthesis with Any Geospatial Primitive
Not on the map. Why?
Abstract (arXiv)
Generative models have achieved remarkable progress, yet applying them to satellite imagery remains challenging. Unlike natural imagery, satellite scenes are structured by spatially complex and semantically distinct geometries. Prior work addresses this complexity by adapting natural image frameworks using dense rasters or sparse prompts, trading off annotation cost and fidelity while breaking compatibility with vector primitives commonly used to represent geographic information. We introduce TerraDiT-Omega, a unified spatial control framework that generates satellite imagery directly from any native geospatial primitive. By jointly leveraging precise annotations (polygons, polylines) and coarser ones (bounding boxes, points), the model supports controllable layouts across varying annotation budgets, broadening applicability to design tasks such as urban planning while remaining naturally compatible with end-to-end GeoAI workflows. To effectively leverage these primitives during generation, we propose Geometry-Aware Local Attention, a conditioning mechanism that injects explicit geometric cues into the attention space. Across all conditioning formats, our approach consistently outperforms both dense-control and sparse-control baselines. Furthermore, this flexibility enables controllable synthetic data augmentation using a single generative model, improving downstream performance on land-cover segmentation, object detection, road graph extraction, and scene classification. Code, data, and weights are available at https://github.com/mvrl/TerraDiT.
Key facts. Cited by 2 papers in the map (data through 7 Oct 2026). Builds on 57 of its 70 references that are in the map. First posted on arXiv 30 Jun 2026.
Builds on
57 of 70 references.
References · 57
- 2015Deep Residual Learning for Image Recognitioncited by 51,809
- 2014Adam: A Method for Stochastic Optimizationcited by 36,960
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
- 2018The Unreasonable Effectiveness of Deep Features as a Perceptual Metriccited by 11,029
- 2022Scalable Diffusion Models with Transformerscited by 5,931
- 2023Adding Conditional Control to Text-to-Image Diffusion Modelscited by 5,466
- 2022Flow Matching for Generative Modelingcited by 5,426
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,510
- 2023SDXL: Improving Latent Diffusion Models for High-Resolution Image Synthesiscited by 4,290
- 2024Scaling Rectified Flow Transformers for High-Resolution Image Synthesiscited by 4,094
- 2022Flow Straight and Fast: Learning to Generate and Transfer Data with Rectified Flowcited by 3,550
- 2021CLIPScore: A Reference-free Evaluation Metric for Image Captioningcited by 2,388
38 more
- 2023T2I-Adapter: Learning Adapters to Dig out More Controllable Ability for Text-to-Image Diffusion Modelscited by 1,339
- 2025DINOv3cited by 1,297
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,176
- 2023Stochastic Interpolants: A Unifying Framework for Flows and Diffusionscited by 897
- 2016Conditional Image Generation with PixelCNN Decoderscited by 859
- 2023GLIGEN: Open-Set Grounded Text-to-Image Generationcited by 774
- 2024Representation Alignment for Generation: Training Diffusion Transformers Is Easier Than You Thinkcited by 666
- 2017AttnGAN: Fine-Grained Text to Image Generation with Attentional Generative Adversarial Networkscited by 664
- 2017Unsupervised Image-to-Image Translation Networkscited by 602
- 2023DETRs Beat YOLOs on Real-time Object Detectioncited by 526
- 2022Make-A-Scene: Scene-Based Text-to-Image Generation with Human Priorscited by 487
- 2016AID: A Benchmark Dataset for Performance Evaluation of Aerial Scene Classificationcited by 343
- 2019Object Detection in Optical Remote Sensing Images: A Survey and A New Benchmarkcited by 339
- 2023LayoutGPT: Compositional Visual Planning and Generation with Large Language Modelscited by 337
- 2024PixArt-Sigma: Weak-to-Strong Training of Diffusion Transformer for 4K Text-to-Image Generationcited by 326
- 2023Composer: Creative and Controllable Image Synthesis with Composable Conditionscited by 303
- 2024Long-CLIP: Unlocking the Long-Text Capability of CLIPcited by 298
- 2021Generating Images with Sparse Representationscited by 262
- 2021LoveDA: A Remote Sensing Land-Cover Dataset for Domain Adaptive Semantic Segmentationcited by 259
- 2023LayoutDiffusion: Controllable Diffusion Model for Layout-to-image Generationcited by 258
- 2022SpaText: Spatio-Textual Representation for Controllable Image Generationcited by 217
- 2018SpaceNet: A Remote Sensing Dataset and Challenge Seriescited by 178
- 2024InstanceDiffusion: Instance-level Control for Image Generationcited by 175
- 2023RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensingcited by 150
- 2019Classification Accuracy Score for Conditional Generative Modelscited by 134
- 2023DiffusionSat: A Generative Foundation Model for Satellite Imagerycited by 130
- 2023SkyScript: A Large and Semantically Diverse Vision-Language Dataset for Remote Sensingcited by 123
- 2022OpenEarthMap: A Benchmark Dataset for Global High-Resolution Land Cover Mappingcited by 80
- 2020Sat2Graph: Road Graph Extraction through Graph-Tensor Encodingcited by 55
- 2024CRS-Diff: Controllable Remote Sensing Image Generation with Diffusion Modelcited by 54
- 2025Text2Earth: Unlocking Text-driven Remote Sensing Image Generation with a Global-Scale Dataset and a Foundation Modelcited by 46
- 2024SatSynth: Augmenting Image-Mask Pairs through Diffusion Models for Aerial Semantic Segmentationcited by 41
- 2024GeoSynth: Contextually-Aware High-Resolution Satellite Image Synthesiscited by 32
- 2024AeroGen: Enhancing Remote Sensing Object Detection with Diffusion-Driven Data Generationcited by 32
- 2022Txt2Img-MHN: Remote Sensing Image Generation from Text Using Modern Hopfield Networkscited by 28
- 2024Segment Anything Model for Road Network Graph Extractioncited by 28
- 2021Spatial-Temporal Super-Resolution of Satellite Imagery via Conditional Pixel Synthesiscited by 20
- 2023SyntheWorld: A Large-Scale Synthetic Dataset for Land Cover Mapping and Building Change Detectioncited by 19
50 most cited of 57 All 57 (JSON)
Built on by
Citing papers per year: 2026: 2.
2 papers.