GeoDiT: A Diffusion-based Vision-Language Model for Geospatial Understanding
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Autoregressive models are structurally misaligned with the inherently parallel nature of geospatial understanding, forcing a rigid sequential narrative onto scenes and fundamentally hindering the generation of structured and coherent outputs. We challenge this paradigm by reframing geospatial generation as a parallel refinement process, enabling a holistic, coarse-to-fine synthesis that resolves all semantic elements simultaneously. To operationalize this, we introduce GeoDiT, the first diffusion-based vision-language model tailored for the geospatial domain. Extensive experiments demonstrate that GeoDiT establishes a new state-of-the-art on benchmarks requiring structured, object-centric outputs. It achieves significant gains in image captioning, visual grounding, and multi-object detection, precisely the tasks where autoregressive models falter. Our work validates that aligning the generative process with the data's intrinsic structure is key to unlocking superior performance in complex geospatial analysis.
Key facts. Cited by 1 paper in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 27 of its 51 references that are in the map. First posted on arXiv 2 Dec 2025.
Builds on
27 of 51 references.
Closest ancestors · 9
Same direction, newest first
- 2024EarthDial: Turning Multi-sensory Earth Observations to Interactive Dialogues19 Dec
- 2024GeoGround: A Unified Large Vision-Language Model for Remote Sensing Visual Grounding16 Nov
- 2024VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understanding18 Jun
- 2024VHM: Versatile and Honest Vision Language Model for Remote Sensing Image Analysis29 Mar
- 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domain30 Jan
- 2023SkyScript: A Large and Semantically Diverse Vision-Language Dataset for Remote Sensing20 Dec
- 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensing24 Nov
- 2023RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensing20 Jun
- 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensing19 Jun
Other references · 18
- 2023GPT-4 Technical Reportcited by 18,132
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,362
- 2017EuroSAT: A Novel Dataset and Deep Learning Benchmark for Land Use and Land Cover Classificationcited by 1,488
- 2017Remote Sensing Image Scene Classification: Benchmark and State of the Artcited by 791
- 2016AID: A Benchmark Dataset for Performance Evaluation of Aerial Scene Classificationcited by 343
- 2025Mercury: Ultra-Fast Language Models Based on Diffusioncited by 225
- 2021Object Detection in Aerial Images: A Large-Scale Benchmark and Challengescited by 202
- 2020RSVQA: Visual Question Answering for Remote Sensing Datacited by 197
- 2017Exploring Models and Data for Remote Sensing Image Caption Generationcited by 195
- 2020FloodNet: A High Resolution Aerial Imagery Dataset for Post Flood Scene Understandingcited by 181
- 2025LLaDA-V: Large Language Diffusion Models with Visual Instruction Tuningcited by 145
- 2021FAIR1M: A Benchmark Dataset for Fine-grained Object Recognition in High-Resolution Remote Sensing Imagerycited by 143
6 more
- 2022RSVG: Exploring Data and Models for Visual Grounding on Remote Sensing Datacited by 121
- 2023DiffiT: Diffusion Vision Transformers for Image Generationcited by 104
- 2025LaViDa: A Large Diffusion Language Model for Multimodal Understandingcited by 81
- 2022Exploring a Fine-Grained Multiscale Method for Cross-Modal Remote Sensing Image Retrievalcited by 77
- 2024From LLM to NMT: Advancing Low-Resource Machine Translation with Claudecited by 57
- 2024LaVida Drive: Vision-Text Interaction VLM for Autonomous Driving with Token Selection, Recovery and Enhancementcited by 9
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Textual Supervision Enhances Geospatial Representations in Vision-Language Models
- 2025GeoViS: Geospatially Rewarded Visual Search for Remote Sensing Visual Grounding
- 2024Towards Vision-Language Geo-Foundation Model: A Survey
- 2024GEOBench-VLM: Benchmarking Vision-Language Models for Geospatial Tasks
- 2026GeoBridge: Decoupled Semantic Conditioning for Generative Image Geolocalization
- 2026GeoCore-9B: Towards Geo-Aware Generative Foundation Models in Earth Observation
- 2024Remote Sensing SpatioTemporal Vision-Language Models: A Comprehensive Survey
- 2023GeoDiffusion: Text-Prompted Geometric Control for Object Detection Data Generation