Remote Sensing SpatioTemporal Vision-Language Models: A Comprehensive Survey
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
The interpretation of multi-temporal remote sensing imagery is critical for monitoring Earth's dynamic processes-yet previous change detection methods, which produce binary or semantic masks, fall short of providing human-readable insights into changes. Recent advances in Vision-Language Models (VLMs) have opened a new frontier by fusing visual and linguistic modalities, enabling spatio-temporal vision-language understanding: models that not only capture spatial and temporal dependencies to recognize changes but also provide a richer interactive semantic analysis of temporal images (e.g., generate descriptive captions and answer natural-language queries). In this survey, we present the first comprehensive review of RS-STVLMs. The survey covers the evolution of models from early task-specific models to recent general foundation models that leverage powerful large language models. We discuss progress in representative tasks, such as change captioning, change question answering, and change grounding. Moreover, we systematically dissect the fundamental components and key technologies underlying these models, and review the datasets and evaluation metrics that have driven the field. By synthesizing task-level insights with a deep dive into shared architectural patterns, we aim to illuminate current achievements and chart promising directions for future research in spatio-temporal vision-language understanding for remote sensing. We will keep tracing related works at https://github.com/Chen-Yang-Liu/Awesome-RS-SpatioTemporal-VLMs
Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 63 of its 321 references that are in the map. First posted on arXiv 3 Dec 2024.
Builds on
63 of 321 references.
Closest ancestors · 9
Same direction, newest first
- 2024GeoLLaVA: Efficient Fine-Tuned Vision-Language Models for Temporal Change Detection in Remote Sensing25 Oct
- 2024Advancements in Visual Language Models for Remote Sensing: Datasets, Capabilities, and Enhancement Techniques15 Oct
- 2024CDChat: A Large Multimodal Model for Remote Sensing Change Description24 Sep
- 2024EarthMarker: A Visual Prompting Multi-modal Large Language Model for Remote Sensing18 Jul
- 2024RS-Agent: Automating Remote Sensing Tasks through Intelligent Agent11 Jun
- 2024VHM: Versatile and Honest Vision Language Model for Remote Sensing Image Analysis29 Mar
- 2024LHRS-Bot: Empowering Remote Sensing with VGI-Enhanced Large Multimodal Language Model4 Feb
- 2023RSGPT: A Remote Sensing Vision Language Model and Benchmark28 Jul
- 2023PaLM-E: An Embodied Multimodal Language Model6 Mar
Other references · 54
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
- 2024The Llama 3 Herd of Modelscited by 14,192
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
- 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
- 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,689
- 2023A Survey of Large Language Modelscited by 2,537
- 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
38 more
- 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
- 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
- 2024Qwen2.5-Coder Technical Reportcited by 1,151
- 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 810
- 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 641
- 2023A Comprehensive Overview of Large Language Modelscited by 639
- 2023Instruction Tuning for Large Language Models: A Surveycited by 617
- 2018Rethinking the Value of Network Pruningcited by 595
- 2023LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Modelscited by 317
- 2018Compositional Attention Networks for Machine Reasoningcited by 183
- 2022A Survey of Vision-Language Pre-Trained Modelscited by 177
- 2024Exploring the Reasoning Abilities of Multimodal Large Language Models (MLLMs): A Comprehensive Survey on Emerging Trends in Multimodal Reasoningcited by 136
- 2023DiffusionSat: A Generative Foundation Model for Satellite Imagerycited by 130
- 2024Large Multimodal Agents: A Surveycited by 99
- 2024RSMamba: Remote Sensing Image Classification with State Space Modelcited by 95
- 2024Scaling Laws for Precisioncited by 92
- 2022SparseAdapter: An Easy Approach for Improving the Parameter-Efficiency of Adapterscited by 83
- 2024RS-Mamba for Large Remote Sensing Image Dense Predictioncited by 80
- 2024TEOChat: A Large Vision-Language Assistant for Temporal Earth Observation Datacited by 69
- 2024Mamba-360: Survey of State Space Models as Transformer Alternative for Long Sequence Modelling: Methods, Applications, and Challengescited by 63
- 2022Transformers in Remote Sensing: A Surveycited by 61
- 2023See, Think, Confirm: Interactive Prompting Between Vision and Language Models for Knowledge-based Visual Reasoningcited by 49
- 2024Visual Mamba: A Survey and New Outlookscited by 41
- 2020Hi-UCD: A Large-scale Dataset for Urban Semantic Change Detection in Remote Sensing Imagerycited by 33
- 2023Aligning Large Language Models with Human: A Surveycited by 31
- 2023Time Travelling Pixels: Bitemporal Features Integration with Foundation Model for Remote Sensing Image Change Detectioncited by 26
- 2024ChangeChat: An Interactive Model for Remote Sensing Change Analysis via Multimodal Instruction Tuningcited by 23
- 2024Semantic-CC: Boosting Remote Sensing Image Change Captioning via Foundational Knowledge and Semantic Guidancecited by 17
- 2024Enhancing Perception of Key Changes in Remote Sensing Image Change Captioningcited by 16
- 2024Show Me What and Where has Changed? Question Answering and Grounding for Remote Sensing Change Detectioncited by 15
- 2023Tree-GPT: Modular Large Language Model Expert System for Forest Remote Sensing Image Understanding and Interactive Analysiscited by 13
- 2024CCExpert: Advancing MLLM Capability in Remote Sensing Change Captioning with Difference-Aware Integration and a Foundational Datasetcited by 13
- 2024DeepPhysiNet: Bridging Deep Learning and Atmospheric Physics for Accurate and Continuous Weather Modelingcited by 11
- 2024Context-aware Difference Distilling for Multi-change Captioningcited by 10
- 2024PyramidMamba: Rethinking Pyramid Feature Fusion with Selective Space State Model for Semantic Segmentation of Remote Sensing Imagerycited by 10
- 2022AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuningcited by 7
- 2024ChangeMinds: Multi-task Framework for Detecting and Describing Changes in Remote Sensingcited by 7
- 2024ImageRAG: Enhancing Ultra High Resolution Remote Sensing Imagery Analysis with ImageRAGcited by 6
50 most cited of 54 All 54 (JSON)
Built on by
Citing papers per year: 2024: 1; 2025: 8; 2026: 13.
22 papers.
Sort:
By area:
- 2025Text2Earth: Unlocking Text-driven Remote Sensing Image Generation with a Global-Scale Dataset and a Foundation Modelcited by 46
- 2025RSCC: A Large-Scale Remote Sensing Change Caption Dataset for Disaster Eventscited by 13
- 2024DVP-MVS: Synergize Depth-Edge and Visibility Prior for Multi-View Stereocited by 11
- 2025TaCo: Capturing Spatio-Temporal Semantic Consistency in Remote Sensing Change Detectioncited by 6
- 2025Asking like Socrates: Socrates helps VLMs understand remote sensing imagescited by 6
- 2025DVP-MVS++: Synergize Depth-Normal-Edge and Harmonized Visibility Prior for Multi-View Stereocited by 3
- 2026Seeing Clearly without Training: Mitigating Hallucinations in Multimodal LLMs for Remote Sensingcited by 3
- 2025Neurosymbolic Inference On Foundation Models For Remote Sensing Text-to-image Retrieval With Complex Queriescited by 1
- 2025RAH-VLA: Resolution-Adaptive Hierarchical Vision-Language Alignment for Multimodal Remote Sensing Understandingcited by 1
- 2026UAV as Urban Construction Change Monitor: A New Benchmark and Change Captioning Modelcited by 1
- 2025Improving Few-Shot Change Detection Visual Question Answering via Decision-Ambiguity-guided Reinforcement Fine-Tuningcited by 0
- 2026Vision-Language Agents for Interactive Forest Change Analysiscited by 0
10 more
- 2026Forest-Chat: Adapting Vision-Language Agents for Interactive Forest Change Analysiscited by 0
- 2026FarmMind: Reasoning-Query-Driven Dynamic Segmentation for Farmland Remote Sensing Imagescited by 0
- 2026Prior-guided Fusion of Multimodal Features for Change Detection from Optical-SAR Imagescited by 0
- 2026CloudMamba: An Uncertainty-Guided Dual-Scale Mamba Network for Cloud Detection in Remote Sensing Imagerycited by 0
- 2026ChangeQuery: Advancing Remote Sensing Change Analysis for Natural and Human-Induced Disasters from Visual Detection to Semantic Understandingcited by 0
- 2026HiSem: Hierarchical Semantic Disentangling for Remote Sensing Image Change Captioningcited by 0
- 2026MetaEarth-MM: Unified Multimodal Remote Sensing Image Generation with Scene-centered Joint Modelingcited by 0
- 2026Beyond Pixel Diffs: Benchmarking Image Change Captioning for Web UI Visual Regression Testingcited by 0
- 2026LBTCap: A Lightweight Bilateral Transformer for Real-Time Remote Sensing Image Change Captioningcited by 0
- 2026Remote Sensing Sparse-View 3D Gaussian Splatting via Depth Image-Based Renderingcited by 0
- 2026Remote Sensing Sparse-View 3D Gaussian Splatting via Depth Image-Based Rendering28 Sep 2026
- 2026LBTCap: A Lightweight Bilateral Transformer for Real-Time Remote Sensing Image Change Captioning3 Jul 2026
- 2026Beyond Pixel Diffs: Benchmarking Image Change Captioning for Web UI Visual Regression Testing2 Jul 2026
- 2026MetaEarth-MM: Unified Multimodal Remote Sensing Image Generation with Scene-centered Joint Modeling19 May 2026
- 2026HiSem: Hierarchical Semantic Disentangling for Remote Sensing Image Change Captioning14 May 2026
- 2026UAV as Urban Construction Change Monitor: A New Benchmark and Change Captioning Model6 May 2026
- 2026ChangeQuery: Advancing Remote Sensing Change Analysis for Natural and Human-Induced Disasters from Visual Detection to Semantic Understanding24 Apr 2026
- 2026CloudMamba: An Uncertainty-Guided Dual-Scale Mamba Network for Cloud Detection in Remote Sensing Imagery8 Apr 2026
- 2026Prior-guided Fusion of Multimodal Features for Change Detection from Optical-SAR Images7 Apr 2026
- 2026Seeing Clearly without Training: Mitigating Hallucinations in Multimodal LLMs for Remote Sensing3 Mar 2026
- 2026FarmMind: Reasoning-Query-Driven Dynamic Segmentation for Farmland Remote Sensing Images30 Jan 2026
- 2026Forest-Chat: Adapting Vision-Language Agents for Interactive Forest Change Analysis21 Jan 2026
10 more
- 2026Vision-Language Agents for Interactive Forest Change Analysis8 Jan 2026
- 2025Improving Few-Shot Change Detection Visual Question Answering via Decision-Ambiguity-guided Reinforcement Fine-Tuning31 Dec 2025
- 2025RAH-VLA: Resolution-Adaptive Hierarchical Vision-Language Alignment for Multimodal Remote Sensing Understanding29 Dec 2025
- 2025Neurosymbolic Inference On Foundation Models For Remote Sensing Text-to-image Retrieval With Complex Queries16 Dec 2025
- 2025Asking like Socrates: Socrates helps VLMs understand remote sensing images27 Nov 2025
- 2025TaCo: Capturing Spatio-Temporal Semantic Consistency in Remote Sensing Change Detection25 Nov 2025
- 2025RSCC: A Large-Scale Remote Sensing Change Caption Dataset for Disaster Events2 Sep 2025
- 2025DVP-MVS++: Synergize Depth-Normal-Edge and Harmonized Visibility Prior for Multi-View Stereo16 Jun 2025
- 2025Text2Earth: Unlocking Text-driven Remote Sensing Image Generation with a Global-Scale Dataset and a Foundation Model1 Jan 2025
- 2024DVP-MVS: Synergize Depth-Edge and Visibility Prior for Multi-View Stereo16 Dec 2024
- 2026Seeing Clearly without Training: Mitigating Hallucinations in Multimodal LLMs for Remote Sensingcited by 3
- 2025Neurosymbolic Inference On Foundation Models For Remote Sensing Text-to-image Retrieval With Complex Queriescited by 1
- 2025RAH-VLA: Resolution-Adaptive Hierarchical Vision-Language Alignment for Multimodal Remote Sensing Understandingcited by 1
- 2026Forest-Chat: Adapting Vision-Language Agents for Interactive Forest Change Analysiscited by 0
- 2026Seeing Clearly without Training: Mitigating Hallucinations in Multimodal LLMs for Remote Sensing3 Mar 2026
- 2026Forest-Chat: Adapting Vision-Language Agents for Interactive Forest Change Analysis21 Jan 2026
- 2025RAH-VLA: Resolution-Adaptive Hierarchical Vision-Language Alignment for Multimodal Remote Sensing Understanding29 Dec 2025
- 2025Neurosymbolic Inference On Foundation Models For Remote Sensing Text-to-image Retrieval With Complex Queries16 Dec 2025
- 2025Text2Earth: Unlocking Text-driven Remote Sensing Image Generation with a Global-Scale Dataset and a Foundation Modelcited by 46
- 2025RSCC: A Large-Scale Remote Sensing Change Caption Dataset for Disaster Eventscited by 13
- 2024DVP-MVS: Synergize Depth-Edge and Visibility Prior for Multi-View Stereocited by 11
- 2025TaCo: Capturing Spatio-Temporal Semantic Consistency in Remote Sensing Change Detectioncited by 6
- 2025DVP-MVS++: Synergize Depth-Normal-Edge and Harmonized Visibility Prior for Multi-View Stereocited by 3
- 2026UAV as Urban Construction Change Monitor: A New Benchmark and Change Captioning Modelcited by 1
- 2025Improving Few-Shot Change Detection Visual Question Answering via Decision-Ambiguity-guided Reinforcement Fine-Tuningcited by 0
- 2026FarmMind: Reasoning-Query-Driven Dynamic Segmentation for Farmland Remote Sensing Imagescited by 0
- 2026Prior-guided Fusion of Multimodal Features for Change Detection from Optical-SAR Imagescited by 0
- 2026ChangeQuery: Advancing Remote Sensing Change Analysis for Natural and Human-Induced Disasters from Visual Detection to Semantic Understandingcited by 0
- 2026HiSem: Hierarchical Semantic Disentangling for Remote Sensing Image Change Captioningcited by 0
- 2026MetaEarth-MM: Unified Multimodal Remote Sensing Image Generation with Scene-centered Joint Modelingcited by 0
12 most cited of 15 All 15 (JSON)
- 2026Remote Sensing Sparse-View 3D Gaussian Splatting via Depth Image-Based Rendering28 Sep 2026
- 2026LBTCap: A Lightweight Bilateral Transformer for Real-Time Remote Sensing Image Change Captioning3 Jul 2026
- 2026Beyond Pixel Diffs: Benchmarking Image Change Captioning for Web UI Visual Regression Testing2 Jul 2026
- 2026MetaEarth-MM: Unified Multimodal Remote Sensing Image Generation with Scene-centered Joint Modeling19 May 2026
- 2026HiSem: Hierarchical Semantic Disentangling for Remote Sensing Image Change Captioning14 May 2026
- 2026UAV as Urban Construction Change Monitor: A New Benchmark and Change Captioning Model6 May 2026
- 2026ChangeQuery: Advancing Remote Sensing Change Analysis for Natural and Human-Induced Disasters from Visual Detection to Semantic Understanding24 Apr 2026
- 2026Prior-guided Fusion of Multimodal Features for Change Detection from Optical-SAR Images7 Apr 2026
- 2026FarmMind: Reasoning-Query-Driven Dynamic Segmentation for Farmland Remote Sensing Images30 Jan 2026
- 2025Improving Few-Shot Change Detection Visual Question Answering via Decision-Ambiguity-guided Reinforcement Fine-Tuning31 Dec 2025
- 2025TaCo: Capturing Spatio-Temporal Semantic Consistency in Remote Sensing Change Detection25 Nov 2025
- 2025RSCC: A Large-Scale Remote Sensing Change Caption Dataset for Disaster Events2 Sep 2025
12 newest of 15 All 15 (JSON)
Similar, not cited
Close in wording, no citation either way
- 2025Towards Comprehensive Interactive Change Understanding in Remote Sensing: A Large-scale Dataset and Dual-granularity Enhanced VLM
- 2026Decoding the Delta: Unifying Remote Sensing Change Detection and Understanding with Multimodal Large Language Models
- 2025GeoRSMLLM: A Multimodal Large Language Model for Vision-Language Tasks in Geoscience and Remote Sensing
- 2025DeltaVLM: Interactive Remote Sensing Image Change Analysis via Instruction-guided Difference Perception
- 2026Selective Tool Use for Agentic Change Visual Question Answering in Remote Sensing
- 2024From Pixels to Prose: Advancing Multi-Modal Language Models for Remote Sensing
- 2025ViLaCD-R1: A Vision-Language Framework for Semantic Change Detection in Remote Sensing
- 2026Revisiting Change VQA in Remote Sensing with Structured and Native Multimodal Qwen Models