mlsanityData to 7 Oct 2026

Remote Sensing SpatioTemporal Vision-Language Models: A Comprehensive Survey

arXiv 2412.02573 ↗First posted 3 Dec 2024cs.CVcited by 22

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

The interpretation of multi-temporal remote sensing imagery is critical for monitoring Earth's dynamic processes-yet previous change detection methods, which produce binary or semantic masks, fall short of providing human-readable insights into changes. Recent advances in Vision-Language Models (VLMs) have opened a new frontier by fusing visual and linguistic modalities, enabling spatio-temporal vision-language understanding: models that not only capture spatial and temporal dependencies to recognize changes but also provide a richer interactive semantic analysis of temporal images (e.g., generate descriptive captions and answer natural-language queries). In this survey, we present the first comprehensive review of RS-STVLMs. The survey covers the evolution of models from early task-specific models to recent general foundation models that leverage powerful large language models. We discuss progress in representative tasks, such as change captioning, change question answering, and change grounding. Moreover, we systematically dissect the fundamental components and key technologies underlying these models, and review the datasets and evaluation metrics that have driven the field. By synthesizing task-level insights with a deep dive into shared architectural patterns, we aim to illuminate current achievements and chart promising directions for future research in spatio-temporal vision-language understanding for remote sensing. We will keep tracing related works at https://github.com/Chen-Yang-Liu/Awesome-RS-SpatioTemporal-VLMs

Key facts. Cited by 22 papers in the map (data through 7 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 63 of its 321 references that are in the map. First posted on arXiv 3 Dec 2024.

Builds on

63 of 321 references.

Closest ancestors · 9

Same direction, newest first

  1. 2024GeoLLaVA: Efficient Fine-Tuned Vision-Language Models for Temporal Change Detection in Remote Sensing25 Oct
  2. 2024Advancements in Visual Language Models for Remote Sensing: Datasets, Capabilities, and Enhancement Techniques15 Oct
  3. 2024CDChat: A Large Multimodal Model for Remote Sensing Change Description24 Sep
  4. 2024EarthMarker: A Visual Prompting Multi-modal Large Language Model for Remote Sensing18 Jul
  5. 2024RS-Agent: Automating Remote Sensing Tasks through Intelligent Agent11 Jun
  6. 2024VHM: Versatile and Honest Vision Language Model for Remote Sensing Image Analysis29 Mar
  7. 2024LHRS-Bot: Empowering Remote Sensing with VGI-Enhanced Large Multimodal Language Model4 Feb
  8. 2023RSGPT: A Remote Sensing Vision Language Model and Benchmark28 Jul
  9. 2023PaLM-E: An Embodied Multimodal Language Model6 Mar

Other references · 54

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,204
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,267
  4. 2024The Llama 3 Herd of Modelscited by 14,192
  5. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  6. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 13,958
  7. 2023Llama 2: Open Foundation and Fine-Tuned Chat Modelscited by 12,865
  8. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  9. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  10. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,689
  11. 2023A Survey of Large Language Modelscited by 2,537
  12. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
38 more
  1. 2023MetaGPT: Meta Programming for A Multi-Agent Collaborative Frameworkcited by 1,761
  2. 2023The Rise and Potential of Large Language Model Based Agents: A Surveycited by 1,422
  3. 2024Qwen2.5-Coder Technical Reportcited by 1,151
  4. 2023Gemini: A Family of Highly Capable Multimodal Modelscited by 810
  5. 2024Parameter-Efficient Fine-Tuning for Large Models: A Comprehensive Surveycited by 641
  6. 2023A Comprehensive Overview of Large Language Modelscited by 639
  7. 2023Instruction Tuning for Large Language Models: A Surveycited by 617
  8. 2018Rethinking the Value of Network Pruningcited by 595
  9. 2023LLM-Adapters: An Adapter Family for Parameter-Efficient Fine-Tuning of Large Language Modelscited by 317
  10. 2018Compositional Attention Networks for Machine Reasoningcited by 183
  11. 2022A Survey of Vision-Language Pre-Trained Modelscited by 177
  12. 2024Exploring the Reasoning Abilities of Multimodal Large Language Models (MLLMs): A Comprehensive Survey on Emerging Trends in Multimodal Reasoningcited by 136
  13. 2023DiffusionSat: A Generative Foundation Model for Satellite Imagerycited by 130
  14. 2024Large Multimodal Agents: A Surveycited by 99
  15. 2024RSMamba: Remote Sensing Image Classification with State Space Modelcited by 95
  16. 2024Scaling Laws for Precisioncited by 92
  17. 2022SparseAdapter: An Easy Approach for Improving the Parameter-Efficiency of Adapterscited by 83
  18. 2024RS-Mamba for Large Remote Sensing Image Dense Predictioncited by 80
  19. 2024TEOChat: A Large Vision-Language Assistant for Temporal Earth Observation Datacited by 69
  20. 2024Mamba-360: Survey of State Space Models as Transformer Alternative for Long Sequence Modelling: Methods, Applications, and Challengescited by 63
  21. 2022Transformers in Remote Sensing: A Surveycited by 61
  22. 2023See, Think, Confirm: Interactive Prompting Between Vision and Language Models for Knowledge-based Visual Reasoningcited by 49
  23. 2024Visual Mamba: A Survey and New Outlookscited by 41
  24. 2020Hi-UCD: A Large-scale Dataset for Urban Semantic Change Detection in Remote Sensing Imagerycited by 33
  25. 2023Aligning Large Language Models with Human: A Surveycited by 31
  26. 2023Time Travelling Pixels: Bitemporal Features Integration with Foundation Model for Remote Sensing Image Change Detectioncited by 26
  27. 2024ChangeChat: An Interactive Model for Remote Sensing Change Analysis via Multimodal Instruction Tuningcited by 23
  28. 2024Semantic-CC: Boosting Remote Sensing Image Change Captioning via Foundational Knowledge and Semantic Guidancecited by 17
  29. 2024Enhancing Perception of Key Changes in Remote Sensing Image Change Captioningcited by 16
  30. 2024Show Me What and Where has Changed? Question Answering and Grounding for Remote Sensing Change Detectioncited by 15
  31. 2023Tree-GPT: Modular Large Language Model Expert System for Forest Remote Sensing Image Understanding and Interactive Analysiscited by 13
  32. 2024CCExpert: Advancing MLLM Capability in Remote Sensing Change Captioning with Difference-Aware Integration and a Foundational Datasetcited by 13
  33. 2024DeepPhysiNet: Bridging Deep Learning and Atmospheric Physics for Accurate and Continuous Weather Modelingcited by 11
  34. 2024Context-aware Difference Distilling for Multi-change Captioningcited by 10
  35. 2024PyramidMamba: Rethinking Pyramid Feature Fusion with Selective Space State Model for Semantic Segmentation of Remote Sensing Imagerycited by 10
  36. 2022AdaMix: Mixture-of-Adaptations for Parameter-efficient Model Tuningcited by 7
  37. 2024ChangeMinds: Multi-task Framework for Detecting and Describing Changes in Remote Sensingcited by 7
  38. 2024ImageRAG: Enhancing Ultra High Resolution Remote Sensing Imagery Analysis with ImageRAGcited by 6

50 most cited of 54 All 54 (JSON)

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 8; 2026: 13.

22 papers.

Sort:

By area:

  1. 2025Text2Earth: Unlocking Text-driven Remote Sensing Image Generation with a Global-Scale Dataset and a Foundation Modelcited by 46
  2. 2025RSCC: A Large-Scale Remote Sensing Change Caption Dataset for Disaster Eventscited by 13
  3. 2024DVP-MVS: Synergize Depth-Edge and Visibility Prior for Multi-View Stereocited by 11
  4. 2025TaCo: Capturing Spatio-Temporal Semantic Consistency in Remote Sensing Change Detectioncited by 6
  5. 2025Asking like Socrates: Socrates helps VLMs understand remote sensing imagescited by 6
  6. 2025DVP-MVS++: Synergize Depth-Normal-Edge and Harmonized Visibility Prior for Multi-View Stereocited by 3
  7. 2026Seeing Clearly without Training: Mitigating Hallucinations in Multimodal LLMs for Remote Sensingcited by 3
  8. 2025Neurosymbolic Inference On Foundation Models For Remote Sensing Text-to-image Retrieval With Complex Queriescited by 1
  9. 2025RAH-VLA: Resolution-Adaptive Hierarchical Vision-Language Alignment for Multimodal Remote Sensing Understandingcited by 1
  10. 2026UAV as Urban Construction Change Monitor: A New Benchmark and Change Captioning Modelcited by 1
  11. 2025Improving Few-Shot Change Detection Visual Question Answering via Decision-Ambiguity-guided Reinforcement Fine-Tuningcited by 0
  12. 2026Vision-Language Agents for Interactive Forest Change Analysiscited by 0
10 more
  1. 2026Forest-Chat: Adapting Vision-Language Agents for Interactive Forest Change Analysiscited by 0
  2. 2026FarmMind: Reasoning-Query-Driven Dynamic Segmentation for Farmland Remote Sensing Imagescited by 0
  3. 2026Prior-guided Fusion of Multimodal Features for Change Detection from Optical-SAR Imagescited by 0
  4. 2026CloudMamba: An Uncertainty-Guided Dual-Scale Mamba Network for Cloud Detection in Remote Sensing Imagerycited by 0
  5. 2026ChangeQuery: Advancing Remote Sensing Change Analysis for Natural and Human-Induced Disasters from Visual Detection to Semantic Understandingcited by 0
  6. 2026HiSem: Hierarchical Semantic Disentangling for Remote Sensing Image Change Captioningcited by 0
  7. 2026MetaEarth-MM: Unified Multimodal Remote Sensing Image Generation with Scene-centered Joint Modelingcited by 0
  8. 2026Beyond Pixel Diffs: Benchmarking Image Change Captioning for Web UI Visual Regression Testingcited by 0
  9. 2026LBTCap: A Lightweight Bilateral Transformer for Real-Time Remote Sensing Image Change Captioningcited by 0
  10. 2026Remote Sensing Sparse-View 3D Gaussian Splatting via Depth Image-Based Renderingcited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025Towards Comprehensive Interactive Change Understanding in Remote Sensing: A Large-scale Dataset and Dual-granularity Enhanced VLM
  2. 2026Decoding the Delta: Unifying Remote Sensing Change Detection and Understanding with Multimodal Large Language Models
  3. 2025GeoRSMLLM: A Multimodal Large Language Model for Vision-Language Tasks in Geoscience and Remote Sensing
  4. 2025DeltaVLM: Interactive Remote Sensing Image Change Analysis via Instruction-guided Difference Perception
  5. 2026Selective Tool Use for Agentic Change Visual Question Answering in Remote Sensing
  6. 2024From Pixels to Prose: Advancing Multi-Modal Language Models for Remote Sensing
  7. 2025ViLaCD-R1: A Vision-Language Framework for Semantic Change Detection in Remote Sensing
  8. 2026Revisiting Change VQA in Remote Sensing with Structured and Native Multimodal Qwen Models