mlsanityData to 14 Oct 2026

Remote Sensing Image Intelligent Interpretation with the Language-Centered Perspective: Principles, Methods and Challenges

arXiv 2508.06832 ↗First posted 9 Aug 2025cs.AIcited by 1

Not on the map. Why?

Abstract (arXiv)

The mainstream paradigm of remote sensing image interpretation has long been dominated by vision-centered models, which rely on visual features for semantic understanding. However, these models face inherent limitations in handling multi-modal reasoning, semantic abstraction, and interactive decision-making. While recent advances have introduced Large Language Models (LLMs) into remote sensing workflows, existing studies primarily focus on downstream applications, lacking a unified theoretical framework that explains the cognitive role of language. This review advocates a paradigm shift from vision-centered to language-centered remote sensing interpretation. Drawing inspiration from the Global Workspace Theory (GWT) of human cognition, We propose a language-centered framework for remote sensing interpretation that treats LLMs as the cognitive central hub integrating perceptual, task, knowledge and action spaces to enable unified understanding, reasoning, and decision-making. We first explore the potential of LLMs as the central cognitive component in remote sensing interpretation, and then summarize core technical challenges, including unified multimodal representation, knowledge association, and reasoning and decision-making. Furthermore, we construct a global workspace-driven interpretation mechanism and review how language-centered solutions address each challenge. Finally, we outline future research directions from four perspectives: adaptive alignment of multimodal data, task understanding under dynamic knowledge constraints, trustworthy reasoning, and autonomous interaction. This work aims to provide a conceptual foundation for the next generation of remote sensing interpretation systems and establish a roadmap toward cognition-driven intelligent geospatial analysis.

Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 151 of its 217 references that are in the map. First posted on arXiv 9 Aug 2025.

Builds on

151 of 217 references.

References · 151

  1. 2017Attention Is All You Needcited by 60,361
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  3. 2020Language Models are Few-Shot Learnerscited by 32,419
  4. 2023GPT-4 Technical Reportcited by 18,396
  5. 2017Proximal Policy Optimization Algorithmscited by 15,215
  6. 2024The Llama 3 Herd of Modelscited by 14,715
  7. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  8. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  9. 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
  10. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  11. 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
  12. 2023Segment Anythingcited by 8,234
38 more
  1. 2023Visual Instruction Tuningcited by 7,869
  2. 2017Mask R-CNNcited by 7,277
  3. 2020Scaling Laws for Neural Language Modelscited by 6,586
  4. 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
  5. 2024GPT-4o System Cardcited by 4,588
  6. 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
  7. 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
  8. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  9. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  10. 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
  11. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  12. 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
  13. 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
  14. 2023Qwen Technical Reportcited by 3,344
  15. 2013Playing Atari with Deep Reinforcement Learningcited by 3,274
  16. 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
  17. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
  18. 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
  19. 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,222
  20. 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
  21. 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
  22. 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
  23. 2019LXMERT: Learning Cross-Modality Encoder Representations from Transformerscited by 1,553
  24. 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,423
  25. 2019VisualBERT: A Simple and Performant Baseline for Vision and Languagecited by 1,296
  26. 2021ViLT: Vision-and-Language Transformer Without Convolution or Region Supervisioncited by 1,230
  27. 2020Oscar: Object-Semantics Aligned Pre-training for Vision-Language Taskscited by 1,214
  28. 2018Self-Attention with Relative Position Representationscited by 1,120
  29. 2019VL-BERT: Pre-training of Generic Visual-Linguistic Representationscited by 954
  30. 2017Revisiting Unreasonable Effectiveness of Data in Deep Learning Eracited by 919
  31. 2017Remote Sensing Image Scene Classification: Benchmark and State of the Artcited by 797
  32. 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 688
  33. 2023Instruction Tuning with GPT-4cited by 686
  34. 2021SimVLM: Simple Visual Language Model Pretraining with Weak Supervisioncited by 647
  35. 2024DeepSeek LLM: Scaling Open-Source Language Models with Longtermismcited by 642
  36. 2023MiniGPT-v2: large language model as a unified interface for vision-language multi-task learningcited by 625
  37. 2017DOTA: A Large-scale Dataset for Object Detection in Aerial Imagescited by 623
  38. 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 622

50 most cited of 151 All 151 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 1.

1 paper.