Remote Sensing Image Intelligent Interpretation with the Language-Centered Perspective: Principles, Methods and Challenges
Not on the map. Why?
Abstract (arXiv)
The mainstream paradigm of remote sensing image interpretation has long been dominated by vision-centered models, which rely on visual features for semantic understanding. However, these models face inherent limitations in handling multi-modal reasoning, semantic abstraction, and interactive decision-making. While recent advances have introduced Large Language Models (LLMs) into remote sensing workflows, existing studies primarily focus on downstream applications, lacking a unified theoretical framework that explains the cognitive role of language. This review advocates a paradigm shift from vision-centered to language-centered remote sensing interpretation. Drawing inspiration from the Global Workspace Theory (GWT) of human cognition, We propose a language-centered framework for remote sensing interpretation that treats LLMs as the cognitive central hub integrating perceptual, task, knowledge and action spaces to enable unified understanding, reasoning, and decision-making. We first explore the potential of LLMs as the central cognitive component in remote sensing interpretation, and then summarize core technical challenges, including unified multimodal representation, knowledge association, and reasoning and decision-making. Furthermore, we construct a global workspace-driven interpretation mechanism and review how language-centered solutions address each challenge. Finally, we outline future research directions from four perspectives: adaptive alignment of multimodal data, task understanding under dynamic knowledge constraints, trustworthy reasoning, and autonomous interaction. This work aims to provide a conceptual foundation for the next generation of remote sensing interpretation systems and establish a roadmap toward cognition-driven intelligent geospatial analysis.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 151 of its 217 references that are in the map. First posted on arXiv 9 Aug 2025.
Builds on
151 of 217 references.
References · 151
- 2017Attention Is All You Needcited by 60,361
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020Language Models are Few-Shot Learnerscited by 32,419
- 2023GPT-4 Technical Reportcited by 18,396
- 2017Proximal Policy Optimization Algorithmscited by 15,215
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
- 2022Chain-of-Thought Prompting Elicits Reasoning in Large Language Modelscited by 12,459
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2022ReAct: Synergizing Reasoning and Acting in Language Modelscited by 8,695
- 2023Segment Anythingcited by 8,234
38 more
- 2023Visual Instruction Tuningcited by 7,869
- 2017Mask R-CNNcited by 7,277
- 2020Scaling Laws for Neural Language Modelscited by 6,586
- 2022PaLM: Scaling Language Modeling with Pathwayscited by 5,326
- 2024GPT-4o System Cardcited by 4,588
- 2023Improved Baselines with Visual Instruction Tuningcited by 4,418
- 2022Flamingo: a Visual Language Model for Few-Shot Learningcited by 4,386
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2023Toolformer: Language Models Can Teach Themselves to Use Toolscited by 4,182
- 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
- 2021Scaling Up Visual and Vision-Language Representation Learning With Noisy Text Supervisioncited by 3,864
- 2023Self-Refine: Iterative Refinement with Self-Feedbackcited by 3,442
- 2023Qwen Technical Reportcited by 3,344
- 2013Playing Atari with Deep Reinforcement Learningcited by 3,274
- 2023Sigmoid Loss for Language Image Pre-Trainingcited by 3,109
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
- 2024LLaVA-OneVision: Easy Visual Task Transfercited by 2,719
- 2019ViLBERT: Pretraining Task-Agnostic Visiolinguistic Representations for Vision-and-Language Taskscited by 2,222
- 2023PaLM-E: An Embodied Multimodal Language Modelcited by 2,071
- 2023ToolLLM: Facilitating Large Language Models to Master 16000+ Real-world APIscited by 1,947
- 2021WebGPT: Browser-assisted question-answering with human feedbackcited by 1,745
- 2019LXMERT: Learning Cross-Modality Encoder Representations from Transformerscited by 1,553
- 2015Show, Attend and Tell: Neural Image Caption Generation with Visual Attentioncited by 1,423
- 2019VisualBERT: A Simple and Performant Baseline for Vision and Languagecited by 1,296
- 2021ViLT: Vision-and-Language Transformer Without Convolution or Region Supervisioncited by 1,230
- 2020Oscar: Object-Semantics Aligned Pre-training for Vision-Language Taskscited by 1,214
- 2018Self-Attention with Relative Position Representationscited by 1,120
- 2019VL-BERT: Pre-training of Generic Visual-Linguistic Representationscited by 954
- 2017Revisiting Unreasonable Effectiveness of Data in Deep Learning Eracited by 919
- 2017Remote Sensing Image Scene Classification: Benchmark and State of the Artcited by 797
- 2022Automatic Chain of Thought Prompting in Large Language Modelscited by 688
- 2023Instruction Tuning with GPT-4cited by 686
- 2021SimVLM: Simple Visual Language Model Pretraining with Weak Supervisioncited by 647
- 2024DeepSeek LLM: Scaling Open-Source Language Models with Longtermismcited by 642
- 2023MiniGPT-v2: large language model as a unified interface for vision-language multi-task learningcited by 625
- 2017DOTA: A Large-scale Dataset for Object Detection in Aerial Imagescited by 623
- 2021CLIPort: What and Where Pathways for Robotic Manipulationcited by 622
50 most cited of 151 All 151 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.