SARLANG-1M: A Benchmark for Vision-Language Modeling in SAR Image Understanding
On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models
Abstract (arXiv)
Synthetic Aperture Radar (SAR) is a crucial remote sensing technology, enabling all-weather, day-and-night observation with strong surface penetration for precise and continuous environmental monitoring and analysis. However, SAR image interpretation remains challenging due to its complex physical imaging mechanisms and significant visual disparities from human perception. Recently, Vision-Language Models (VLMs) have demonstrated remarkable success in RGB image understanding, offering powerful open-vocabulary interpretation and flexible language interaction. However, their application to SAR images is severely constrained by the absence of SAR-specific knowledge in their training distributions, leading to suboptimal performance. To address this limitation, we introduce SARLANG-1M, a large-scale benchmark tailored for multimodal SAR image understanding, with a primary focus on integrating SAR with textual modality. SARLANG-1M comprises more than 1 million high-quality SAR image-text pairs collected from over 59 cities worldwide. It features hierarchical resolutions (ranging from 0.1 to 25 meters), fine-grained semantic descriptions (including both concise and detailed captions), diverse remote sensing categories (1,696 object types and 16 land cover classes), and multi-task question-answering pairs spanning seven applications and 1,012 question types. Extensive experiments on mainstream VLMs demonstrate that fine-tuning with SARLANG-1M significantly enhances their performance in SAR image interpretation, reaching performance comparable to human experts. The dataset and code will be made publicly available at https://github.com/Jimmyxichen/SARLANG-1M.
Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 57 of its 127 references that are in the map. First posted on arXiv 4 Apr 2025.
Builds on
57 of 127 references.
Closest ancestors · 5
Same direction, newest first
- 2024VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understanding18 Jun
- 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensing24 Nov
- 2023RSGPT: A Remote Sensing Vision Language Model and Benchmark28 Jul
- 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensing19 Jun
- 2023Vision-Language Models in Remote Sensing: Current Progress and Future Trends9 May
Other references · 52
- 2017Attention Is All You Needcited by 60,361
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
- 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2023GPT-4 Technical Reportcited by 18,396
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
- 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
38 more
- 2023Visual Instruction Tuningcited by 7,869
- 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
- 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
- 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
- 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
- 2014Going Deeper with Convolutionscited by 4,241
- 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
- 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
- 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
- 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
- 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
- 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,656
- 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
- 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
- 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
- 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,216
- 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,135
- 2015Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Bookscited by 1,043
- 2023EVA-CLIP: Improved Training Techniques for CLIP at Scalecited by 798
- 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 733
- 2021FLAVA: A Foundational Language And Vision Alignment Modelcited by 649
- 2024Mini-Gemini: Mining the Potential of Multi-modality Vision Language Modelscited by 365
- 2015Skip-Thought Vectorscited by 322
- 2020RSVQA: Visual Question Answering for Remote Sensing Datacited by 203
- 2017Exploring Models and Data for Remote Sensing Image Caption Generationcited by 197
- 2024LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuningcited by 89
- 2022OpenEarthMap: A Benchmark Dataset for Global High-Resolution Land Cover Mappingcited by 82
- 2022Exploring a Fine-Grained Multiscale Method for Cross-Modal Remote Sensing Image Retrievalcited by 77
- 2024Foundation Models for Remote Sensing and Earth Observation: A Surveycited by 70
- 2021MMBERT: Multimodal BERT Pretraining for Improved Medical VQAcited by 68
- 2022Masked Vision and Language Modeling for Multi-modal Representation Learningcited by 67
- 2020RealFormer: Transformer Likes Residual Attentioncited by 62
- 2024SARDet-100K: Towards Open-Source Benchmark and ToolKit for Large-Scale SAR Object Detectioncited by 48
- 2020SpaceNet 6: Multi-Sensor All Weather Mapping Datasetcited by 47
- 2023CLAIR: Evaluating Image Captions with Large Language Modelscited by 43
- 2025BRIGHT: A globally distributed multimodal building damage assessment dataset with very-high-resolution for all-weather disaster responsecited by 41
- 2025OpenEarthMap-SAR: A Benchmark Synthetic Aperture Radar Dataset for Global High-Resolution Land Cover Mappingcited by 13
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2025: 4; 2026: 12.
16 papers.
Sort:
By area:
- 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Modelscited by 90
- 2025Asking like Socrates: Socrates helps VLMs understand remote sensing imagescited by 6
- 2026GeoMMBench and GeoMMAgent: Toward Expert-Level Multimodal Intelligence in Geoscience and Remote Sensingcited by 6
- 2026MM-OVSeg:Multimodal Optical-SAR Fusion for Open-Vocabulary Segmentation in Remote Sensingcited by 4
- 2026Earth-OneVision: Extending Remote Sensing Multimodal Large Language Models to More Sensor Modalities and Taskscited by 4
- 2025FUSAR-KLIP: Towards Multimodal Foundation Models for Remote Sensingcited by 3
- 2026OmniEarth: A Benchmark for Evaluating Vision-Language Models in Geospatial Taskscited by 3
- 2025SARVLM: A Vision Language Foundation Model for Semantic Understanding in SAR Imagerycited by 1
- 2026FUSAR-GPT : A Spatiotemporal Feature-Embedded and Two-Stage Decoupled Visual Language Model for SAR Imagerycited by 1
- 2026Unifying Heterogeneous Multi-Modal Remote Sensing Detection Via Language-Pivoted Pretrainingcited by 1
- 2026Geospatial-Temporal Sensemaking of Remote Sensing Activity Detections with Multimodal Large Language Modelcited by 1
- 2026Continual Vision-Language Learning for Remote Sensing: Benchmarking and Analysiscited by 0
4 more
- 2026Unlocking Optical Prior: Spectrum-Guided Knowledge Transfer for SAR Generalized Category Discoverycited by 0
- 2026Sentinel2Cap: A Human-Annotated Benchmark Dataset for Multimodal Remote Sensing Image Captioningcited by 0
- 2026More with Less: a Large Scale Remote Sensing VLM with a Simple Recipecited by 0
- 2026FUSAR-R1: A Large-Scale Reasoning Model for Intelligent Interpretation of SAR Imagescited by 0
- 2026FUSAR-R1: A Large-Scale Reasoning Model for Intelligent Interpretation of SAR Images18 Jul 2026
- 2026More with Less: a Large Scale Remote Sensing VLM with a Simple Recipe17 Jul 2026
- 2026Earth-OneVision: Extending Remote Sensing Multimodal Large Language Models to More Sensor Modalities and Tasks9 Jun 2026
- 2026Geospatial-Temporal Sensemaking of Remote Sensing Activity Detections with Multimodal Large Language Model11 May 2026
- 2026Sentinel2Cap: A Human-Annotated Benchmark Dataset for Multimodal Remote Sensing Image Captioning4 May 2026
- 2026Unlocking Optical Prior: Spectrum-Guided Knowledge Transfer for SAR Generalized Category Discovery24 Apr 2026
- 2026GeoMMBench and GeoMMAgent: Toward Expert-Level Multimodal Intelligence in Geoscience and Remote Sensing10 Apr 2026
- 2026Continual Vision-Language Learning for Remote Sensing: Benchmarking and Analysis1 Apr 2026
- 2026MM-OVSeg:Multimodal Optical-SAR Fusion for Open-Vocabulary Segmentation in Remote Sensing18 Mar 2026
- 2026OmniEarth: A Benchmark for Evaluating Vision-Language Models in Geospatial Tasks10 Mar 2026
- 2026Unifying Heterogeneous Multi-Modal Remote Sensing Detection Via Language-Pivoted Pretraining2 Mar 2026
- 2026FUSAR-GPT : A Spatiotemporal Feature-Embedded and Two-Stage Decoupled Visual Language Model for SAR Imagery22 Feb 2026
4 more
- 2025Asking like Socrates: Socrates helps VLMs understand remote sensing images27 Nov 2025
- 2025SARVLM: A Vision Language Foundation Model for Semantic Understanding in SAR Imagery26 Oct 2025
- 2025FUSAR-KLIP: Towards Multimodal Foundation Models for Remote Sensing28 Sep 2025
- 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Models8 May 2025
- 2026GeoMMBench and GeoMMAgent: Toward Expert-Level Multimodal Intelligence in Geoscience and Remote Sensingcited by 6
- 2025FUSAR-KLIP: Towards Multimodal Foundation Models for Remote Sensingcited by 3
- 2025SARVLM: A Vision Language Foundation Model for Semantic Understanding in SAR Imagerycited by 1
- 2026Geospatial-Temporal Sensemaking of Remote Sensing Activity Detections with Multimodal Large Language Modelcited by 1
- 2026Continual Vision-Language Learning for Remote Sensing: Benchmarking and Analysiscited by 0
- 2026More with Less: a Large Scale Remote Sensing VLM with a Simple Recipecited by 0
- 2026More with Less: a Large Scale Remote Sensing VLM with a Simple Recipe17 Jul 2026
- 2026Geospatial-Temporal Sensemaking of Remote Sensing Activity Detections with Multimodal Large Language Model11 May 2026
- 2026GeoMMBench and GeoMMAgent: Toward Expert-Level Multimodal Intelligence in Geoscience and Remote Sensing10 Apr 2026
- 2026Continual Vision-Language Learning for Remote Sensing: Benchmarking and Analysis1 Apr 2026
- 2025SARVLM: A Vision Language Foundation Model for Semantic Understanding in SAR Imagery26 Oct 2025
- 2025FUSAR-KLIP: Towards Multimodal Foundation Models for Remote Sensing28 Sep 2025
- 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Modelscited by 90
- 2025Asking like Socrates: Socrates helps VLMs understand remote sensing imagescited by 6
- 2026Earth-OneVision: Extending Remote Sensing Multimodal Large Language Models to More Sensor Modalities and Taskscited by 4
- 2026OmniEarth: A Benchmark for Evaluating Vision-Language Models in Geospatial Taskscited by 3
- 2026Earth-OneVision: Extending Remote Sensing Multimodal Large Language Models to More Sensor Modalities and Tasks9 Jun 2026
- 2026OmniEarth: A Benchmark for Evaluating Vision-Language Models in Geospatial Tasks10 Mar 2026
- 2025Asking like Socrates: Socrates helps VLMs understand remote sensing images27 Nov 2025
- 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Models8 May 2025
- 2026MM-OVSeg:Multimodal Optical-SAR Fusion for Open-Vocabulary Segmentation in Remote Sensingcited by 4
- 2026FUSAR-GPT : A Spatiotemporal Feature-Embedded and Two-Stage Decoupled Visual Language Model for SAR Imagerycited by 1
- 2026Unifying Heterogeneous Multi-Modal Remote Sensing Detection Via Language-Pivoted Pretrainingcited by 1
- 2026Unlocking Optical Prior: Spectrum-Guided Knowledge Transfer for SAR Generalized Category Discoverycited by 0
- 2026Sentinel2Cap: A Human-Annotated Benchmark Dataset for Multimodal Remote Sensing Image Captioningcited by 0
- 2026FUSAR-R1: A Large-Scale Reasoning Model for Intelligent Interpretation of SAR Imagescited by 0
- 2026FUSAR-R1: A Large-Scale Reasoning Model for Intelligent Interpretation of SAR Images18 Jul 2026
- 2026Sentinel2Cap: A Human-Annotated Benchmark Dataset for Multimodal Remote Sensing Image Captioning4 May 2026
- 2026Unlocking Optical Prior: Spectrum-Guided Knowledge Transfer for SAR Generalized Category Discovery24 Apr 2026
- 2026MM-OVSeg:Multimodal Optical-SAR Fusion for Open-Vocabulary Segmentation in Remote Sensing18 Mar 2026
- 2026Unifying Heterogeneous Multi-Modal Remote Sensing Detection Via Language-Pivoted Pretraining2 Mar 2026
- 2026FUSAR-GPT : A Spatiotemporal Feature-Embedded and Two-Stage Decoupled Visual Language Model for SAR Imagery22 Feb 2026
Similar, not cited
Close in wording, no citation either way
- 2025SARChat-Bench-2M: A Multi-Task Vision-Language Benchmark for SAR Image Interpretation
- 2025SAR-TEXT: A Large-Scale SAR Image-Text Dataset Built with SAR-Narrator and A Progressive Learning Strategy for Downstream Tasks
- 2026Lightweight Adaptation of General-Purpose VLMs for Multispectral and SAR Image Understanding
- 2026CrossEarth-SAR: A SAR-Centric and Billion-Scale Geospatial Foundation Model for Domain Generalizable Semantic Segmentation
- 2026RRS-10K: A Multitask Vision-Language Model Benchmark for Rare Remote Sensing Image Interpretation
- 2026Multimodal Large Language Models for Remote Sensing Image Understanding: Domain-Specific or General-Purpose?
- 2024From Pixels to Prose: Advancing Multi-Modal Language Models for Remote Sensing
- 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domain