mlsanityData to 14 Oct 2026

SARLANG-1M: A Benchmark for Vision-Language Modeling in SAR Image Understanding

arXiv 2504.03254 ↗First posted 4 Apr 2025cs.CVcited by 16

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

Synthetic Aperture Radar (SAR) is a crucial remote sensing technology, enabling all-weather, day-and-night observation with strong surface penetration for precise and continuous environmental monitoring and analysis. However, SAR image interpretation remains challenging due to its complex physical imaging mechanisms and significant visual disparities from human perception. Recently, Vision-Language Models (VLMs) have demonstrated remarkable success in RGB image understanding, offering powerful open-vocabulary interpretation and flexible language interaction. However, their application to SAR images is severely constrained by the absence of SAR-specific knowledge in their training distributions, leading to suboptimal performance. To address this limitation, we introduce SARLANG-1M, a large-scale benchmark tailored for multimodal SAR image understanding, with a primary focus on integrating SAR with textual modality. SARLANG-1M comprises more than 1 million high-quality SAR image-text pairs collected from over 59 cities worldwide. It features hierarchical resolutions (ranging from 0.1 to 25 meters), fine-grained semantic descriptions (including both concise and detailed captions), diverse remote sensing categories (1,696 object types and 16 land cover classes), and multi-task question-answering pairs spanning seven applications and 1,012 question types. Extensive experiments on mainstream VLMs demonstrate that fine-tuning with SARLANG-1M significantly enhances their performance in SAR image interpretation, reaching performance comparable to human experts. The dataset and code will be made publicly available at https://github.com/Jimmyxichen/SARLANG-1M.

Key facts. Cited by 16 papers in the map (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 57 of its 127 references that are in the map. First posted on arXiv 4 Apr 2025.

Builds on

57 of 127 references.

Closest ancestors · 5

Same direction, newest first

  1. 2024VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understanding18 Jun
  2. 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensing24 Nov
  3. 2023RSGPT: A Remote Sensing Vision Language Model and Benchmark28 Jul
  4. 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensing19 Jun
  5. 2023Vision-Language Models in Remote Sensing: Current Progress and Future Trends9 May

Other references · 52

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  4. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  5. 2020Denoising Diffusion Probabilistic Modelscited by 21,076
  6. 2023GPT-4 Technical Reportcited by 18,396
  7. 2014Microsoft COCO: Common Objects in Contextcited by 17,608
  8. 2014Very Deep Convolutional Networks for Large-Scale Image Recognitioncited by 15,364
  9. 2024The Llama 3 Herd of Modelscited by 14,715
  10. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
  11. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,139
  12. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,170
38 more
  1. 2023Visual Instruction Tuningcited by 7,869
  2. 2016Grad-CAM: Visual Explanations from Deep Networks via Gradient-based Localizationcited by 6,733
  3. 2023BLIP-2: Bootstrapping Language-Image Pre-training with Frozen Image Encoders and Large Language Modelscited by 6,137
  4. 2015You Only Look Once: Unified, Real-Time Object Detectioncited by 4,852
  5. 2022BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generationcited by 4,322
  6. 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
  7. 2014Going Deeper with Convolutionscited by 4,241
  8. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  9. 2024Qwen2-VL: Enhancing Vision-Language Model's Perception of the World at Any Resolutioncited by 4,234
  10. 2021The Power of Scale for Parameter-Efficient Prompt Tuningcited by 3,795
  11. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,876
  12. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,711
  13. 2016Visual Genome: Connecting Language and Vision Using Crowdsourced Dense Image Annotationscited by 2,656
  14. 2023InternVL: Scaling up Vision Foundation Models and Aligning for Generic Visual-Linguistic Taskscited by 2,565
  15. 2014CIDEr: Consensus-based Image Description Evaluationcited by 2,046
  16. 2021LAION-400M: Open Dataset of CLIP-Filtered 400 Million Image-Text Pairscited by 1,555
  17. 2021Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Conceptscited by 1,216
  18. 2021EfficientNetV2: Smaller Models and Faster Trainingcited by 1,135
  19. 2015Aligning Books and Movies: Towards Story-like Visual Explanations by Watching Movies and Reading Bookscited by 1,043
  20. 2023EVA-CLIP: Improved Training Techniques for CLIP at Scalecited by 798
  21. 2024DeepSeek-VL: Towards Real-World Vision-Language Understandingcited by 733
  22. 2021FLAVA: A Foundational Language And Vision Alignment Modelcited by 649
  23. 2024Mini-Gemini: Mining the Potential of Multi-modality Vision Language Modelscited by 365
  24. 2015Skip-Thought Vectorscited by 322
  25. 2020RSVQA: Visual Question Answering for Remote Sensing Datacited by 203
  26. 2017Exploring Models and Data for Remote Sensing Image Caption Generationcited by 197
  27. 2024LISA: Layerwise Importance Sampling for Memory-Efficient Large Language Model Fine-Tuningcited by 89
  28. 2022OpenEarthMap: A Benchmark Dataset for Global High-Resolution Land Cover Mappingcited by 82
  29. 2022Exploring a Fine-Grained Multiscale Method for Cross-Modal Remote Sensing Image Retrievalcited by 77
  30. 2024Foundation Models for Remote Sensing and Earth Observation: A Surveycited by 70
  31. 2021MMBERT: Multimodal BERT Pretraining for Improved Medical VQAcited by 68
  32. 2022Masked Vision and Language Modeling for Multi-modal Representation Learningcited by 67
  33. 2020RealFormer: Transformer Likes Residual Attentioncited by 62
  34. 2024SARDet-100K: Towards Open-Source Benchmark and ToolKit for Large-Scale SAR Object Detectioncited by 48
  35. 2020SpaceNet 6: Multi-Sensor All Weather Mapping Datasetcited by 47
  36. 2023CLAIR: Evaluating Image Captions with Large Language Modelscited by 43
  37. 2025BRIGHT: A globally distributed multimodal building damage assessment dataset with very-high-resolution for all-weather disaster responsecited by 41
  38. 2025OpenEarthMap-SAR: A Benchmark Synthetic Aperture Radar Dataset for Global High-Resolution Land Cover Mappingcited by 13

50 most cited of 52 All 52 (JSON)

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 4; 2026: 12.

16 papers.

Sort:

By area:

  1. 2025Perception, Reason, Think, and Plan: A Survey on Large Multimodal Reasoning Modelscited by 90
  2. 2025Asking like Socrates: Socrates helps VLMs understand remote sensing imagescited by 6
  3. 2026GeoMMBench and GeoMMAgent: Toward Expert-Level Multimodal Intelligence in Geoscience and Remote Sensingcited by 6
  4. 2026MM-OVSeg:Multimodal Optical-SAR Fusion for Open-Vocabulary Segmentation in Remote Sensingcited by 4
  5. 2026Earth-OneVision: Extending Remote Sensing Multimodal Large Language Models to More Sensor Modalities and Taskscited by 4
  6. 2025FUSAR-KLIP: Towards Multimodal Foundation Models for Remote Sensingcited by 3
  7. 2026OmniEarth: A Benchmark for Evaluating Vision-Language Models in Geospatial Taskscited by 3
  8. 2025SARVLM: A Vision Language Foundation Model for Semantic Understanding in SAR Imagerycited by 1
  9. 2026FUSAR-GPT : A Spatiotemporal Feature-Embedded and Two-Stage Decoupled Visual Language Model for SAR Imagerycited by 1
  10. 2026Unifying Heterogeneous Multi-Modal Remote Sensing Detection Via Language-Pivoted Pretrainingcited by 1
  11. 2026Geospatial-Temporal Sensemaking of Remote Sensing Activity Detections with Multimodal Large Language Modelcited by 1
  12. 2026Continual Vision-Language Learning for Remote Sensing: Benchmarking and Analysiscited by 0
4 more
  1. 2026Unlocking Optical Prior: Spectrum-Guided Knowledge Transfer for SAR Generalized Category Discoverycited by 0
  2. 2026Sentinel2Cap: A Human-Annotated Benchmark Dataset for Multimodal Remote Sensing Image Captioningcited by 0
  3. 2026More with Less: a Large Scale Remote Sensing VLM with a Simple Recipecited by 0
  4. 2026FUSAR-R1: A Large-Scale Reasoning Model for Intelligent Interpretation of SAR Imagescited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2025SARChat-Bench-2M: A Multi-Task Vision-Language Benchmark for SAR Image Interpretation
  2. 2025SAR-TEXT: A Large-Scale SAR Image-Text Dataset Built with SAR-Narrator and A Progressive Learning Strategy for Downstream Tasks
  3. 2026Lightweight Adaptation of General-Purpose VLMs for Multispectral and SAR Image Understanding
  4. 2026CrossEarth-SAR: A SAR-Centric and Billion-Scale Geospatial Foundation Model for Domain Generalizable Semantic Segmentation
  5. 2026RRS-10K: A Multitask Vision-Language Model Benchmark for Rare Remote Sensing Image Interpretation
  6. 2026Multimodal Large Language Models for Remote Sensing Image Understanding: Domain-Specific or General-Purpose?
  7. 2024From Pixels to Prose: Advancing Multi-Modal Language Models for Remote Sensing
  8. 2024EarthGPT: A Universal Multi-modal Large Language Model for Multi-sensor Image Comprehension in Remote Sensing Domain