mlsanityData to 14 Oct 2026

GeoAlignCLIP: Enhancing Fine-Grained Vision-Language Alignment in Remote Sensing via Multi-Granular Consistency Learning

arXiv 2603.09566 ↗First posted 10 Mar 2026cs.CVcited by 2

On the map: Multimodal LLMs / vision-language models → Embodied and 3D vision-language models

Abstract (arXiv)

Vision-language pretraining models have made significant progress in bridging remote sensing imagery with natural language. However, existing approaches often fail to effectively integrate multi-granular visual and textual information, relying primarily on global image-text alignment. This limitation hinders the model's ability to accurately capture fine-grained details in images, thus restricting its performance in complex, fine-grained tasks. To address this, we propose GeoAlignCLIP, a unified framework that achieves fine-grained alignment in remote sensing tasks by learning multi-granular semantic alignments and incorporating intra-modal consistency, enabling more precise visual-semantic alignment between image regions and text concepts. Additionally, we construct RSFG-100k, a fine-granular remote sensing dataset containing scene descriptions, region-level annotations, and challenging hard-negative samples, providing hierarchical supervision for model training. Extensive experiments conducted on multiple public remote-sensing benchmarks demonstrate that GeoAlignCLIP consistently outperforms existing RS-specific methods across diverse tasks, exhibiting more robust and accurate fine-grained vision-language alignment.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Embodied and 3D vision-language models, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 39 of its 45 references that are in the map. First posted on arXiv 10 Mar 2026.

Builds on

39 of 45 references.

Closest ancestors · 14

Same direction, newest first

  1. 2025DescribeEarth: Describe Anything for Remote Sensing Images30 Sep
  2. 2025Vision-Language Modeling Meets Remote Sensing: Models, Datasets and Perspectives20 May
  3. 2025GeoPixel: Pixel Grounding Large Multimodal Model in Remote Sensing23 Jan
  4. 2024CHOICE: Benchmarking the Remote Sensing Capabilities of Large Vision-Language Models27 Nov
  5. 2024RSTeller: Scaling Up Visual Language Modeling in Remote Sensing with Rich Linguistic Semantics from Openly Available Data and Large Language Models27 Aug
  6. 2024VRSBench: A Versatile Vision-Language Benchmark Dataset for Remote Sensing Image Understanding18 Jun
  7. 2024SkySenseGPT: A Fine-Grained Instruction Tuning Dataset and Model for Remote Sensing Vision-Language Understanding14 Jun
  8. 2024Towards Vision-Language Geo-Foundation Model: A Survey13 Jun
  9. 2024MGIMM: Multi-Granularity Instruction Multimodal Model for Attribute-Guided Remote Sensing Image Detailed Description7 Jun
  10. 2024VHM: Versatile and Honest Vision Language Model for Remote Sensing Image Analysis29 Mar
  11. 2023SkyScript: A Large and Semantically Diverse Vision-Language Dataset for Remote Sensing20 Dec
  12. 2023GeoChat: Grounded Large Vision-Language Model for Remote Sensing24 Nov
2 more
  1. 2023RS5M and GeoRSCLIP: A Large Scale Vision-Language Dataset and A Large Vision-Language Model for Remote Sensing20 Jun
  2. 2023RemoteCLIP: A Vision Language Foundation Model for Remote Sensing19 Jun

Other references · 25

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,744
  2. 2020Language Models are Few-Shot Learnerscited by 32,419
  3. 2023LLaMA: Open and Efficient Foundation Language Modelscited by 14,132
  4. 2025Qwen3 Technical Reportcited by 8,820
  5. 2023Visual Instruction Tuningcited by 7,869
  6. 2017Mask R-CNNcited by 7,277
  7. 2023Grounding DINO: Marrying DINO with Grounded Pre-Training for Open-Set Object Detectioncited by 3,332
  8. 2021Grounded Language-Image Pre-trainingcited by 1,156
  9. 2021Open-vocabulary Object Detection via Vision and Language Knowledge Distillationcited by 906
  10. 2017DOTA: A Large-scale Dataset for Object Detection in Aerial Imagescited by 623
  11. 2019Object Detection in Optical Remote Sensing Images: A Survey and A New Benchmarkcited by 340
  12. 2024Long-CLIP: Unlocking the Long-Text Capability of CLIPcited by 300
13 more
  1. 2017Exploring Models and Data for Remote Sensing Image Caption Generationcited by 197
  2. 2023GeoCLIP: Clip-Inspired Alignment between Locations and Images for Effective Worldwide Geo-localizationcited by 187
  3. 2022RSVG: Exploring Data and Models for Visual Grounding on Remote Sensing Datacited by 123
  4. 2025FG-CLIP: Fine-Grained Visual and Textual Alignmentcited by 81
  5. 2022Exploring a Fine-Grained Multiscale Method for Cross-Modal Remote Sensing Image Retrievalcited by 77
  6. 2023Rotated Multi-Scale Interaction Network for Referring Remote Sensing Image Segmentationcited by 76
  7. 2023A Survey on Open-Vocabulary Detection and Segmentation: Past, Present, and Futurecited by 61
  8. 2023Cross-Modal Retrieval: A Systematic Review of Methods and Future Directionscited by 40
  9. 2024Visual-Text Cross Alignment: Refining the Similarity Score in Vision-Language Modelscited by 30
  10. 2023Toward Open Vocabulary Aerial Object Detection with CLIP-Activated Student-Teacher Learningcited by 22
  11. 2024Interpreting and Analysing CLIP's Zero-Shot Image Classification via Mutual Knowledgecited by 12
  12. 2025CADFormer: Fine-Grained Cross-modal Alignment and Decoding Transformer for Referring Remote Sensing Image Segmentationcited by 9
  13. 2025From Local Details to Global Context: Advancing Vision-Language Models with Attention-Based Selectioncited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025DGTRSD & DGTRS-CLIP: A Dual-Granularity Remote Sensing Image-Text Dataset and Vision Language Foundation Model for Alignment
  2. 2025FarSLIP: Discovering Effective CLIP Adaptation for Fine-Grained Remote Sensing Understanding
  3. 2025RAH-VLA: Resolution-Adaptive Hierarchical Vision-Language Alignment for Multimodal Remote Sensing Understanding
  4. 2026SkyNative: A Native Multimodal Architecture for Remote Sensing Vision-Language Understanding
  5. 2024SkyEyeGPT: Unifying Remote Sensing Vision-Language Tasks via Instruction Tuning with Large Language Model
  6. 2026Earth-OneVision: Extending Remote Sensing Multimodal Large Language Models to More Sensor Modalities and Tasks
  7. 2026GeoMeld: Toward Semantically Grounded Foundation Models for Remote Sensing
  8. 2024Mind the Modality Gap: Towards a Remote Sensing Vision-Language Model via Cross-modal Alignment