mlsanityData to 7 Oct 2026

CLOSP: A Unified Semantic Space for SAR, MSI, and Text in Remote Sensing

arXiv 2507.10403 ↗First posted 14 Jul 2025cs.CV cs.CL cs.IRcited by 0

Not on the map. Why?

Abstract (arXiv)

Retrieving relevant imagery from vast satellite archives is crucial for applications like disaster response and long-term climate monitoring. However, most text-to-image retrieval systems are limited to RGB data, failing to exploit the unique physical information captured by other sensors, such as the all-weather structural sensitivity of Synthetic Aperture Radar (SAR) or the spectral signatures in optical multispectral data. To bridge this gap, we introduce CrisisLandMark, a new large-scale corpus of over 647,000 Sentinel-1 SAR and Sentinel-2 multispectral images paired with structured textual annotations for land cover, land use, and crisis events harmonized from authoritative land cover systems (CORINE and Dynamic World) and crisis-specific sources. We then present CLOSP (Contrastive Language Optical SAR Pretraining), a novel framework that uses text as a bridge to align unpaired optical and SAR images into a unified embedding space. Our experiments show that CLOSP achieves a new state-of-the-art, improving retrieval nDGC@1000 by 54% over existing models. Additionally, we find that the unified training strategy overcomes the inherent difficulty of interpreting SAR imagery by transferring rich semantic knowledge from the optical domain with indirect interaction. Furthermore, GeoCLOSP, which integrates geographic coordinates into our framework, creates a powerful trade-off between generality and specificity: while the CLOSP excels at general semantic tasks, the GeoCLOSP becomes a specialized expert for retrieving location-dependent crisis events and rare geographic features. This work highlights that the integration of diverse sensor data and geographic context is essential for unlocking the full potential of remote sensing archives.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 13 of its 36 references that are in the map. First posted on arXiv 14 Jul 2025.

Builds on

13 of 36 references.

References · 13

  1. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  2. 2019Sentence-BERT: Sentence Embeddings using Siamese BERT-Networkscited by 9,049
  3. 2020Implicit Neural Representations with Periodic Activation Functionscited by 2,214
  4. 2017Exploring Models and Data for Remote Sensing Image Caption Generationcited by 195
  5. 2023SatCLIP: Global, General-Purpose Location Embeddings with Satellite Imagerycited by 148
  6. 2023SkyScript: A Large and Semantically Diverse Vision-Language Dataset for Remote Sensingcited by 123
  7. 2016Time for a change: a tutorial for comparing multiple classifiers through Bayesian analysiscited by 92
  8. 2022Exploring a Fine-Grained Multiscale Method for Cross-Modal Remote Sensing Image Retrievalcited by 77
  9. 2023Geographic Location Encoding with Spherical Harmonics and Sinusoidal Representation Networkscited by 61
  10. 2024reBEN: Refined BigEarthNet Dataset for Remote Sensing Image Analysiscited by 48
  11. 2025Text2Earth: Unlocking Text-driven Remote Sensing Image Generation with a Global-Scale Dataset and a Foundation Modelcited by 46
  12. 2024QuakeSet: A Dataset and Low-Resource Models to Monitor Earthquakes through Sentinel-1cited by 8
1 more
  1. 2025Beyond the Visible: Multispectral Vision-Language Learning for Earth Observationcited by 7

Built on by

Not cited yet.