mlsanityData to 7 Oct 2026

Masks Can Talk: Extracting Structured Text Information from Single-Modal Images for Remote Sensing Change Detection

arXiv 2605.07178 ↗First posted 8 May 2026cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Remote sensing change detection is pivotal for urban monitoring, disaster assessment, and environmental resource management. Yet, unimodal deep learning methods frequently confuse genuine semantic changes with visually similar but irrelevant variations. Recent multimodal approaches incorporate text as auxiliary supervision, but their descriptions are either semantically coarse and unstructured or model-generated and thus noisy. Critically, all of them overlook a simple fact: fine-grained change semantics are already implicitly encoded in the ground-truth mask labels that come standard with every change detection dataset. These masks know where the change happened, what the land-cover types were before and after, how the transition occurred, and how many objects were involved. In this paper, we propose S2M, a framework that obtains structured textual features directly from change labels at zero additional annotation cost. Specifically, each change region is automatically transcribed into a semantic quadruple (where, what, how, how many) and converted into several fixed-template text descriptions, providing precise, dense, and noise-free multimodal supervision. We adopts a two-stage training strategy to fine-tune on remote sensing imagery firstly for robust domain-specific representation, after which a multimodal decoder with a bi-directional contrastive loss is introduced to achieve deep alignment between visual features and structured textual embeddings. To validate our method, we construct Gaza-Change-v2, a new multi-class change detection (MCD) dataset about the Gaza Strip. On this MCD dataset, S2M achieves a Sek of 17.80% and an Fscd of 66.14%, notably surpassing even multimodal methods that leverage large language models. Our work demonstrates that masks can indeed talk. They tell us exactly what, where, how, and how many changes have occurred.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 24 of its 38 references that are in the map. First posted on arXiv 8 May 2026.

Builds on

24 of 38 references.

References · 24

  1. 2017Attention Is All You Needcited by 59,932
  2. 2021Learning Transferable Visual Models From Natural Language Supervisioncited by 33,456
  3. 2021Swin Transformer: Hierarchical Vision Transformer using Shifted Windowscited by 12,082
  4. 2023Visual Instruction Tuningcited by 7,792
  5. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  6. 2019Momentum Contrast for Unsupervised Visual Representation Learningcited by 7,482
  7. 2023InstructBLIP: Towards General-purpose Vision-Language Models with Instruction Tuningcited by 2,855
  8. 2023MiniGPT-4: Enhancing Vision-Language Understanding with Advanced Large Language Modelscited by 2,689
  9. 2016V-Net: Fully Convolutional Neural Networks for Volumetric Medical Image Segmentationcited by 2,284
  10. 2018Fully Convolutional Siamese Networks for Change Detectioncited by 305
  11. 2021Remote Sensing Image Change Detection with Transformerscited by 305
  12. 2022A Transformer-Based Siamese Network for Change Detectioncited by 243
12 more
  1. 2024ChangeMamba: Remote Sensing Change Detection With Spatiotemporal State Space Modelcited by 118
  2. 2019Building Change Detection for Remote Sensing Images Using a Dual Task Constrained Deep Siamese Convolutional Network Modelcited by 84
  3. 2024CDMamba: Incorporating Local Clues into Mamba for Remote Sensing Image Binary Change Detectioncited by 48
  4. 2021Bi-Temporal Semantic Reasoning for the Semantic Change Detection in HR Remote Sensing Imagescited by 43
  5. 2024RSCaMa: Remote Sensing Image Change Captioning with State Space Modelcited by 35
  6. 2025Semantic-CD: Remote Sensing Image Semantic Change Detection towards Open-vocabulary Settingcited by 14
  7. 2025UniChange: Unifying Change Detection with Multimodal Large Language Modelcited by 8
  8. 2023STNet: Spatial and Temporal feature fusion network for change detection in remote sensing imagescited by 6
  9. 2024DDLNet: Boosting Remote Sensing Change Detection with Dual-Domain Learningcited by 6
  10. 2024CDXLSTM: Boosting Remote Sensing Change Detection with Extended Long Short-Term Memorycited by 4
  11. 2025Changes in Gaza: DINOv3-Powered Multi-Class Change Detection for Damage Assessment in Conflict Zonescited by 2
  12. 2025Multimodal Feature Fusion Network with Text Difference Enhancement for Remote Sensing Change Detectioncited by 1

Built on by

Not cited yet.