mlsanityData to 7 Oct 2026

Benchmarking Attention Mechanisms and Consistency Regularization Semi-Supervised Learning for Post-Flood Building Damage Assessment in Satellite Images

arXiv 2412.03015 ↗First posted 4 Dec 2024cs.CVcited by 0

Not on the map. Why?

Abstract (arXiv)

Post-flood building damage assessment is critical for rapid response and post-disaster reconstruction planning. Current research fails to consider the distinct requirements of disaster assessment (DA) from change detection (CD) in neural network design. This paper focuses on two key differences: 1) building change features in DA satellite images are more subtle than in CD; 2) DA datasets face more severe data scarcity and label imbalance. To address these issues, in terms of model architecture, the research explores the benchmark performance of attention mechanisms in post-flood DA tasks and introduces Simple Prior Attention UNet (SPAUNet) to enhance the model's ability to recognize subtle changes, in terms of semi-supervised learning (SSL) strategies, the paper constructs four different combinations of image-level label category reference distributions for consistent training. Experimental results on flood events of xBD dataset show that SPAUNet performs exceptionally well in supervised learning experiments, achieving a recall of 79.10% and an F1 score of 71.32% for damaged classification, outperforming CD methods. The results indicate the necessity of DA task-oriented model design. SSL experiments demonstrate the positive impact of image-level consistency regularization on the model. Using pseudo-labels to form the reference distribution for consistency training yields the best results, proving the potential of using the category distribution of a large amount of unlabeled data for SSL. This paper clarifies the differences between DA and CD tasks. It preliminarily explores model design strategies utilizing prior attention mechanisms and image-level consistency regularization, establishing new post-flood DA task benchmark methods.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 14 of its 55 references that are in the map. First posted on arXiv 4 Dec 2024.

Builds on

14 of 55 references.

References · 14

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  2. 2017Squeeze-and-Excitation Networkscited by 4,763
  3. 2020FixMatch: Simplifying Semi-Supervised Learning with Consistency and Confidencecited by 2,080
  4. 2016Revisiting Semi-Supervised Learning with Graph Embeddingscited by 970
  5. 2018Fully Convolutional Siamese Networks for Change Detectioncited by 305
  6. 2021Remote Sensing Image Change Detection with Transformerscited by 305
  7. 2022Revisiting Weak-to-Strong Consistency in Semi-Supervised Semantic Segmentationcited by 177
  8. 2018Gather-Excite: Exploiting Feature Context in Convolutional Neural Networkscited by 138
  9. 2019Relation-Aware Global Attention for Person Re-identificationcited by 124
  10. 2020An Overview of Deep Semi-Supervised Learningcited by 121
  11. 2022Changer: Feature Interaction is What You Need for Change Detectioncited by 78
  12. 2017Triple Generative Adversarial Netscited by 59
2 more
  1. 2023Exchange means change: an unsupervised single-temporal change detection framework based on intra- and inter-image patch exchangecited by 20
  2. 2020IAUnet: Global Context-Aware Feature Learning for Person Re-Identificationcited by 10

Built on by

Not cited yet.