mlsanityData to 7 Oct 2026

Rapid Adaptation of Earth Observation Foundation Models for Segmentation

arXiv 2409.09907 ↗First posted 16 Sep 2024cs.CVcited by 3

Not on the map. Why?

Abstract (arXiv)

This study investigates the efficacy of Low-Rank Adaptation (LoRA) in fine-tuning Earth Observation (EO) foundation models for flood segmentation. We hypothesize that LoRA, a parameter-efficient technique, can significantly accelerate the adaptation of large-scale EO models to this critical task while maintaining high performance. We apply LoRA to fine-tune a state-of-the-art EO foundation model pre-trained on diverse satellite imagery, using a curated dataset of flood events. Our results demonstrate that LoRA-based fine-tuning (r-256) improves F1 score by 6.66 points and IoU by 0.11 compared to a frozen encoder baseline, while significantly reducing computational costs. Notably, LoRA outperforms full fine-tuning, which proves computationally infeasible on our hardware. We further assess generalization through out-of-distribution (OOD) testing on a geographically distinct flood event. While LoRA configurations show improved OOD performance over the baseline. This work contributes to research on efficient adaptation of foundation models for specialized EO tasks, with implications for rapid response systems in disaster management. Our findings demonstrate LoRA's potential for enabling faster deployment of accurate flood segmentation models in resource-constrained, time-critical scenarios.

Key facts. Cited by 3 papers in the map (data through 7 Oct 2026). Builds on 12 of its 20 references that are in the map. First posted on arXiv 16 Sep 2024.

Builds on

12 of 20 references.

References · 12

  1. 2017Attention Is All You Needcited by 59,932
  2. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 29,915
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  4. 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,084
  5. 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
  6. 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 402
  7. 2023SpectralGPT: Spectral Remote Sensing Foundation Modelcited by 250
  8. 2023SkySense: A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagerycited by 202
  9. 2024A Survey on LoRA of Large Language Modelscited by 67
  10. 2023SSL4EO-L: Datasets and Foundation Models for Landsat Imagerycited by 49
  11. 2023Large Scale Masked Autoencoding for Reducing Label Requirements on SAR Datacited by 7
  12. 2023Fewshot learning on global multimodal embeddings for earth observation taskscited by 6

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2025: 2; 2026: 1.

3 papers.