mlsanityData to 7 Oct 2026

Cross-Architecture Foundation-Model Distillation for Edge Flood Segmentation

arXiv 2609.20441 ↗First posted 17 Sep 2026cs.CV cs.LGcited by 0

Not on the map. Why?

Abstract (arXiv)

Geospatial foundation models can provide strong flood-segmentation performance, but their size limits deployment on memory-constrained edge hardware. We distill a 300-million-parameter Prithvi-EO-2.0 teacher, fine-tuned on the 252 manually labeled Sen1Floods11 training scenes, into a 0.7-million-parameter EfficientViT-B0 student. The teacher supervises additional unlabeled Sentinel-2 imagery, allowing the student training set to grow without new manual annotations. At the matched budget of 252 scenes, teacher-supervised training is competitive with direct training and improves STURM-Flood performance across tested configurations; a geometry-matched control shows that label source alone does not explain the difference. Scaling the teacher-supervised pool to 2,500 scenes narrows the remaining student--teacher gap: the float student reaches 0.787 water intersection over union on the Sen1Floods11 test split against 0.822 for the teacher, matches the teacher on STURM-Flood under our evaluation protocol, and remains below it on WorldFloods-v2. After activation replacement and quantization-aware training, the student runs as a 1.5-megabyte 8-bit integer (INT8) TensorRT engine on a Jetson Xavier NX at 5.57 milliseconds of graphics processing unit (GPU) compute per 512-by-512 image, with approximately 14 megabytes of runtime device memory. A fixed modified normalized difference water index (MNDWI) threshold is competitive with both models on the two clean external benchmarks, so we interpret those benchmarks as generalization tests rather than as evidence of learned-model superiority over a spectral rule. The results support the conclusion: foundation-model supervision can amplify a fixed manual annotation budget into a substantially larger training set and yield a compact, deployable edge model.

Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 36 references that are in the map. First posted on arXiv 17 Sep 2026.

Builds on

18 of 36 references.

References · 18

  1. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,604
  2. 2015Distilling the Knowledge in a Neural Networkcited by 10,076
  3. 2014Fully Convolutional Networks for Semantic Segmentationcited by 4,845
  4. 2019Similarity of Neural Network Representations Revisitedcited by 1,695
  5. 2014FitNets: Hints for Thin Deep Netscited by 1,619
  6. 2016Paying More Attention to Attention: Improving the Performance of Convolutional Neural Networks via Attention Transfercited by 1,059
  7. 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 402
  8. 2014Deeply-Supervised Netscited by 364
  9. 2023SpectralGPT: Spectral Remote Sensing Foundation Modelcited by 250
  10. 2020GLISTER: Generalization based Data Subset Selection for Efficient and Robust Learningcited by 224
  11. 2024Prithvi-EO-2.0: A Versatile Multi-Temporal Foundation Model for Earth Observation Applicationscited by 139
  12. 2023One-for-All: Bridge the Gap Between Heterogeneous Architectures in Knowledge Distillationcited by 77
6 more
  1. 2022Cross-Architecture Knowledge Distillationcited by 40
  2. 2023Assessment of a new GeoAI foundation model for flood inundation mappingcited by 14
  3. 2024Applications of Knowledge Distillation in Remote Sensing: A Surveycited by 8
  4. 2023Cross Modal Distillation for Flood Extent Mappingcited by 6
  5. 2026Flood Mapping from RGB imagery using a Vision Foundation Modelcited by 2
  6. 2025InstaGeo: Compute-Efficient Geospatial Machine Learning from Data to Deploymentcited by 1

Built on by

Not cited yet.