mlsanityData to 14 Oct 2026

Ice-FMBench: A Foundation Model Benchmark for Sea Ice Type Segmentation

arXiv 2503.22516 ↗First posted 28 Mar 2025cs.LG cs.CVcited by 5

Not on the map. Why?

Abstract (arXiv)

Accurate segmentation and mapping of sea ice types is crucial for safe polar navigation, offshore operations, and climate monitoring. While deep learning has demonstrated strong potential for automating sea ice type segmentation, its success often relies on access to extensive expert labeled datasets, which is both resource intensive and time consuming to create. However, foundation models (FMs), recently developed through self-supervised training on large-scale datasets, have demonstrated impressive performance. Nevertheless, their applicability to sea ice type segmentation based on Synthetic Aperture Radar (SAR) imagery remains uncertain due to the unique challenges posed by sea ice such as intricate geophysical patterns, pronounced seasonal variability, and SAR-specific artifacts like banding, scalloping, and heterogeneous backscatter as well as the fact that SAR data in polar regions are often acquired using specialized sensor modes that differ markedly from those used to collect FM training data at lower latitudes, limiting their direct transferability to polar environments. To address this gap, we contribute: (1) IceFMBench, a comprehensive benchmark framework for evaluation of the state-of-the-art remote sensing FMs on the sea ice type segmentation task using Sentinel1 SAR imagery, where IceFMBench is composed of a widely used standardized dataset, diverse evaluation metrics, and a representative set of selected remote sensing FM models suitable for sea ice type segmentation, with the ability to include new models side by side the existing models; (2) an extensive comparative evaluation of the representative FMs using IceFMBench, with additional case studies to assess performance of the top-performing model in terms of transferability across temporal and spatial domains and (3) a multi teacher knowledge distillation approach to address lack of spatiotemporal transferability.

Key facts. Cited by 5 papers in the map (data through 14 Oct 2026). Builds on 35 of its 74 references that are in the map. First posted on arXiv 28 Mar 2025.

Builds on

35 of 74 references.

References · 35

  1. 2020An Image is Worth 16x16 Words: Transformers for Image Recognition at Scalecited by 30,186
  2. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
  3. 2015Distilling the Knowledge in a Neural Networkcited by 10,324
  4. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  5. 2019Parameter-Efficient Transfer Learning for NLPcited by 4,236
  6. 2021On the Opportunities and Risks of Foundation Modelscited by 4,033
  7. 2016DeepLab: Semantic Image Segmentation with Deep Convolutional Nets, Atrous Convolution, and Fully Connected CRFscited by 3,241
  8. 2017Rethinking Atrous Convolution for Semantic Image Segmentationcited by 2,161
  9. 2021BitFit: Simple Parameter-efficient Fine-tuning for Transformer-based Masked Language-modelscited by 1,245
  10. 2021Train Short, Test Long: Attention with Linear Biases Enables Input Length Extrapolationcited by 1,103
  11. 2020Image Segmentation Using Deep Learning: A Surveycited by 660
  12. 2022SatMAE: Pre-training Transformers for Temporal and Multi-Spectral Satellite Imagerycited by 408
23 more
  1. 2023SpectralGPT: Spectral Remote Sensing Foundation Modelcited by 252
  2. 2019BigEarthNet: A Large-Scale Benchmark Archive For Remote Sensing Image Understandingcited by 234
  3. 2021Seasonal Contrast: Unsupervised Pre-Training from Uncurated Remote Sensing Datacited by 215
  4. 2023SkySense: A Multi-Modal Remote Sensing Foundation Model Towards Universal Interpretation for Earth Observation Imagerycited by 205
  5. 2023CROMA: Remote Sensing Representations with Contrastive Radar-Optical Masked Autoencoderscited by 169
  6. 2022SatlasPretrain: A Large-Scale Dataset for Remote Sensing Image Understandingcited by 167
  7. 2022Advancing Plain Vision Transformer Towards Remote Sensing Foundation Modelcited by 149
  8. 2024Prithvi-EO-2.0: A Versatile Multi-Temporal Foundation Model for Earth Observation Applicationscited by 144
  9. 2023GEO-Bench: Toward Foundation Models for Earth Monitoringcited by 124
  10. 2022An Empirical Study of Remote Sensing Pretrainingcited by 105
  11. 2024MMEarth: Exploring Multi-Modal Pretext Tasks For Geospatial Representation Learningcited by 77
  12. 2024Foundation Models for Remote Sensing and Earth Observation: A Surveycited by 70
  13. 2023CSP: Self-Supervised Contrastive Spatial Pre-Training for Geospatial-Visual Representationscited by 69
  14. 2025Towards a Unified Copernicus Foundation Model for Earth Visioncited by 53
  15. 2023CMID: A Unified Self-Supervised Learning Framework for Remote Sensing Image Understandingcited by 48
  16. 2023Feature Guided Masked Autoencoder for Self-supervised Learning in Remote Sensingcited by 48
  17. 2024Cross-Scale MAE: A Tale of Multi-Scale Exploitation in Remote Sensingcited by 47
  18. 2022Self-supervised Vision Transformers for Joint SAR-optical Representation Learningcited by 40
  19. 2023FoMo: Multi-Modal, Multi-Scale and Multi-Task Remote Sensing Foundation Models for Forest Monitoringcited by 31
  20. 2024PhilEO Bench: Evaluating Geo-Spatial Foundation Modelscited by 25
  21. 2023Adaptive Multi-Teacher Knowledge Distillation with Meta-Learningcited by 16
  22. 2023Enhancing sea ice segmentation in Sentinel-1 images with atrous convolutionscited by 7
  23. 2025IceBench: A Benchmark for Deep Learning based Sea Ice Type Classificationcited by 5

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 5.

5 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2026TinyIceNet: Low-Power SAR Sea Ice Segmentation for On-Board FPGA Inference
  2. 2026RoughNet: Mapping Arctic Sea Ice Roughness Using Diffusion-Based Super-Resolution of Satellite Imagery
  3. 2026CrossEarth-SAR: A SAR-Centric and Billion-Scale Geospatial Foundation Model for Domain Generalizable Semantic Segmentation
  4. 2025Seasonal Forecasting of Pan-Arctic Sea Ice with State Space Model
  5. 2024IceDiff: High Resolution and High-Quality Sea Ice Forecasting with Generative Diffusion Prior
  6. 2025SARLANG-1M: A Benchmark for Vision-Language Modeling in SAR Image Understanding
  7. 2023Exploring DINO: Emergent Properties and Limitations for Synthetic Aperture Radar Imagery
  8. 2026Frequency-Enhanced Hilbert Scanning Mamba for Short-Term Arctic Sea Ice Concentration Prediction