Weakly Supervised Seafloor Segmentation for Seagrass Habitat Mapping in Side-Scan Sonar Imagery
Not on the map. Why?
Abstract (arXiv)
Seagrass meadows are crucial blue-carbon habitats, and mapping their extent is a prerequisite for coastal management and carbon inventory. Optical satellite sensors cover large areas but cannot reach deep or turbid water, whereas side-scan sonar (SSS) images the seabed at high resolution and at any depth. Interpreting SSS, however, still relies on dense manual annotation, which is slow and costly. We address this by adapting a weakly supervised semantic segmentation framework to SSS benthic habitat mapping, so that pixel-level maps are learned from image-level labels alone. The framework couples a ViT-based encoder-decoder with a classification branch, extracts class activation maps, and refines them into pseudo-labels with a dense conditional random field that we tune for the noise and weak boundaries of acoustic imagery. It follows an iterative self-training scheme, together with a sampling strategy to cope with the strong class imbalance of the data. We also study the effect of different loss functions on segmentation quality, finding Lov'asz-Softmax loss the most effective. On a held-out transect, the refined pseudo-labels reached an mIoU of 89.3% against the ground truth, and the segmentation branch, trained without any pixel-level labels, reached 87.6%. Self-supervised pretraining on unlabelled SSS added a further 3% in mean intersection-over-union. Field trials further demonstrate the generalizability of the trained model. These results show that accurate and label-efficient benthic habitat mapping from side-scan sonar is feasible at the scale needed for coast-wide seagrass monitoring.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 32 references that are in the map. First posted on arXiv 25 Aug 2026.
Builds on
12 of 32 references.
References · 12
- 2023Segment Anythingcited by 8,234
- 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
- 2015Learning Deep Features for Discriminative Localizationcited by 2,436
- 2018Learning Pixel-level Semantic Affinity with Image-level Supervision for Weakly Supervised Semantic Segmentationcited by 321
- 2021Efficient Self-supervised Vision Transformers for Representation Learningcited by 149
- 2021FathomNet: A global image database for enabling artificial intelligence in the oceancited by 25
- 2023Weakly-Supervised Semantic Segmentation with Image-Level Labels: from Traditional Models to Foundation Modelscited by 19
- 2024Machine Learning for Shipwreck Segmentation from Side Scan Sonar Imagery: Dataset and Benchmarkcited by 13
- 2023A Convolutional Vision Transformer for Semantic Segmentation of Side-Scan Sonar Datacited by 7
- 2025BenthiCat: An opti-acoustic dataset for advancing benthic classification and habitat mappingcited by 5
- 2022ISIM: Iterative Self-Improved Model for Weakly Supervised Segmentationcited by 2
- 2024Weakly-Supervised Semantic Segmentation of Circular-Scan, Synthetic-Aperture-Sonar Imagerycited by 1
Built on by
Not cited yet.