mlsanityData to 14 Oct 2026

BenthicDINO: Physics-Informed Self-Distillation for View-Invariant Side-Scan Sonar Representations

arXiv 2608.23215 ↗First posted 24 Aug 2026cs.CV cs.AI cs.LGcited by 0

On the map: Knowledge distillation → Detection and dense prediction distillation

Abstract (arXiv)

Automated perception in side-scan sonar (SSS) imagery is severely hindered by physical acoustic artifacts, resulting in representations that inextricably mix intrinsic seabed reflectivity with transient viewing geometries. Existing self-supervised learning (SSL) frameworks rely on augmentations designed for natural images, failing to account for acoustic degradation and explicitly enforce view-invariance. To address this gap, we introduce a physics-informed self-distillation framework built upon the DINOv3 architecture utilizing a ConvNeXt-v2-Tiny backbone to maximize data efficiency. The proposed methodology enforces view-invariance through two primary mechanisms: physically motivated augmentations that simulate speckle noise, range-dependent attenuation, and radiometric miscalibration; and a Hilbert-Schmidt Independence Criterion (HSIC) penalty that explicitly decouples learned dense patch features from physical viewing parameters. Furthermore, we propose a dense, hierarchical feature fusion strategy across all four network stages to preserve fine-grained sediment details alongside deep semantic abstractions. Extensive evaluation demonstrates that the framework natively groups complex benthic topographies into stable, noise-free semantic clusters without relying on manual annotations. During supervised downstream tasks on the S3Seg dataset, the fused representations exhibited exceptional data efficiency, achieving 96% of its absolute peak performance using only 10% of the available annotated data, ultimately reaching a mean Intersection over Union (mIoU) of 71.4% and an overall accuracy of 86.5%.

Key facts. No citing papers in the map yet (data through 14 Oct 2026). Placed in Detection and dense prediction distillation, one of 12 directions in Knowledge distillation. Builds on 23 of its 41 references that are in the map. First posted on arXiv 24 Aug 2026.

Builds on

23 of 41 references.

References · 23

  1. 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
  2. 2021Emerging Properties in Self-Supervised Vision Transformerscited by 6,968
  3. 2022A ConvNet for the 2020scited by 3,579
  4. 2018UMAP: Uniform Manifold Approximation and Projection for Dimension Reductioncited by 2,898
  5. 2025DINOv3cited by 1,414
  6. 2023ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoderscited by 712
  7. 2021Understanding Dimensional Collapse in Contrastive Self-supervised Learningcited by 378
  8. 2018Estimating the intrinsic dimension of datasets by a minimal neighborhood informationcited by 250
  9. 2021Self-Supervised Learning with Kernel Dependence Maximizationcited by 77
  10. 2024Machine Learning for Shipwreck Segmentation from Side Scan Sonar Imagery: Dataset and Benchmarkcited by 13
  11. 2022Self-supervised Learning for Sonar Image Classificationcited by 12
  12. 2023A Convolutional Vision Transformer for Semantic Segmentation of Side-Scan Sonar Datacited by 7
11 more
  1. 2025BenthiCat: An opti-acoustic dataset for advancing benthic classification and habitat mappingcited by 5
  2. 2021Pre-trained Models for Sonar Imagescited by 4
  3. 2024S3Simulator: A benchmarking Side Scan Sonar Simulator dataset for Underwater Image Analysiscited by 4
  4. 2021Image-to-Height Domain Translation for Synthetic Aperture Sonarcited by 3
  5. 2023Self-Supervised Learning for Improved Synthetic Aperture Sonar Target Recognitioncited by 2
  6. 2025PhysDNet: Physics-Guided Decomposition Network of Side-Scan Sonar Imagerycited by 2
  7. 2023Advances in Self-Supervised Learning for Synthetic Aperture Sonar Data Processing, Classification, and Pattern Recognitioncited by 1
  8. 2024On Vision Transformers for Classification Tasks in Side-Scan Sonar Imagerycited by 1
  9. 2025Self-Supervised Enhancement of Forward-Looking Sonar Images: Bridging Cross-Modal Degradation Gaps through Feature Space Transformation and Multi-Frame Fusioncited by 1
  10. 2026Mine-JEPA: In-Domain Self-Supervised Learning for Mine-Like Object Classification in Side-Scan Sonarcited by 1
  11. 2026Physics-informed simulation framework for realistic sonar image generation and statistical validationcited by 1

Built on by

Not cited yet.

Similar, not cited

Close in wording, no citation either way

  1. 2025Self-Supervised Compression and Artifact Correction for Streaming Underwater Imaging Sonar
  2. 2026BenthicFlow: Generating Extensible Underwater Environments via Flow Matching
  3. 2024Composing Open-domain Vision with RAG for Ocean Monitoring and Conservation
  4. 2026SonarLLM: A Native Sonar--Optical Multimodal Large Language Model for Underwater Perception
  5. 2026ShellfishNet: A Domain-Specific Benchmark for Visual Recognition of Marine Molluscs
  6. 2025Supervised Contrastive Machine Unlearning of Background Bias in Sonar Image Classification with Fine-Grained Explainable AI
  7. 2026AquaStereo: Enabling Underwater Stereo Matching via Depth-Conditioned Diffusion and Geometry Self-Distillation
  8. 2024Knowledge Distillation in YOLOX-ViT for Side-Scan Sonar Object Detection