Taxonomy-aware deep learning for hierarchical marine species classification in underwater imagery
Not on the map. Why?
Abstract (arXiv)
Automated classification of marine species from underwater imagery is essential for scalable ocean biodiversity monitoring and conservation policy. Existing approaches struggle with severe domain shift across collection platforms, fine-grained visual similarity between closely related species, and uneven annotation granularity, where many specimens can only be identified to genus or a coarser taxonomic rank. We present a taxonomy-aware deep learning framework that aligns both the training loss and the inference rule with the hierarchical structure of biological classification, combining a taxonomy-weighted loss, minimum-risk Bayesian inference, multi-scale feature encoding, and independent per-rank classification heads. Evaluated on the FathomNet 2025 dataset1 (79 marine classes across seven taxonomic ranks), the system achieves a mean taxonomic distance of 1.581, within 3% of the 1st-place solution (1.535), with the largest gains from metric-aligned inference and simple, decoupled components that generalize better than learned dependencies under distribution shift.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 12 of its 20 references that are in the map. First posted on arXiv 24 Jun 2026.
Builds on
12 of 20 references.
References · 12
- 2023DINOv2: Learning Robust Visual Features without Supervisioncited by 7,974
- 2017On Calibration of Modern Neural Networkscited by 4,960
- 2019When Does Label Smoothing Help?cited by 988
- 2023ConvNeXt V2: Co-designing and Scaling ConvNets with Masked Autoencoderscited by 712
- 2019Making Better Mistakes: Leveraging Class Hierarchies with Deep Networkscited by 113
- 2022Three things everyone should know about Vision Transformerscited by 90
- 2020Coherent Hierarchical Multi-Label Classification Networkscited by 65
- 2017B-CNN: Branch Convolutional Neural Network for Hierarchical Classificationcited by 37
- 2021FathomNet: A global image database for enabling artificial intelligence in the oceancited by 25
- 2024SAFT: Towards Out-of-Distribution Generalization in Fine-Tuningcited by 12
- 2021Semi-Supervised Learning with Taxonomic Labelscited by 11
- 2026MATANet: A Multi-context Attention and Taxonomy-Aware Network for Fine-Grained Underwater Recognition of Marine Speciescited by 1
Built on by
Not cited yet.