Applications of Deep Learning in Fish Habitat Monitoring: A Tutorial and Survey
Not on the map. Why?
Abstract (arXiv)
Marine ecosystems and their fish habitats are becoming increasingly important due to their integral role in providing a valuable food source and conservation outcomes. Due to their remote and difficult to access nature, marine environments and fish habitats are often monitored using underwater cameras. These cameras generate a massive volume of digital data, which cannot be efficiently analysed by current manual processing methods, which involve a human observer. DL is a cutting-edge AI technology that has demonstrated unprecedented performance in analysing visual data. Despite its application to a myriad of domains, its use in underwater fish habitat monitoring remains under explored. In this paper, we provide a tutorial that covers the key concepts of DL, which help the reader grasp a high-level understanding of how DL works. The tutorial also explains a step-by-step procedure on how DL algorithms should be developed for challenging applications such as underwater fish monitoring. In addition, we provide a comprehensive survey of key deep learning techniques for fish habitat monitoring including classification, counting, localization, and segmentation. Furthermore, we survey publicly available underwater fish datasets, and compare various DL techniques in the underwater fish monitoring domains. We also discuss some challenges and opportunities in the emerging field of deep learning for fish habitat processing. This paper is written to serve as a tutorial for marine scientists who would like to grasp a high-level understanding of DL, develop it for their applications by following our step-by-step tutorial, and see how it is evolving to facilitate their research efforts. At the same time, it is suitable for computer scientists who would like to survey state-of-the-art DL-based methodologies for fish habitat monitoring.
Key facts. Cited by 4 papers in the map (data through 14 Oct 2026). Builds on 52 of its 170 references that are in the map. First posted on arXiv 11 Jun 2022.
Builds on
52 of 170 references.
References · 52
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2014Adam: A Method for Stochastic Optimizationcited by 37,240
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2015Faster R-CNN: Towards Real-Time Object Detection with Region Proposal Networkscited by 9,639
- 2015Batch Normalization: Accelerating Deep Network Training by Reducing Internal Covariate Shiftcited by 7,005
- 2022Generative Adversarial Networkscited by 5,627
- 2015Rethinking the Inception Architecture for Computer Visioncited by 5,475
- 2014Going Deeper with Convolutionscited by 4,241
- 2013Rich feature hierarchies for accurate object detection and semantic segmentationcited by 2,162
- 2016Photo-Realistic Single Image Super-Resolution Using a Generative Adversarial Networkcited by 1,908
- 2019Class-Balanced Loss Based on Effective Number of Samplescited by 1,245
- 2019Learning Imbalanced Datasets with Label-Distribution-Aware Margin Losscited by 989
38 more
- 2019Large-Scale Long-Tailed Recognition in an Open Worldcited by 705
- 2015Towards Open Set Deep Networkscited by 538
- 2019Generalizing from a Few Examples: A Survey on Few-Shot Learningcited by 463
- 2016ScribbleSup: Scribble-Supervised Convolutional Networks for Semantic Segmentationcited by 331
- 2018Learning Pixel-level Semantic Affinity with Image-level Supervision for Weakly Supervised Semantic Segmentationcited by 321
- 2015What's the Point: Semantic Segmentation with Point Supervisioncited by 298
- 2015BoxSup: Exploiting Bounding Boxes to Supervise Convolutional Networks for Semantic Segmentationcited by 238
- 2016Simple Does It: Weakly Supervised Instance and Semantic Segmentationcited by 227
- 2019A Survey of the Recent Architectures of Deep Convolutional Neural Networkscited by 213
- 2017CleanNet: Transfer Learning for Scalable Image Classifier Training with Label Noisecited by 181
- 2018Revisiting Dilated Convolution: A Simple Approach for Weakly- and Semi- Supervised Semantic Segmentationcited by 145
- 2015Constrained Convolutional Neural Networks for Weakly Supervised Segmentationcited by 100
- 2020Semantic Segmentation of Underwater Imagery: Dataset and Benchmarkcited by 95
- 2017Regularization for Deep Learning: A Taxonomycited by 91
- 2016DeepCut: Object Segmentation from Bounding Box Annotations using Convolutional Neural Networkscited by 79
- 2018DeepWeeds: A Multiclass Weed Species Image Dataset for Deep Learningcited by 69
- 2020A Realistic Fish-Habitat Dataset to Evaluate Algorithms for Underwater Visual Analysiscited by 57
- 2016Pruning Convolutional Neural Networks for Resource Efficient Inferencecited by 48
- 2020Hardware Implementation of Deep Network Accelerators Towards Healthcare and Biomedical Applicationscited by 34
- 2018Coarse-to-fine Semantic Segmentation from Image-level Labelscited by 28
- 2020Distilling Spikes: Knowledge Distillation in Spiking Neural Networkscited by 27
- 2020A Weakly Supervised Consistency-based Learning Method for COVID-19 Segmentation in CT Imagescited by 24
- 2019Classification from Pairwise Similarities/Dissimilarities and Unlabeled Data via Empirical Risk Minimizationcited by 21
- 2017Understanding Traffic Density from Large-Scale Web Camera Datacited by 18
- 2017Beyond Counting: Comparisons of Density Maps for Crowd Analysis Tasks - Counting, Detection, and Trackingcited by 15
- 2022Computer Vision and Deep Learning for Fish Classification in Underwater Habitats: A Surveycited by 14
- 2020Deep learning for smart fish farming: applications, opportunities and challengescited by 12
- 2020Internet of Underwater Things and Big Marine Data Analytics -- A Comprehensive Surveycited by 11
- 2017ConvNet-Based Localization of Anatomical Structures in 3D Medical Imagescited by 9
- 2021Deep learning with self-supervision and uncertainty regularization to count fish in underwater imagescited by 9
- 2020Temperate Fish Detection and Classification: a Deep Learning based Approachcited by 8
- 2018Underwater Fish Detection using Deep Learning for Water Power Applicationscited by 5
- 2019Underwater Fish Detection with Weak Multi-Domain Supervisioncited by 5
- 2020Counting Fish and Dolphins in Sonar Images Using Deep Learningcited by 5
- 2020Affinity LCFCN: Learning to Segment Fish with Weak Supervisioncited by 5
- 2021A Deep Learning Localization Method for Measuring Abdominal Muscle Dimensions in Ultrasound Imagescited by 4
- 2016A Feature Learning and Object Recognition Framework for Underwater Fish Imagescited by 3
- 2018Assessing fish abundance from underwater video using deep neural networkscited by 3
50 most cited of 52 All 52 (JSON)
Built on by
Citing papers per year: 2023: 2; 2024: 0; 2025: 2.
4 papers.
- 2023Membership Inference Attack for Beluga Whales Discriminationcited by 1
- 2023Cognitive Edge Device (CED) for Real-Time Environmental Monitoring in Aquatic Ecosystemscited by 0
- 2025AI in Agriculture: A Survey of Deep Learning Techniques for Crops, Fisheries and Livestockcited by 0
- 2025Benchmarking Out-of-Distribution Detection for Plankton Recognition: A Systematic Evaluation of Advanced Methods in Marine Ecological Monitoringcited by 0
- 2025Benchmarking Out-of-Distribution Detection for Plankton Recognition: A Systematic Evaluation of Advanced Methods in Marine Ecological Monitoring20 Oct 2025
- 2025AI in Agriculture: A Survey of Deep Learning Techniques for Crops, Fisheries and Livestock29 Jul 2025
- 2023Cognitive Edge Device (CED) for Real-Time Environmental Monitoring in Aquatic Ecosystems21 Dec 2023
- 2023Membership Inference Attack for Beluga Whales Discrimination28 Feb 2023