Advancing Marine Bioacoustics with Deep Generative Models: A Hybrid Augmentation Strategy for Southern Resident Killer Whale Detection
Not on the map. Why?
Abstract (arXiv)
Automated detection and classification of marine mammals vocalizations is critical for conservation and management efforts but is hindered by limited annotated datasets and the acoustic complexity of real-world marine environments. Data augmentation has proven to be an effective strategy to address this limitation by increasing dataset diversity and improving model generalization without requiring additional field data. However, most augmentation techniques used to date rely on effective but relatively simple transformations, leaving open the question of whether deep generative models can provide additional benefits. In this study, we evaluate the potential of deep generative for data augmentation in marine mammal call detection including: Variational Autoencoders, Generative Adversarial Networks, and Denoising Diffusion Probabilistic Models. Using Southern Resident Killer Whale (Orcinus orca) vocalizations from two long-term hydrophone deployments in the Salish Sea, we compare these approaches against traditional augmentation methods such as time-shifting and vocalization masking. While all generative approaches improved classification performance relative to the baseline, diffusion-based augmentation yielded the highest recall (0.87) and overall F1-score (0.75). A hybrid strategy combining generative-based synthesis with traditional methods achieved the best overall performance with an F1-score of 0.81. We hope this study encourages further exploration of deep generative models as complementary augmentation strategies to advance acoustic monitoring of threatened marine mammal populations.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 27 of its 89 references that are in the map. First posted on arXiv 26 Nov 2025.
Builds on
27 of 89 references.
References · 27
- 2015Deep Residual Learning for Image Recognitioncited by 52,096
- 2020Denoising Diffusion Probabilistic Modelscited by 21,076
- 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,713
- 2021Diffusion Models Beat GANs on Image Synthesiscited by 8,255
- 2015Deep Unsupervised Learning using Nonequilibrium Thermodynamicscited by 7,058
- 2018A Style-Based Generator Architecture for Generative Adversarial Networkscited by 6,013
- 2016Image-to-Image Translation with Conditional Adversarial Networkscited by 4,527
- 2021Improved Denoising Diffusion Probabilistic Modelscited by 3,761
- 2017Improved Training of Wasserstein GANscited by 2,235
- 2015Unsupervised Representation Learning with Deep Convolutional Generative Adversarial Networkscited by 2,054
- 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,380
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,354
15 more
- 2017High-Resolution Image Synthesis and Semantic Manipulation with Conditional GANscited by 1,179
- 2017StarGAN: Unified Generative Adversarial Networks for Multi-Domain Image-to-Image Translationcited by 1,039
- 2019An Introduction to Variational Autoencoderscited by 1,000
- 2017Towards Principled Methods for Training Generative Adversarial Networkscited by 464
- 2022A Survey on Generative Diffusion Modelcited by 240
- 2018Adversarial Audio Synthesiscited by 225
- 2017Supervised Speech Separation Based on Deep Learning: An Overviewcited by 216
- 2017VEEGAN: Reducing Mode Collapse in GANs using Implicit Variational Learningcited by 200
- 2016Mode Regularized Generative Adversarial Networkscited by 123
- 2018BAGAN: Data Augmentation with Balancing GANcited by 90
- 2021Computational bioacoustics with deep learning: a review and roadmapcited by 78
- 2019A Survey on Face Data Augmentationcited by 23
- 2020Learning Deep Models from Synthetic Data for Extracting Dolphin Whistle Contourscited by 4
- 2020Performance of a Deep Neural Network at Detecting North Atlantic Right Whale Upcallscited by 2
- 2023Learning Stage-wise GANs for Whistle Extraction in Time-Frequency Spectrogramscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025Perch 2.0: The Bittern Lesson for Bioacoustics
- 2024Generative AI-based data augmentation for improved bioacoustic classification in noisy environments
- 2024animal2vec and MeerKAT: A self-supervised transformer for rare-event raw audio input and a large-scale reference dataset for bioacoustics
- 2025Synthetic data enables context-aware bioacoustic sound event detection
- 2025Knowledge-Augmented Vision Language Models for Underwater Bioacoustic Spectrogram Analysis
- 2024Benchmarking Large Language Models for Image Classification of Marine Mammals
- 2024Generalization in birdsong classification: impact of transfer learning methods and dataset characteristics
- 2025FishNet++: Analyzing the capabilities of Multimodal Large Language Models in marine biology