Computational bioacoustics with deep learning: a review and roadmap
Not on the map. Why?
Abstract (arXiv)
Animal vocalisations and natural soundscapes are fascinating objects of study, and contain valuable evidence about animal behaviours, populations and ecosystems. They are studied in bioacoustics and ecoacoustics, with signal processing and analysis an important component. Computational bioacoustics has accelerated in recent decades due to the growth of affordable digital sound recording devices, and to huge progress in informatics such as big data, signal processing and machine learning. Methods are inherited from the wider field of deep learning, including speech and image processing. However, the tasks, demands and data characteristics are often different from those addressed in speech or music analysis. There remain unsolved problems, and tasks for which evidence is surely present in many acoustic signals, but not yet realised. In this paper I perform a review of the state of the art in deep learning for computational bioacoustics, aiming to clarify key concepts and identify and analyse knowledge gaps. Based on this, I offer a subjective but principled roadmap for computational bioacoustics with deep learning: topics that the community should aim to address, in order to make the most of future developments in AI and informatics, and to use audio data in answering zoological and ecological questions.
Key facts. Cited by 78 papers in the map (data through 14 Oct 2026). First posted on arXiv 13 Dec 2021.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2022: 2; 2023: 15; 2024: 12; 2025: 23; 2026: 26.
78 papers.
Sort:
By area:
- 2023Deep Learning for Time Series Classification and Extrinsic Regression: A Current Surveycited by 68
- 2024BirdSet: A Large-Scale Dataset for Audio Classification in Avian Bioacousticscited by 36
- 2025Can Masked Autoencoders Also Listen to Birds?cited by 26
- 2025Perch 2.0: The Bittern Lesson for Bioacousticscited by 26
- 2023Transferable Models for Bioacoustics with Human Language Supervisioncited by 21
- 2023BIRB: A Generalization Benchmark for Information Retrieval in Bioacousticscited by 19
- 2024animal2vec and MeerKAT: A self-supervised transformer for rare-event raw audio input and a large-scale reference dataset for bioacousticscited by 14
- 2022Few-shot bioacoustic event detection at the DCASE 2022 challengecited by 13
- 2023Self-Supervised Learning for Few-Shot Bird Sound Classificationcited by 11
- 2025Foundation Models for Bioacoustics -- a Comparative Reviewcited by 11
- 2023Unsupervised classification to improve the quality of a bird song recording datasetcited by 10
- 2023AnuraSet: A dataset for benchmarking Neotropical anuran calls identification in passive acoustic monitoringcited by 10
38 more
- 2024AudioProtoPNet: An interpretable deep learning model for bird sound classificationcited by 10
- 2024Towards Deep Active Learning in Avian Bioacousticscited by 10
- 2023Can Self-Supervised Neural Representations Pre-Trained on Human Speech distinguish Animal Callers?cited by 9
- 2025Comparing Self-Supervised Learning Models Pre-Trained on Human Speech and Animal Vocalizations for Bioacoustics Processingcited by 9
- 2023Regularized Contrastive Pre-training for Few-shot Bioacoustic Sound Detectioncited by 7
- 2024Leveraging tropical reef, bird and unrelated sounds for superior transfer learning in marine bioacousticscited by 7
- 2025Clustering and novel class recognition: evaluating bioacoustic deep learning feature extractorscited by 7
- 2024Exploring bat song syllable representations in self-supervised audio encoderscited by 5
- 2024Generalization in birdsong classification: impact of transfer learning methods and dataset characteristicscited by 5
- 2025AVEX: What Matters for Animal Vocalization Encodingcited by 5
- 2023Fitting Auditory Filterbanks with Multiresolution Neural Networkscited by 4
- 2023Exploring Meta Information for Audio-based Zero-shot Bird Classificationcited by 4
- 2024ISPA: Inter-Species Phonetic Alphabet for Transcribing Animal Soundscited by 4
- 2024Animal Behavior Analysis Methods Using Deep Learning: A Surveycited by 4
- 2024On the Utility of Speech and Audio Foundation Models for Marmoset Call Analysiscited by 4
- 2025Robust detection of overlapping bioacoustic sound eventscited by 4
- 2023Active Bird2Vec: Towards End-to-End Bird Sound Monitoring with Transformerscited by 3
- 2026Future of Edge AI in biodiversity monitoringcited by 3
- 2023Instabilities in Convnets for Raw Audiocited by 2
- 2024Self-supervised Learning for Acoustic Few-Shot Classificationcited by 2
- 2025Synthetic data enables context-aware bioacoustic sound event detectioncited by 2
- 2025Aggregation Strategies for Efficient Annotation of Bioacoustic Sound Events Using Active Learningcited by 2
- 2025Hybrid Disagreement-Diversity Active Learning for Bioacoustic Sound Event Detectioncited by 2
- 2025WoW-Bench: Evaluating Fine-Grained Acoustic Perception in Audio-Language Models via Marine Mammal Vocalizationscited by 2
- 2025Model Merging Improves Zero-Shot Generalization in Bioacoustic Foundation Modelscited by 2
- 2026bacpipe: a Python package to make bioacoustic deep learning models accessiblecited by 2
- 2026Determinantal point process sampling for bioacoustic active learningcited by 2
- 2026MetaPerch: Learning from metadata for bioacoustics foundation modelscited by 2
- 2022Propagating Variational Model Uncertainty for Bioacoustic Call Label Smoothingcited by 1
- 2024Generative AI-based data augmentation for improved bioacoustic classification in noisy environmentscited by 1
- 2025acoupi: An Open-Source Python Framework for Deploying Bioacoustic AI Models on Edge Devicescited by 1
- 2025Localized time-frequency representation learning for bioacoustic classification in complex soundscapescited by 1
- 2025Weakly Supervised Detection and Temporal Localization of Whale Calls in Long-Duration Bioacoustic Datacited by 1
- 2025A Bird Song Detector for improving bird identification through Deep Learning: a case study from Do~nanacited by 1
- 2025First-of-its-kind AI model for bioacoustic detection using a lightweight associative memory Hopfield neural networkcited by 1
- 2025No Free Lunch from Audio Pretraining in Bioacoustics: A Benchmark Study of Embeddingscited by 1
- 2025Explainability of CNN Based Classification Models for Acoustic Signalcited by 1
- 2025Uncertainty Calibration of Multi-Label Bird Sound Classifierscited by 1
50 most cited of 78 All 78 (JSON)
- 2026OpenWhistle: A Large-Scale Longitudinal Dataset and Benchmark of Bottlenose Dolphin Vocalizations28 Sep 2026
- 2026Active Learning for Biodiversity Monitoring: From Label Efficiency to Reliable Ecological Inference23 Sep 2026
- 2026MAST: Label-Efficient, Robust, and Generalizable Sound Detection for Biodiversity Monitoring via Masked Audio Pretraining and Self-Training14 Sep 2026
- 2026Large-scale bioacoustic detection using semantic segmentation: a deep learning framework applied to fin whale calls in ocean-bottom seismometer recordings8 Sep 2026
- 2026Unlabeled Echoes: Pseudo-Labels and Genus-Aware Smoothing for Bat Call Recognition8 Sep 2026
- 2026A Parameter-Free Few-Shot Evaluation for Elephant Vocalisation Classification14 Aug 2026
- 2026When Big Data Becomes a Curse: Spatial Heterogeneity and the Limits of Learning from Passive Acoustic Monitoring Data6 Aug 2026
- 2026Uncertainty-Aware Crossmodal Fusion for Classification of Animal Behavior3 Aug 2026
- 2026MetaPerch: Learning from metadata for bioacoustics foundation models15 Jul 2026
- 2026Cover First, Disagree Softly: Rethinking Mismatch-First Active Learning for Frame-Level Audio Classification15 Jul 2026
- 2026Greedy Volume Maximization of Gradient Embeddings for Long-Tailed Frame-Level Bioacoustic Active Learning15 Jul 2026
- 2026Determinantal point process sampling for bioacoustic active learning7 Jul 2026
38 more
- 2026Adaptive Loss Balancing for Multi-Task Bioacoustic Classification of Bird Species and Call Types3 Jul 2026
- 2026Beyond task performance: Decoding bioacoustic embeddings with speech features12 Jun 2026
- 2026CoarseSoundNet: Building a reliable model for ecological soundscape analysis20 May 2026
- 2026A strongly annotated passive acoustic dataset for tropical bird monitoring20 May 2026
- 2026Multi-layer attentive probing improves transfer of audio representations for bioacoustics11 May 2026
- 2026Ecologically-Constrained Task Arithmetic for Multi-Taxa Bioacoustic Classifiers Without Shared Data5 May 2026
- 2026BioSEN: A Bio-acoustic Signal Enhancement Network for Animal Vocalizations2 May 2026
- 2026From Birdsong to Rumbles: Classifying Elephant Calls with Out-of-Species Embeddings30 Apr 2026
- 2026Beyond the Baseband: Adaptive Multi-Band Encoding for Full-Spectrum Bioacoustics Classification30 Apr 2026
- 2026bacpipe: a Python package to make bioacoustic deep learning models accessible13 Apr 2026
- 2026DeepForestSound: a multi-species automatic detector for passive acoustic monitoring in African tropical forests, a case study in Kibale National Park9 Apr 2026
- 2026BioVITA: Biological Dataset, Model, and Benchmark for Visual-Textual-Acoustic Alignment25 Mar 2026
- 2026Spectrogram features for audio and speech analysis16 Mar 2026
- 2026Future of Edge AI in biodiversity monitoring13 Feb 2026
- 2025Advancing Marine Bioacoustics with Deep Generative Models: A Hybrid Augmentation Strategy for Southern Resident Killer Whale Detection26 Nov 2025
- 2025Dynamic Multi-Species Bird Soundscape Generation with Acoustic Patterning and 3D Spatialization24 Nov 2025
- 2025Uncertainty Calibration of Multi-Label Bird Sound Classifiers11 Nov 2025
- 2025Model Merging Improves Zero-Shot Generalization in Bioacoustic Foundation Models7 Nov 2025
- 2025Explainability of CNN Based Classification Models for Acoustic Signal10 Sep 2025
- 2025WoW-Bench: Evaluating Fine-Grained Acoustic Perception in Audio-Language Models via Marine Mammal Vocalizations28 Aug 2025
- 2025AVEX: What Matters for Animal Vocalization Encoding15 Aug 2025
- 2025No Free Lunch from Audio Pretraining in Bioacoustics: A Benchmark Study of Embeddings13 Aug 2025
- 2025Perch 2.0: The Bittern Lesson for Bioacoustics6 Aug 2025
- 2025Foundation Models for Bioacoustics -- a Comparative Review2 Aug 2025
- 2025First-of-its-kind AI model for bioacoustic detection using a lightweight associative memory Hopfield neural network14 Jul 2025
- 2025Hybrid Disagreement-Diversity Active Learning for Bioacoustic Sound Event Detection27 May 2025
- 2025Can Masked Autoencoders Also Listen to Birds?17 Apr 2025
- 2025Clustering and novel class recognition: evaluating bioacoustic deep learning feature extractors9 Apr 2025
- 2025A Bird Song Detector for improving bird identification through Deep Learning: a case study from Do~nana19 Mar 2025
- 2025Inteligencia Artificial para la conservaci'on y uso sostenible de la biodiversidad, una visi'on desde Colombia (Artificial Intelligence for conservation and sustainable use of biodiversity, a view from Colombia)17 Mar 2025
- 2025Aggregation Strategies for Efficient Annotation of Bioacoustic Sound Events Using Active Learning4 Mar 2025
- 2025Robust detection of overlapping bioacoustic sound events4 Mar 2025
- 2025Synthetic data enables context-aware bioacoustic sound event detection1 Mar 2025
- 2025Weakly Supervised Detection and Temporal Localization of Whale Calls in Long-Duration Bioacoustic Data28 Feb 2025
- 2025Localized time-frequency representation learning for bioacoustic classification in complex soundscapes19 Feb 2025
- 2025acoupi: An Open-Source Python Framework for Deploying Bioacoustic AI Models on Edge Devices29 Jan 2025
- 2025Comparing Self-Supervised Learning Models Pre-Trained on Human Speech and Animal Vocalizations for Bioacoustics Processing10 Jan 2025
- 2024Generative AI-based data augmentation for improved bioacoustic classification in noisy environments2 Dec 2024
50 newest of 78 All 78 (JSON)
- 2023Deep Learning for Time Series Classification and Extrinsic Regression: A Current Surveycited by 68
- 2024BirdSet: A Large-Scale Dataset for Audio Classification in Avian Bioacousticscited by 36
- 2025Can Masked Autoencoders Also Listen to Birds?cited by 26
- 2025Perch 2.0: The Bittern Lesson for Bioacousticscited by 26
- 2023Transferable Models for Bioacoustics with Human Language Supervisioncited by 21
- 2023BIRB: A Generalization Benchmark for Information Retrieval in Bioacousticscited by 19
- 2024animal2vec and MeerKAT: A self-supervised transformer for rare-event raw audio input and a large-scale reference dataset for bioacousticscited by 14
- 2022Few-shot bioacoustic event detection at the DCASE 2022 challengecited by 13
- 2023Self-Supervised Learning for Few-Shot Bird Sound Classificationcited by 11
- 2025Foundation Models for Bioacoustics -- a Comparative Reviewcited by 11
- 2023Unsupervised classification to improve the quality of a bird song recording datasetcited by 10
- 2023AnuraSet: A dataset for benchmarking Neotropical anuran calls identification in passive acoustic monitoringcited by 10
12 most cited of 76 All 76 (JSON)
- 2026OpenWhistle: A Large-Scale Longitudinal Dataset and Benchmark of Bottlenose Dolphin Vocalizations28 Sep 2026
- 2026Active Learning for Biodiversity Monitoring: From Label Efficiency to Reliable Ecological Inference23 Sep 2026
- 2026MAST: Label-Efficient, Robust, and Generalizable Sound Detection for Biodiversity Monitoring via Masked Audio Pretraining and Self-Training14 Sep 2026
- 2026Large-scale bioacoustic detection using semantic segmentation: a deep learning framework applied to fin whale calls in ocean-bottom seismometer recordings8 Sep 2026
- 2026Unlabeled Echoes: Pseudo-Labels and Genus-Aware Smoothing for Bat Call Recognition8 Sep 2026
- 2026A Parameter-Free Few-Shot Evaluation for Elephant Vocalisation Classification14 Aug 2026
- 2026When Big Data Becomes a Curse: Spatial Heterogeneity and the Limits of Learning from Passive Acoustic Monitoring Data6 Aug 2026
- 2026Uncertainty-Aware Crossmodal Fusion for Classification of Animal Behavior3 Aug 2026
- 2026MetaPerch: Learning from metadata for bioacoustics foundation models15 Jul 2026
- 2026Cover First, Disagree Softly: Rethinking Mismatch-First Active Learning for Frame-Level Audio Classification15 Jul 2026
- 2026Greedy Volume Maximization of Gradient Embeddings for Long-Tailed Frame-Level Bioacoustic Active Learning15 Jul 2026
- 2026Determinantal point process sampling for bioacoustic active learning7 Jul 2026
12 newest of 76 All 76 (JSON)