Time-frequency localization of bird calls in dense soundscapes
Not on the map. Why?
Abstract (arXiv)
Passive acoustic monitoring enables large-scale wildlife observation. Most bioacoustic classifiers predict species presence in a time window without localizing vocalizations precisely in time or frequency, limiting downstream analyses. We formulate time-frequency localization of bird calls as object detection on spectrograms and compare three computer vision model families (YOLO11, SAM 3, RF-DETR) against a non-learnable baseline. We introduce Intersection over Minimum (IoMin), an evaluation metric that better handles ambiguous acoustic boundaries than IoU. We also open-source a browser-based tool for efficient bounding-box labeling. The best RF-DETR model nearly doubles baseline performance on in-distribution, dense soundscapes from Singapore (83.4% vs. 42.1% IoMin@50 F1-score) and generalizes better to out-of-distribution recordings from Hawaii (63.2% vs. 48.6%). These results indicate that fine-tuned computer-vision models are well suited for time-frequency localization of bird vocalizations in complex soundscapes.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 7 of its 24 references that are in the map. First posted on arXiv 9 Jun 2026.
Builds on
7 of 24 references.
References · 7
- 2014Microsoft COCO: Common Objects in Contextcited by 17,608
- 2025RF-DETR: Neural Architecture Search for Real-Time Detection Transformerscited by 75
- 2024BirdSet: A Large-Scale Dataset for Audio Classification in Avian Bioacousticscited by 36
- 2016Trainable Frontend For Robust and Far-Field Keyword Spottingcited by 33
- 2025Perch 2.0: The Bittern Lesson for Bioacousticscited by 26
- 2025Foundation Models for Bioacoustics -- a Comparative Reviewcited by 11
- 2025Localized time-frequency representation learning for bioacoustic classification in complex soundscapescited by 1
Built on by
Not cited yet.