mlsanityData to 7 Oct 2026

A Framework for the Robust Evaluation of Sound Event Detection

arXiv 1910.08440 ↗First posted 18 Oct 2019eess.AS cs.SDcited by 28

Not on the map. Why?

Abstract (arXiv)

This work defines a new framework for performance evaluation of polyphonic sound event detection (SED) systems, which overcomes the limitations of the conventional collar-based event decisions, event F-scores and event error rates. The proposed framework introduces a definition of event detection that is more robust against labelling subjectivity. It also resorts to polyphonic receiver operating characteristic (ROC) curves to deliver more global insight into system performance than F1-scores, and proposes a reduction of these curves into a single polyphonic sound detection score (PSDS), which allows system comparison independently from operating points (OPs). The presented method also delivers better insight into data biases and classification stability across sound classes. Furthermore, it can be tuned to varying applications in order to match a variety of user experience requirements. The benefits of the proposed approach are demonstrated by re-evaluating the baseline and two of the top-performing systems from DCASE 2019 Task 4.

Key facts. Cited by 28 papers in the map (data through 7 Oct 2026). First posted on arXiv 18 Oct 2019.

Builds on

No reference list yet.

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2021: 3; 2022: 6; 2023: 2; 2024: 6; 2025: 10; 2026: 1.

28 papers.

Sort:

By area:

  1. 2023Self-supervised Audio Teacher-Student Transformer for Both Clip-level and Frame-level Taskscited by 25
  2. 2025Pushing the Frontier of Audiovisual Perception with Large-Scale Multimodal Correspondence Learningcited by 12
  3. 2025TACOS: Temporally-aligned Audio CaptiOnS for Language-Audio Pretrainingcited by 9
  4. 2025Detect Any Sound: Open-Vocabulary Sound Event Detection with Multi-Modal Queriescited by 9
  5. 2024MAT-SED: A Masked Audio Transformer with Masked-Reconstruction Based Pre-training for Sound Event Detectioncited by 7
  6. 2021The impact of non-target events in synthetic soundscapes for sound event detectioncited by 4
  7. 2022The ACM Multimedia 2022 Computational Paralinguistics Challenge: Vocalisations, Stuttering, Activity, & Mosquitoescited by 4
  8. 2025FlexSED: Towards Open-Vocabulary Sound Event Detectioncited by 4
  9. 2022Segment-level Metric Learning for Few-shot Bioacoustic Event Detectioncited by 3
  10. 2024Prototype based Masked Audio Model for Self-Supervised Learning of Sound Event Detectioncited by 3
  11. 2021Self-training with noisy student model and semi-supervised loss function for dcase 2021 challenge task 4cited by 2
  12. 2024Dual Knowledge Distillation for Efficient Sound Event Detectioncited by 2
16 more
  1. 2024Energy Consumption Trends in Sound Event Detection Systemscited by 2
  2. 2022A benchmark of state-of-the-art sound event detection systems evaluated on synthetic soundscapescited by 1
  3. 2025Auditory Intelligence: Understanding the World Through Soundcited by 1
  4. 2025SynSonic: Augmenting Sound Event Detection through Text-to-Audio Diffusion ControlNet and Effective Sample Filteringcited by 1
  5. 2021Audio Attacks and Defenses against AED Systems -- A Practical Studycited by 0
  6. 2022Deep Learning-Based Acoustic Mosquito Detection in Noisy Conditions Using Trainable Kernels and Augmentationscited by 0
  7. 2022Multi-encoder attention-based architectures for sound recognition with partial visual assistancecited by 0
  8. 2022A Hybrid System of Sound Event Detection Transformer and Frame-wise Model for DCASE 2022 Task 4cited by 0
  9. 2023AGS: An Dataset and Taxonomy for Domestic Scene Sound Event Recognitioncited by 0
  10. 2024Meta-Decomposition: Dynamic Segmentation Approach Selection in IoT-based Activity Recognitioncited by 0
  11. 2024MTDA-HSED: Mutual-Assistance Tuning and Dual-Branch Aggregating for Heterogeneous Sound Event Detectioncited by 0
  12. 2025Formula-Supervised Sound Event Detection: Pre-Training Without Real Datacited by 0
  13. 2025Revisiting SSL for sound event detection: complementary fusion and adaptive post-processingcited by 0
  14. 2025EZhouNet:A framework based on graph neural network and anchor interval for the respiratory sound event detectioncited by 0
  15. 2025More Than A Shortcut: A Hyperbolic Approach To Early-Exit Networkscited by 0
  16. 2026Auto-AEG: Scalable Data Construction for Open-Vocabulary Audio Event Groundingcited by 0