# DCASE 2021 Task 3: Spectrotemporally-aligned Features for Polyphonic Sound Event Localization and Detection

arXiv: https://arxiv.org/abs/2106.15190 · HTML: https://mlsanity.com/paper/2106.15190/

## Key facts

- Cited by 3 papers in the map (data through 14 Oct 2026).
- Builds on 18 of its 24 references that are in the map.
- First posted on arXiv 29 Jun 2021.

## Builds on (most cited first, 18 of 18)

- [Deep Residual Learning for Image Recognition](https://mlsanity.com/paper/1512.03385/) (2015)
- [SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition](https://mlsanity.com/paper/1904.08779/) (2019)
- [Random Erasing Data Augmentation](https://mlsanity.com/paper/1708.04896/) (2017)
- [PANNs: Large-Scale Pretrained Audio Neural Networks for Audio Pattern Recognition](https://mlsanity.com/paper/1912.10211/) (2019)
- [Deep Convolutional Neural Networks and Data Augmentation for Environmental Sound Classification](https://mlsanity.com/paper/1608.04363/) (2016)
- [Sound Event Localization and Detection of Overlapping Sources Using Convolutional Recurrent Neural Networks](https://mlsanity.com/paper/1807.00129/) (2018)
- [Convolutional Recurrent Neural Networks for Polyphonic Sound Event Detection](https://mlsanity.com/paper/1702.06286/) (2017)
- [Overview and Evaluation of Sound Event Localization and Detection in DCASE 2019](https://mlsanity.com/paper/2009.02792/) (2020)
- [ACCDOA: Activity-Coupled Cartesian Direction of Arrival Representation for Sound Event Localization and Detection](https://mlsanity.com/paper/2010.15306/) (2020)
- [An Improved Event-Independent Network for Polyphonic Sound Event Localization and Detection](https://mlsanity.com/paper/2010.13092/) (2020)
- [A Dataset of Reverberant Spatial Sound Scenes with Moving Sources for Sound Event Localization and Detection](https://mlsanity.com/paper/2006.01919/) (2020)
- [A Four-Stage Data Augmentation Approach to ResNet-Conformer Based Acoustic Modeling for Sound Event Localization and Detection](https://mlsanity.com/paper/2101.02919/) (2021)
- [A Dataset of Dynamic Reverberant Sound Scenes with Directional Interferers for Sound Event Localization and Detection](https://mlsanity.com/paper/2106.06999/) (2021)
- [Polyphonic Sound Event Detection and Localization using a Two-Stage Strategy](https://mlsanity.com/paper/1905.00268/) (2019)
- [A multi-room reverberant dataset for sound event localization and detection](https://mlsanity.com/paper/1905.08546/) (2019)
- [First Order Ambisonics Domain Spatial Augmentation for DNN-based Direction of Arrival Estimation](https://mlsanity.com/paper/1910.04388/) (2019)
- [Event-Independent Network for Polyphonic Sound Event Localization and Detection](https://mlsanity.com/paper/2010.00140/) (2020)
- [Bird detection in audio: a survey and a challenge](https://mlsanity.com/paper/1608.03417/) (2016)

## Built on by (most cited first, 3 of 3)

- [A Survey of Sound Source Localization with Deep Learning Methods](https://mlsanity.com/paper/2109.03465/) (2021)
- [What Makes Sound Event Localization and Detection Difficult? Insights from Error Analysis](https://mlsanity.com/paper/2107.10469/) (2021)
- [Spatial mixup: Directional loudness modification as data augmentation for sound event localization and detection](https://mlsanity.com/paper/2110.06126/) (2021)

## Abstract (arXiv)

Sound event localization and detection consists of two subtasks which are sound event detection and direction-of-arrival estimation. While sound event detection mainly relies on time-frequency patterns to distinguish different sound classes, direction-of-arrival estimation uses magnitude or phase differences between microphones to estimate source directions. Therefore, it is often difficult to jointly train these two subtasks simultaneously. We propose a novel feature called spatial cue-augmented log-spectrogram (SALSA) with exact time-frequency mapping between the signal power and the source direction-of-arrival. The feature includes multichannel log-spectrograms stacked along with the estimated direct-to-reverberant ratio and a normalized version of the principal eigenvector of the spatial covariance matrix at each time-frequency bin on the spectrograms. Experimental results on the DCASE 2021 dataset for sound event localization and detection with directional interference showed that the deep learning-based models trained on this new feature outperformed the DCASE challenge baseline by a large margin. We combined several models with slightly different architectures that were trained on the new feature to further improve the system performances for the DCASE sound event localization and detection challenge.