mlsanityData to 13 Oct 2026

A Survey of Sound Source Localization with Deep Learning Methods

arXiv 2109.03465 ↗First posted 8 Sep 2021cs.SD cs.LG eess.AScited by 45

Not on the map. Why?

Abstract (arXiv)

This article is a survey on deep learning methods for single and multiple sound source localization. We are particularly interested in sound source localization in indoor/domestic environment, where reverberation and diffuse noise are present. We provide an exhaustive topography of the neural-based localization literature in this context, organized according to several aspects: the neural network architecture, the type of input features, the output strategy (classification or regression), the types of data used for model training and evaluation, and the model training strategy. This way, an interested reader can easily comprehend the vast panorama of the deep learning-based sound source localization methods. Tables summarizing the literature survey are provided at the end of the paper for a quick search of methods with a given set of target characteristics.

Key facts. Cited by 45 papers in the map (data through 13 Oct 2026). Builds on 118 of its 402 references that are in the map. First posted on arXiv 8 Sep 2021.

Builds on

118 of 402 references.

References · 118

  1. 2017Attention Is All You Needcited by 60,106
  2. 2015Deep Residual Learning for Image Recognitioncited by 51,950
  3. 2015U-Net: Convolutional Networks for Biomedical Image Segmentationcited by 19,656
  4. 2017mixup: Beyond Empirical Risk Minimizationcited by 5,170
  5. 2017Squeeze-and-Excitation Networkscited by 4,772
  6. 2014Neural Machine Translation by Jointly Learning to Align and Translatecited by 4,539
  7. 2014Learning Phrase Representations using RNN Encoder-Decoder for Statistical Machine Translationcited by 4,024
  8. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,844
  9. 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,359
  10. 2019A Comprehensive Survey on Transfer Learningcited by 1,157
  11. 2014Convolutional Neural Networks for Sentence Classificationcited by 1,126
  12. 2017A Survey on Multi-Task Learningcited by 840
38 more
  1. 2017An Overview of Multi-Task Learning in Deep Neural Networkscited by 799
  2. 2021TrackFormer: Multi-Object Tracking with Transformerscited by 516
  3. 2016Temporal Convolutional Networks for Action Segmentation and Detectioncited by 504
  4. 2018Conv-TasNet: Surpassing Ideal Time-Frequency Magnitude Masking for Speech Separationcited by 402
  5. 2020TransTrack: Multiple Object Tracking with Transformercited by 370
  6. 2019Gauge Equivariant Convolutional Networks and the Icosahedral CNNcited by 263
  7. 2017Supervised Speech Separation Based on Deep Learning: An Overviewcited by 213
  8. 2016Permutation Invariant Training of Deep Models for Speaker-Independent Multi-talker Speech Separationcited by 190
  9. 2020DDSP: Differentiable Digital Signal Processingcited by 178
  10. 2014Multiple Object Tracking: A Literature Reviewcited by 165
  11. 2019A review of domain adaptation without target labelscited by 155
  12. 2019WHAM!: Extending Speech Separation to Noisy Environmentscited by 155
  13. 2020Model-Based Deep Learningcited by 139
  14. 2017Pyroomacoustics: A Python package for audio room simulations and array processing algorithmscited by 131
  15. 2020Dynamical Variational Autoencoders: A Comprehensive Reviewcited by 127
  16. 2021A Review of Speaker Diarization: Recent Advances with Deep Learningcited by 123
  17. 2019Deep Learning in Video Multi-Object Tracking: A Surveycited by 107
  18. 2019Deep Learning for Audio Signal Processingcited by 92
  19. 2016Deep Convolutional Neural Networks and Data Augmentation for Environmental Sound Classificationcited by 84
  20. 2018Sound Event Localization and Detection of Overlapping Sources Using Convolutional Recurrent Neural Networkscited by 84
  21. 2017Tracking The Untrackable: Learning To Track Multiple Cues with Long-Term Dependenciescited by 76
  22. 2018Trellis Networks for Sequence Modelingcited by 51
  23. 2018gpuRIR: A Python Library for Room Impulse Response Simulation with GPU Accelerationcited by 46
  24. 2018Building and Evaluation of a Real Room Impulse Response Datasetcited by 43
  25. 2019Exploiting Spatial Invariance for Scalable Unsupervised Object Trackingcited by 40
  26. 2019Machine learning in acoustics: theory and applicationscited by 36
  27. 2020Probabilistic Tracklet Scoring and Inpainting for Multiple Object Trackingcited by 36
  28. 2020UnOVOST: Unsupervised Offline Video Object Segmentation and Trackingcited by 34
  29. 2020Simple Unsupervised Multi-Object Trackingcited by 33
  30. 2019End-to-end Microphone Permutation and Number Invariant Multi-channel Speech Separationcited by 31
  31. 2020Overview and Evaluation of Sound Event Localization and Detection in DCASE 2019cited by 31
  32. 2017Sample-level Deep Convolutional Neural Networks for Music Auto-tagging Using Raw Waveformscited by 27
  33. 2017Direction of arrival estimation for multiple sound sources using convolutional recurrent neural networkcited by 27
  34. 2020An Improved Event-Independent Network for Polyphonic Sound Event Localization and Detectioncited by 25
  35. 2020ACCDOA: Activity-Coupled Cartesian Direction of Arrival Representation for Sound Event Localization and Detectioncited by 25
  36. 2018Tracking by Animation: Unsupervised Learning of Multi-Object Attentive Trackerscited by 22
  37. 2017Deep Neural Networks for Multiple Speaker Detection and Localizationcited by 21
  38. 2018Quaternion Convolutional Neural Networks for End-to-End Automatic Speech Recognitioncited by 21

50 most cited of 118 All 118 (JSON)

Built on by

Cited by year (2026 to 13 Oct)

Citing papers per year: 2021: 1; 2022: 11; 2023: 11; 2024: 9; 2025: 8; 2026: 5.

45 papers.

Sort:

By area:

  1. 2022SoundSpaces 2.0: A Simulation Platform for Visual-Acoustic Learningcited by 93
  2. 2022Egocentric Deep Multi-Channel Audio-Visual Active Speaker Localizationcited by 27
  3. 2022MESH2IR: Neural Acoustic Impulse Response Generator for Complex 3D Scenescited by 23
  4. 2022Vision+X: A Survey on Multimodal Learning in the Light of Datacited by 22
  5. 2023Resilient Multiple Choice Learning: A learned scoring scheme with application to audio scene analysiscited by 12
  6. 2024Spatial Scaper: A Library to Simulate and Augment Soundscapes for Sound Event Localization and Detection in Realistic Roomscited by 12
  7. 2021DA-MUSIC: Data-Driven DoA Estimation via Deep Augmented MUSIC Algorithmcited by 10
  8. 2022Extending GCC-PHAT using Shift Equivariant Neural Networkscited by 7
  9. 2023Spatial LibriSpeech: An Augmented Dataset for Spatial Audio Learningcited by 6
  10. 2024Winner-takes-all learners are geometry-aware conditional density estimatorscited by 6
  11. 2023Multi-goal Audio-visual Navigation using Sound Direction Mapcited by 5
  12. 2024TF-Mamba: A Time-Frequency Network for Sound Source Localizationcited by 5
33 more
  1. 2024SonicSim: A customizable simulation platform for speech processing in moving sound source scenarioscited by 4
  2. 2022Direction of Arrival Estimation of Sound Sources Using Icosahedral CNNscited by 3
  3. 2022Enemy Spotted: in-game gun sound dataset for gunshot classification and localizationcited by 3
  4. 2022Position tracking of a varying number of sound sources with sliding permutation invariant trainingcited by 3
  5. 2023Dual input neural networks for positional sound source localizationcited by 3
  6. 2023A Real-Time Active Speaker Detection System Integrating an Audio-Visual Signal with a Spatial Querying Mechanismcited by 3
  7. 2024Enhanced Sound Event Localization and Detection in Real 360-degree audio-visual soundscapescited by 3
  8. 2025From Waveforms to Pixels: A Survey on Audio-Visual Segmentationcited by 3
  9. 2025From Large-scale Audio Tagging to Real-Time Explainable Emergency Vehicle Sirens Detectioncited by 2
  10. 2022Locate This, Not That: Class-Conditioned Sound Event DOA Estimationcited by 1
  11. 2023How far generated data can impact Neural Networks performance?cited by 1
  12. 2023Permutation Invariant Recurrent Neural Networks for Sound Source Tracking Applicationscited by 1
  13. 2024wav2pos: Sound Source Localization using Masked Autoencoderscited by 1
  14. 2025A Review on Sound Source Localization in Robotics: Focusing on Deep Learning Methodscited by 1
  15. 2025Latent Acoustic Mapping for Direction of Arrival Estimation: A Self-Supervised Approachcited by 1
  16. 2026Query-Guided Spatial-Temporal-Frequency Interaction for Music Audio-Visual Question Answeringcited by 1
  17. 2026Semantic Audio-Visual Navigation in Continuous Environmentscited by 1
  18. 2026SelectTSL: Prompt-Guided Selective Target Sound Localization in Complex Scenarioscited by 1
  19. 2022Uncertainty-Based Non-Parametric Active Peak Detectioncited by 0
  20. 2022A physically-informed Deep-Learning approach for locating sources in a waveguidecited by 0
  21. 2023Enhanced Neural Beamformer with Spatial Information for Target Speech Extractioncited by 0
  22. 2023Sound field decomposition based on two-stage neural networkscited by 0
  23. 2023An experiment on an automated literature survey of data-driven speech enhancement methodscited by 0
  24. 2023Feature Aggregation in Joint Sound Classification and Localization Neural Networkscited by 0
  25. 2024Audio Simulation for Sound Source Localization in Virtual Evironmentcited by 0
  26. 2024Maximum Likelihood Estimation of the Direction of Sound In A Reverberant Noisy Environmentcited by 0
  27. 2024SONNET: Enhancing Time Delay Estimation by Leveraging Simulated Audiocited by 0
  28. 2025Efficient and Microphone-Fault-Tolerant 3D Sound Source Localizationcited by 0
  29. 2025Acoustic Imaging for UAV Detection: Dense Beamformed Energy Maps and U-Net SELDcited by 0
  30. 2025Towards Low-Latency Tracking of Multiple Speakers With Short-Context Speaker Embeddingscited by 0
  31. 2025Systematic Evaluation of Time-Frequency Features for Binaural Sound Source Localizationcited by 0
  32. 2026What Do Neural Networks Learn for TDOA Estimation? A Cross-Architecture Probing Studycited by 0
  33. 2026RAO-Nav: Probing Omni-Language Models for Zero-shot Semantic Audio-Visual Navigationcited by 0