Direction of arrival estimation for multiple sound sources using convolutional recurrent neural network
Not on the map. Why?
Abstract (arXiv)
This paper proposes a deep neural network for estimating the directions of arrival (DOA) of multiple sound sources. The proposed stacked convolutional and recurrent neural network (DOAnet) generates a spatial pseudo-spectrum (SPS) along with the DOA estimates in both azimuth and elevation. We avoid any explicit feature extraction step by using the magnitudes and phases of the spectrograms of all the channels as input to the network. The proposed DOAnet is evaluated by estimating the DOAs of multiple concurrently present sources in anechoic, matched and unmatched reverberant conditions. The results show that the proposed DOAnet is capable of estimating the number of sources and their respective DOAs with good precision and generate SPS with high signal-to-noise ratio.
Key facts. Cited by 27 papers in the map (data through 14 Oct 2026). First posted on arXiv 27 Oct 2017.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 7; 2022: 5; 2023: 6; 2024: 3; 2025: 4; 2026: 2.
27 papers.
Sort:
By area:
- 2021A Survey of Sound Source Localization with Deep Learning Methodscited by 46
- 2022Egocentric Deep Multi-Channel Audio-Visual Active Speaker Localizationcited by 27
- 2022Sound Localization by Self-Supervised Time Delay Estimationcited by 18
- 2023Sound Localization from Motion: Jointly Learning Sound Direction and Camera Rotationcited by 18
- 2023Resilient Multiple Choice Learning: A learned scoring scheme with application to audio scene analysiscited by 12
- 2021PILOT: Introducing Transformers for Probabilistic Sound Event Localizationcited by 7
- 2021Exploiting Attention-based Sequence-to-Sequence Architectures for Sound Event Localizationcited by 6
- 2023LocSelect: Target Speaker Localization with an Auditory Selective Hearing Mechanismcited by 6
- 2024Winner-takes-all learners are geometry-aware conditional density estimatorscited by 6
- 2024TF-Mamba: A Time-Frequency Network for Sound Source Localizationcited by 5
- 2022MIMO-DoAnet: Multi-channel Input and Multiple Outputs DoA Network with Unknown Number of Sound Sourcescited by 4
- 2022Direction of Arrival Estimation of Sound Sources Using Icosahedral CNNscited by 3
15 more
- 2023Quaternion Convolutional Neural Networks: Current Advances and Future Directionscited by 3
- 2023Dual input neural networks for positional sound source localizationcited by 3
- 2021DeepAoANet: Learning Angle of Arrival from Software Defined Radios with Deep Neural Networkscited by 2
- 2021Data Fusion for Audiovisual Speaker Localization: Extending Dynamic Stream Weights to the Spatial Domaincited by 1
- 2022Iterative Sound Source Localization for Unknown Number of Sourcescited by 1
- 2025Spatial and Semantic Embedding Integration for Stereo Sound Event Localization and Detection in Regular Videoscited by 1
- 2025Integrating Spatial and Semantic Embeddings for Stereo Sound Event Localization in Videoscited by 1
- 2021What Makes Sound Event Localization and Detection Difficult? Insights from Error Analysiscited by 0
- 2021Spatial mixup: Directional loudness modification as data augmentation for sound event localization and detectioncited by 0
- 2023Feature Aggregation in Joint Sound Classification and Localization Neural Networkscited by 0
- 2024Audio Simulation for Sound Source Localization in Virtual Evironmentcited by 0
- 2025An Experimental Study on Joint Modeling for Sound Event Localization and Detection with Source Distance Estimationcited by 0
- 2025Acoustic Imaging for UAV Detection: Dense Beamformed Energy Maps and U-Net SELDcited by 0
- 2026PhysWave: Physics-Guided Latent Diffusion Models for Controllable Spatial Audio Generationcited by 0
- 2026RAO-Nav: Probing Omni-Language Models for Zero-shot Semantic Audio-Visual Navigationcited by 0
- 2026RAO-Nav: Probing Omni-Language Models for Zero-shot Semantic Audio-Visual Navigation26 Sep 2026
- 2026PhysWave: Physics-Guided Latent Diffusion Models for Controllable Spatial Audio Generation30 Aug 2026
- 2025Integrating Spatial and Semantic Embeddings for Stereo Sound Event Localization in Videos8 Sep 2025
- 2025Acoustic Imaging for UAV Detection: Dense Beamformed Energy Maps and U-Net SELD1 Aug 2025
- 2025Spatial and Semantic Embedding Integration for Stereo Sound Event Localization and Detection in Regular Videos7 Jul 2025
- 2025An Experimental Study on Joint Modeling for Sound Event Localization and Detection with Source Distance Estimation18 Jan 2025
- 2024TF-Mamba: A Time-Frequency Network for Sound Source Localization8 Sep 2024
- 2024Winner-takes-all learners are geometry-aware conditional density estimators7 Jun 2024
- 2024Audio Simulation for Sound Source Localization in Virtual Evironment2 Apr 2024
- 2023Resilient Multiple Choice Learning: A learned scoring scheme with application to audio scene analysis2 Nov 2023
- 2023Feature Aggregation in Joint Sound Classification and Localization Neural Networks29 Oct 2023
- 2023LocSelect: Target Speaker Localization with an Auditory Selective Hearing Mechanism16 Oct 2023
15 more
- 2023Dual input neural networks for positional sound source localization8 Aug 2023
- 2023Quaternion Convolutional Neural Networks: Current Advances and Future Directions17 Jul 2023
- 2023Sound Localization from Motion: Jointly Learning Sound Direction and Camera Rotation20 Mar 2023
- 2022MIMO-DoAnet: Multi-channel Input and Multiple Outputs DoA Network with Unknown Number of Sound Sources15 Jul 2022
- 2022Iterative Sound Source Localization for Unknown Number of Sources24 Jun 2022
- 2022Sound Localization by Self-Supervised Time Delay Estimation26 Apr 2022
- 2022Direction of Arrival Estimation of Sound Sources Using Icosahedral CNNs31 Mar 2022
- 2022Egocentric Deep Multi-Channel Audio-Visual Active Speaker Localization6 Jan 2022
- 2021DeepAoANet: Learning Angle of Arrival from Software Defined Radios with Deep Neural Networks1 Dec 2021
- 2021Spatial mixup: Directional loudness modification as data augmentation for sound event localization and detection12 Oct 2021
- 2021A Survey of Sound Source Localization with Deep Learning Methods8 Sep 2021
- 2021What Makes Sound Event Localization and Detection Difficult? Insights from Error Analysis22 Jul 2021
- 2021PILOT: Introducing Transformers for Probabilistic Sound Event Localization7 Jun 2021
- 2021Exploiting Attention-based Sequence-to-Sequence Architectures for Sound Event Localization28 Feb 2021
- 2021Data Fusion for Audiovisual Speaker Localization: Extending Dynamic Stream Weights to the Spatial Domain23 Feb 2021
- 2021A Survey of Sound Source Localization with Deep Learning Methodscited by 46
- 2022Egocentric Deep Multi-Channel Audio-Visual Active Speaker Localizationcited by 27
- 2022Sound Localization by Self-Supervised Time Delay Estimationcited by 18
- 2023Sound Localization from Motion: Jointly Learning Sound Direction and Camera Rotationcited by 18
- 2023Resilient Multiple Choice Learning: A learned scoring scheme with application to audio scene analysiscited by 12
- 2021PILOT: Introducing Transformers for Probabilistic Sound Event Localizationcited by 7
- 2021Exploiting Attention-based Sequence-to-Sequence Architectures for Sound Event Localizationcited by 6
- 2023LocSelect: Target Speaker Localization with an Auditory Selective Hearing Mechanismcited by 6
- 2024Winner-takes-all learners are geometry-aware conditional density estimatorscited by 6
- 2022MIMO-DoAnet: Multi-channel Input and Multiple Outputs DoA Network with Unknown Number of Sound Sourcescited by 4
- 2022Direction of Arrival Estimation of Sound Sources Using Icosahedral CNNscited by 3
- 2023Quaternion Convolutional Neural Networks: Current Advances and Future Directionscited by 3
12 most cited of 25 All 25 (JSON)
- 2026RAO-Nav: Probing Omni-Language Models for Zero-shot Semantic Audio-Visual Navigation26 Sep 2026
- 2025Integrating Spatial and Semantic Embeddings for Stereo Sound Event Localization in Videos8 Sep 2025
- 2025Acoustic Imaging for UAV Detection: Dense Beamformed Energy Maps and U-Net SELD1 Aug 2025
- 2025Spatial and Semantic Embedding Integration for Stereo Sound Event Localization and Detection in Regular Videos7 Jul 2025
- 2025An Experimental Study on Joint Modeling for Sound Event Localization and Detection with Source Distance Estimation18 Jan 2025
- 2024Winner-takes-all learners are geometry-aware conditional density estimators7 Jun 2024
- 2024Audio Simulation for Sound Source Localization in Virtual Evironment2 Apr 2024
- 2023Resilient Multiple Choice Learning: A learned scoring scheme with application to audio scene analysis2 Nov 2023
- 2023Feature Aggregation in Joint Sound Classification and Localization Neural Networks29 Oct 2023
- 2023LocSelect: Target Speaker Localization with an Auditory Selective Hearing Mechanism16 Oct 2023
- 2023Dual input neural networks for positional sound source localization8 Aug 2023
- 2023Quaternion Convolutional Neural Networks: Current Advances and Future Directions17 Jul 2023
12 newest of 25 All 25 (JSON)