Reverberant Sound Localization with a Robot Head Based on Direct-Path Relative Transfer Function
Not on the map. Why?
Abstract (arXiv)
This paper addresses the problem of sound-source localization (SSL) with a robot head, which remains a challenge in real-world environments. In particular we are interested in locating speech sources, as they are of high interest for human-robot interaction. The microphone-pair response corresponding to the direct-path sound propagation is a function of the source direction. In practice, this response is contaminated by noise and reverberations. The direct-path relative transfer function (DP-RTF) is defined as the ratio between the direct-path acoustic transfer function (ATF) of the two microphones, and it is an important feature for SSL. We propose a method to estimate the DP-RTF from noisy and reverberant signals in the short-time Fourier transform (STFT) domain. First, the convolutive transfer function (CTF) approximation is adopted to accurately represent the impulse response of the microphone array, and the first coefficient of the CTF is mainly composed of the direct-path ATF. At each frequency, the frame-wise speech auto- and cross-power spectral density (PSD) are obtained by spectral subtraction. Then a set of linear equations is constructed by the speech auto- and cross-PSD of multiple frames, in which the DP-RTF is an unknown variable, and is estimated by solving the equations. Finally, the estimated DP-RTFs are concatenated across frequencies and used as a feature vector for SSL. Experiments with a robot, placed in various reverberant environments, show that the proposed method outperforms two state-of-the-art methods.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). First posted on arXiv 7 Dec 2020.
Builds on
No reference list yet.
Built on by
Citing papers per year: 2021: 2; 2022: 1; 2023: 2; 2024: 1.
6 papers.
- 2021A Survey of Sound Source Localization with Deep Learning Methodscited by 46
- 2024Learning to Visually Localize Sound Sources from Mixtures without Prior Source Knowledgecited by 14
- 2022Extending GCC-PHAT using Shift Equivariant Neural Networkscited by 7
- 2023Audio-Visual Spatial Integration and Recursive Attention for Robust Sound Source Localizationcited by 5
- 2021AcousticFusion: Fusing Sound Source Localization to Visual SLAM in Dynamic Environmentscited by 2
- 2023Feature Aggregation in Joint Sound Classification and Localization Neural Networkscited by 0
- 2024Learning to Visually Localize Sound Sources from Mixtures without Prior Source Knowledge26 Mar 2024
- 2023Feature Aggregation in Joint Sound Classification and Localization Neural Networks29 Oct 2023
- 2023Audio-Visual Spatial Integration and Recursive Attention for Robust Sound Source Localization11 Aug 2023
- 2022Extending GCC-PHAT using Shift Equivariant Neural Networks9 Aug 2022
- 2021A Survey of Sound Source Localization with Deep Learning Methods8 Sep 2021
- 2021AcousticFusion: Fusing Sound Source Localization to Visual SLAM in Dynamic Environments3 Aug 2021