SelectTSL: Prompt-Guided Selective Target Sound Localization in Complex Scenarios
Not on the map. Why?
Abstract (arXiv)
Humans can selectively attend to a target sound and estimate its direction in complex scenarios, whereas such selective localization remains challenging for current deep learning-based systems. Sound source localization (SSL) has achieved remarkable success with deep learning, yet most methods localize all active sources without selectivity. Conversely, target sound extraction (TSE) extracts sources using multimodal prompts but typically fails to preserve the multichannel spatial information required for accurate localization. To bridge this gap, we formulate the task of prompt-guided selective target sound localization and propose SelectTSL, an end-to-end architecture that localizes only the user-specified target in multi-source acoustic scenes. Specifically, we design a target-aware selective localization strategy that employs a Prompt-Guided Selective Attention Module (PGSA) to generate prompt-informed embeddings. These embeddings guide an inter-channel phase difference (IPD) enhancer to refine raw phase cues, fusing with target magnitudes to jointly estimate direction of arrival (DoA) and target-source cardinality, i.e., the number of target sound sources. This coupled design effectively focuses on the user-specified target spatial cues for selective localization and also handles time-varying numbers of target sources. Extensive experiments on both synthetic data and real-world recordings demonstrate that our proposed method consistently outperforms other baselines and exhibits robust generalization to real acoustic environments.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Builds on 60 of its 76 references that are in the map. First posted on arXiv 2 Jul 2026.
Builds on
60 of 76 references.
References · 60
- 2024Qwen2 Technical Reportcited by 2,120
- 2022Large-scale Contrastive Language-Audio Pretraining with Feature Fusion and Keyword-to-Caption Augmentationcited by 719
- 2015MUSAN: A Music, Speech, and Noise Corpuscited by 425
- 2018Conv-TasNet: Surpassing Ideal Time-Frequency Magnitude Masking for Speech Separationcited by 406
- 2018Deep Audio-Visual Speech Recognitioncited by 322
- 2023WavCaps: A ChatGPT-Assisted Weakly-Labelled Audio Captioning Dataset for Audio-Language Multimodal Researchcited by 267
- 2019Dual-path RNN: efficient long sequence modeling for time-domain single-channel speech separationcited by 182
- 2019WHAM!: Extending Speech Separation to Noisy Environmentscited by 156
- 2020The INTERSPEECH 2020 Deep Noise Suppression Challenge: Datasets, Subjective Testing Framework, and Challenge Resultscited by 133
- 2018Sound Event Localization and Detection of Overlapping Sources Using Convolutional Recurrent Neural Networkscited by 85
- 2018VoiceFilter: Targeted Voice Separation by Speaker-Conditioned Spectrogram Maskingcited by 73
- 2022TF-GridNet: Integrating Full- and Sub-Band Modeling for Speech Separationcited by 63
38 more
- 2018gpuRIR: A Python Library for Room Impulse Response Simulation with GPU Accelerationcited by 46
- 2021A Survey of Sound Source Localization with Deep Learning Methodscited by 46
- 2022Separate What You Describe: Language-Queried Audio Source Separationcited by 45
- 2023Separate Anything You Describecited by 43
- 2019Learning to Localize Sound Sources in Visual Scenes: Analysis and Applicationscited by 31
- 2020Overview and Evaluation of Sound Event Localization and Detection in DCASE 2019cited by 31
- 2020SpEx: Multi-Scale Time Domain Speaker Extraction Networkcited by 30
- 2021Zero-shot Audio Source Separation through Query-based Learning from Weakly-labeled Datacited by 27
- 2020ACCDOA: Activity-Coupled Cartesian Direction of Arrival Representation for Sound Event Localization and Detectioncited by 26
- 2020An Improved Event-Independent Network for Polyphonic Sound Event Localization and Detectioncited by 25
- 2021Multi-ACCDOA: Localizing and Detecting Overlapping Sounds from the Same Class with Auxiliary Duplicating Permutation Invariant Trainingcited by 25
- 2022CLIPSep: Learning Text-queried Sound Separation with Noisy Unlabeled Videoscited by 23
- 2020A Dataset of Reverberant Spatial Sound Scenes with Moving Sources for Sound Event Localization and Detectioncited by 21
- 2016A metric on the space of finite sets of trajectories for evaluation of multi-target tracking algorithmscited by 17
- 2022STARSS22: A dataset of spatial recordings of real scenes with spatiotemporal annotations of sound eventscited by 16
- 2021SALSA: Spatial Cue-Augmented Log-Spectrogram Features for Polyphonic Sound Event Localization and Detectioncited by 15
- 2021USEV: Universal Speaker Extraction with Visual Cuecited by 11
- 2018Multi-Speaker DOA Estimation Using Deep Convolutional Networks Trained with Noise Signalscited by 10
- 2019Localization, Detection and Tracking of Multiple Moving Sound Sources with a Convolutional Recurrent Neural Networkcited by 10
- 2021SALSA-Lite: A Fast and Effective Feature for Polyphonic Sound Event Localization and Detection with Microphone Arrayscited by 10
- 2023FN-SSL: Full-Band and Narrow-Band Fusion for Sound Source Localizationcited by 10
- 2020Event-Independent Network for Polyphonic Sound Event Localization and Detectioncited by 9
- 2022An Audio-Visual Speech Separation Model Inspired by Cortico-Thalamo-Cortical Circuitscited by 9
- 2024CLAPSep: Leveraging Contrastive Pre-trained Model for Multi-Modal Query-Conditioned Target Sound Extractioncited by 9
- 2021Differentiable Tracking-Based Training of Deep Learning Sound Source Localizerscited by 8
- 2023CST-former: Transformer with Channel-Spectro-Temporal Attention for Sound Event Localization and Detectioncited by 8
- 2023X-SepFormer: End-to-end Speaker Extraction Network with Explicit Optimization on Speaker Confusioncited by 6
- 2023Two vs. Four-Channel Sound Event Localization and Detectioncited by 6
- 2023LocSelect: Target Speaker Localization with an Auditory Selective Hearing Mechanismcited by 6
- 2022SRP-DNN: Learning Direct-Path Phase Difference for Multiple Moving Sound Source Localizationcited by 5
- 2022Towards Unified All-Neural Beamforming for Time and Frequency Domain Speech Separationcited by 5
- 2025Microphone Array Signal Processing and Deep Learning for Speech Enhancementcited by 5
- 2021SALADnet: Self-Attentive multisource Localization in the Ambisonics Domaincited by 4
- 2022MIMO-DoAnet: Multi-channel Input and Multiple Outputs DoA Network with Unknown Number of Sound Sourcescited by 4
- 2024Leveraging Audio-Only Data for Text-Queried Target Sound Extractioncited by 4
- 2025Stereo Sound Event Localization and Detection with Onscreen/offscreen Classificationcited by 4
- 2022Sound Event Localization and Detection for Real Spatial Sound Scenes: Event-Independent Network and Data Augmentation Chainscited by 3
- 2023Zero- and Few-shot Sound Event Localization and Detectioncited by 3
50 most cited of 60 All 60 (JSON)
Built on by
Citing papers per year: 2026: 1.
1 paper.