SoundCompass: Navigating Target Sound Extraction With Effective Directional Clue Integration In Complex Acoustic Scenes
Not on the map. Why?
Abstract (arXiv)
Recent advances in target sound extraction (TSE) utilize directional clues derived from direction of arrival (DoA), which represent an inherent spatial property of sound available in any acoustic scene. However, previous DoA-based methods rely on hand-crafted features or discrete encodings, which lose fine-grained spatial information and limit adaptability. We propose SoundCompass, an effective directional clue integration framework centered on a Spectral Pairwise INteraction (SPIN) module that captures cross-channel spatial correlations in the complex spectrogram domain to preserve full spatial information in multichannel signals. The input feature expressed in terms of spatial correlations is fused with a DoA clue represented as spherical harmonics (SH) encoding. The fusion is carried out across overlapping frequency subbands, inheriting the benefits reported in the previous band-split architectures. We also incorporate the iterative refinement strategy, chain-of-inference (CoI), in the TSE framework, which recursively fuses DoA with sound event activation estimated from the previous inference stage. Experiments demonstrate that SoundCompass, combining SPIN, SH embedding, and CoI, robustly extracts target sources across diverse signal classes and spatial configurations.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 22 of its 30 references that are in the map. First posted on arXiv 23 Sep 2025.
Builds on
22 of 30 references.
References · 22
- 2017FiLM: Visual Reasoning with a General Conditioning Layercited by 2,333
- 2018SDR - half-baked or well done?cited by 423
- 2019Understanding and Improving Layer Normalizationcited by 217
- 2022Music Source Separation with Band-split RNNcited by 70
- 2018gpuRIR: A Python Library for Room Impulse Response Simulation with GPU Accelerationcited by 46
- 2023Neural Target Speech Extraction: An Overviewcited by 33
- 2020Listen to What You Want: Neural Network-based Universal Sound Selectorcited by 27
- 2023Semantic Hearing: Programming Acoustic Scenes with Binaural Hearablescited by 11
- 2023Multi-channel Speech Separation Using Spatially Selective Deep Non-linear Filterscited by 10
- 2023ReZero: Region-customizable Sound Extractioncited by 10
- 2024CLAPSep: Leveraging Contrastive Pre-trained Model for Multi-Modal Query-Conditioned Target Sound Extractioncited by 9
- 2022ConceptBeam: Concept Driven Target Speech Extractioncited by 8
10 more
- 2023A Generalized Bandsplit Neural Network for Cinematic Audio Source Separationcited by 8
- 2024A Stem-Agnostic Single-Decoder System for Music Source Separation Beyond Four Stemscited by 7
- 2024All Neural Low-latency Directional Speech Extractioncited by 7
- 2023Target Sound Extraction with Variable Cross-modality Cluescited by 6
- 2024Interaural time difference loss for binaural target sound extractioncited by 3
- 2024Language-Queried Target Sound Extraction Without Parallel Training Datacited by 3
- 2024Multichannel-to-Multichannel Target Sound Extraction Using Direction and Timestamp Cluescited by 2
- 2025End-to-End DOA-Guided Speech Extraction in Noisy Multi-Talker Scenarioscited by 2
- 2025Self-Guided Target Sound Extraction and Classification Through Universal Sound Separation Model and Multiple Cluescited by 1
- 2025DeepASA: An Object-Oriented Multi-Purpose Network for Auditory Scene Analysiscited by 1
Built on by
Not cited yet.