mlsanityData to 7 Oct 2026

TF-Mamba: A Time-Frequency Network for Sound Source Localization

arXiv 2409.05034 ↗First posted 8 Sep 2024eess.AS cs.SDcited by 5

On the map: State-space sequence models (S4, Mamba) → Speech and audio SSMs

Abstract (arXiv)

Sound source localization (SSL) determines the position of sound sources using multi-channel audio data. It is commonly used to improve speech enhancement and separation. Extracting spatial features is crucial for SSL, especially in challenging acoustic environments. Recently, a novel structure referred to as Mamba demonstrated notable performance across various sequence-based modalities. This study introduces the Mamba for SSL tasks. We consider the Mamba-based model to analyze spatial features from speech signals by fusing both time and frequency features, and we develop an SSL system called TF-Mamba. This system integrates time and frequency fusion, with Bidirectional Mamba managing both time-wise and frequency-wise processing. We conduct the experiments on the simulated and real datasets. Experiments show that TF-Mamba significantly outperforms other advanced methods. The code will be publicly released in due course.

Key facts. Cited by 5 papers in the map (data through 7 Oct 2026). Placed in Speech and audio SSMs, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 27 of its 45 references that are in the map. First posted on arXiv 8 Sep 2024.

Builds on

27 of 45 references.

Closest ancestors · 6

Same direction, newest first

  1. 2024RawBMamba: End-to-End Bidirectional State Space Model for Audio Deepfake Detection10 Jun
  2. 2024Audio Mamba: Bidirectional State Space Model for Audio Representation Learning5 Jun
  3. 2024Mamba in Speech: Towards an Alternative to Self-Attention21 May
  4. 2024SSAMBA: Self-Supervised Audio Representation Learning with Mamba State Space Model20 May
  5. 2024An Investigation of Incorporating Mamba for Speech Enhancement10 May
  6. 2024Dual-path Mamba: Short and Long-term Bidirectional Selective Structured State Space Models for Speech Separation27 Mar

Other references · 21

  1. 2016Densely Connected Convolutional Networkscited by 6,691
  2. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,616
  3. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,424
  4. 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,051
  5. 2022On the Parameterization and Initialization of Diagonal State Space Modelscited by 418
  6. 2024Jamba: A Hybrid Transformer-Mamba Language Modelcited by 390
  7. 2018Sound Event Localization and Detection of Overlapping Sources Using Convolutional Recurrent Neural Networkscited by 84
  8. 2018gpuRIR: A Python Library for Room Impulse Response Simulation with GPU Accelerationcited by 46
  9. 2021A Survey of Sound Source Localization with Deep Learning Methodscited by 45
  10. 2024Multichannel Long-Term Streaming Neural Speech Enhancement for Static and Moving Speakerscited by 28
  11. 2017Direction of arrival estimation for multiple sound sources using convolutional recurrent neural networkcited by 27
  12. 2020ADL-MVDR: All deep learning MVDR beamformer for target speech separationcited by 20
9 more
  1. 2022STARSS22: A dataset of spatial recordings of real scenes with spatiotemporal annotations of sound eventscited by 16
  2. 2020Robust Sound Source Tracking Using SRP-PHAT and 3D Convolutional Neural Networkscited by 15
  3. 2021SALSA-Lite: A Fast and Effective Feature for Polyphonic Sound Event Localization and Detection with Microphone Arrayscited by 10
  4. 2023FN-SSL: Full-Band and Narrow-Band Fusion for Sound Source Localizationcited by 10
  5. 2018Deep Residual Network for Sound Source Localization in the Time Domaincited by 5
  6. 2022SRP-DNN: Learning Direct-Path Phase Difference for Multiple Moving Sound Source Localizationcited by 5
  7. 2019Exploiting Deep Neural Networks and Head Movements for Robust Binaural Localisation of Multiple Sources in Reverberant Environmentscited by 3
  8. 2024Dual Knowledge Distillation for Efficient Sound Event Detectioncited by 2
  9. 2024Where's That Voice Coming? Continual Learning for Sound Source Localizationcited by 1

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2024: 1; 2025: 3; 2026: 1.

5 papers.

  1. 2024XLSR-Mamba: A Dual-Column Bidirectional State Space Model for Spoofing Attack Detectioncited by 27
  2. 2025Deep Active Speech Cancellation with Mamba-Masking Networkcited by 2
  3. 2026Autoregressive Guidance of Deep Spatially Selective Filters using Bayesian Tracking for Efficient Extraction of Moving Speakerscited by 1
  4. 2025Active Speech Enhancement: Active Speech Denoising Decliping and Deveraberationcited by 0
  5. 2025ESTM: An Enhanced Dual-Branch Spectral-Temporal Mamba for Anomalous Sound Detectioncited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024SELD-Mamba: Selective State-Space Model for Sound Event Localization and Detection with Source Distance Estimation
  2. 2026Omni-directional attention mechanism based on Mamba for speech separation
  3. 2025State Space and Self-Attention Collaborative Network with Feature Aggregation for DOA Estimation
  4. 2024Leveraging Joint Spectral and Spatial Learning with MAMBA for Multichannel Speech Enhancement
  5. 2025Mamba2 Meets Silence: Robust Vocal Source Separation for Sparse Regions
  6. 2024Exploring the Capability of Mamba in Speech Applications
  7. 2024Mamba-SEUNet: Mamba UNet for Monaural Speech Enhancement
  8. 2024Speech-Mamba: Long-Context Speech Recognition with Selective State Spaces Models