mlsanityData to 14 Oct 2026

XLSR-Mamba: A Dual-Column Bidirectional State Space Model for Spoofing Attack Detection

arXiv 2411.10027 ↗First posted 15 Nov 2024eess.AS cs.SDcited by 30

On the map: State-space sequence models (S4, Mamba) → Speech and audio SSMs

Abstract (arXiv)

Transformers and their variants have achieved great success in speech processing. However, their multi-head self-attention mechanism is computationally expensive. Therefore, one novel selective state space model, Mamba, has been proposed as an alternative. Building on its success in automatic speech recognition, we apply Mamba for spoofing attack detection. Mamba is well-suited for this task as it can capture the artifacts in spoofed speech signals by handling long-length sequences. However, Mamba's performance may suffer when it is trained with limited labeled data. To mitigate this, we propose combining a new structure of Mamba based on a dual-column architecture with self-supervised learning, using the pre-trained wav2vec 2.0 model. The experiments show that our proposed approach achieves competitive results and faster inference on the ASVspoof 2021 LA and DF datasets, and on the more challenging In-the-Wild dataset, it emerges as the strongest candidate for spoofing attack detection. The code has been publicly released in https://github.com/swagshaw/XLSR-Mamba.

Key facts. Cited by 30 papers in the map (data through 14 Oct 2026). Placed in Speech and audio SSMs, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 24 of its 37 references that are in the map. First posted on arXiv 15 Nov 2024.

Builds on

24 of 37 references.

Closest ancestors · 3

Same direction, newest first

  1. 2024TF-Mamba: A Time-Frequency Network for Sound Source Localization8 Sep
  2. 2024RawBMamba: End-to-End Bidirectional State Space Model for Audio Deepfake Detection10 Jun
  3. 2024Mamba in Speech: Towards an Alternative to Self-Attention21 May

Other references · 21

  1. 2017Attention Is All You Needcited by 60,361
  2. 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
  3. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
  4. 2021Efficiently Modeling Long Sequences with Structured State Spacescited by 2,465
  5. 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,342
  6. 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
  7. 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 601
  8. 2021AASIST: Audio Anti-Spoofing using Integrated Spectro-Temporal Graph Attention Networkscited by 180
  9. 2020End-to-end anti-spoofing with RawNet2cited by 164
  10. 2021ASVspoof 2021: accelerating progress in spoofed and deepfake speech detectioncited by 161
  11. 2022Does Audio Deepfake Detection Generalize?cited by 135
  12. 2022Automatic speaker verification spoofing and deepfake detection using wav2vec 2.0 and data augmentationcited by 117
9 more
  1. 2020Voice Conversion Challenge 2020: Intra-lingual semi-parallel and cross-lingual voice conversioncited by 75
  2. 2021RawBoost: A Raw Data Boosting and Augmentation Method applied to Automatic Speaker Verification Anti-Spoofingcited by 67
  3. 2021ASVspoof 2019: spoofing countermeasures for the detection of synthesized, converted and replayed speechcited by 58
  4. 2023Audio Deepfake Detection with Self-Supervised WavLM and Multi-Fusion Attentive Classifiercited by 27
  5. 2024Temporal-Channel Modeling in Multi-head Self-Attention for Synthetic Speech Detectioncited by 25
  6. 2020Tandem Assessment of Spoofing Countermeasures and Automatic Speaker Verification: Fundamentalscited by 22
  7. 2024Mixture of Experts Fusion for Fake Audio Detection Using Frozen wav2vec 2.0cited by 20
  8. 2020The Attacker's Perspective on Automatic Speaker Verification: An Overviewcited by 19
  9. 2023Improving Short Utterance Anti-Spoofing with AASIST2cited by 11

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2025: 16; 2026: 14.

30 papers.

Sort:

By area:

  1. 2025Speech DF Arena: A Leaderboard for Speech DeepFake Detection Modelscited by 21
  2. 2025Nes2Net: A Lightweight Nested Architecture for Foundation Model Driven Speech Anti-spoofingcited by 19
  3. 2025Multilingual Source Tracing of Speech Deepfakes: A First Benchmarkcited by 7
  4. 2025Tell me Habibi, is it Real or Fake?cited by 6
  5. 2025Fake-Mamba: Real-Time Speech Deepfake Detection Using Bidirectional Mamba as Self-Attention's Alternativecited by 6
  6. 2025Unveiling Audio Deepfake Origins: A Deep Metric learning And Conformer Network Approach With Ensemble Fusioncited by 5
  7. 2026Do Compact SSL Backbones Matter for Audio Deepfake Detection? A Controlled Study with RAPTORcited by 4
  8. 2025WaveVerify: A Novel Audio Watermarking Framework for Media Authentication and Combatting Deepfakescited by 3
  9. 2025Multi-level SSL Feature Gating for Audio Deepfake Detectioncited by 3
  10. 2025Addressing Gradient Misalignment in Data-Augmented Training for Robust Speech Deepfake Detectioncited by 2
  11. 2025Evaluating Fake Music Detection Performance Under Audio Augmentationscited by 1
  12. 2025QAMO: Quality-aware Multi-centroid One-class Learning For Speech Deepfake Detectioncited by 1
18 more
  1. 2025Generalizable Speech Deepfake Detection via Information Bottleneck Enhanced Adversarial Alignmentcited by 1
  2. 2025SONAR: Spectral-Contrastive Audio Residuals for Generalizable Deepfake Detectioncited by 1
  3. 2026Investigating the Viability of Employing Multi-modal Large Language Models in the Context of Audio Deepfake Detectioncited by 1
  4. 2026XLSR-MamBo: Scaling the Hybrid Mamba-Attention Backbone for Audio Deepfake Detectioncited by 1
  5. 2026Teffic-Audio: Tell Fact from Fictioncited by 1
  6. 2026REIMU: Efficient Heterogeneous Hierarchical Reasoning for SSL-Based Speech Deepfake Detectioncited by 1
  7. 2025Keyword Mamba: Spoken Keyword Spotting with State Space Modelscited by 0
  8. 2025Multilingual Dataset Integration Strategies for Robust Audio Deepfake Detection: A SAFE Challenge Systemcited by 0
  9. 2025HuLA: Prosody-Aware Anti-Spoofing with Multi-Task Learning for Expressive and Emotional Synthetic Speechcited by 0
  10. 2026HyperPotter: Spell the Charm of High-Order Interactions in Audio Deepfake Detectioncited by 0
  11. 2026A SUPERB-Style Benchmark of Self-Supervised Speech Models for Audio Deepfake Detectioncited by 0
  12. 2026ICLAD: In-Context Learning with Comparison-Guidance for Audio Deepfake Detectioncited by 0
  13. 2026A Comparison of SSL-Based Feature Extractors and Back-End Classifiers for Spoofing Detection: A Multi-Corpus Training and Cross-Linguistic Analysiscited by 0
  14. 2026Speaker-Invariant Representation Learning for Spoofing Detection via Gradient Reversal and A Variational Information Bottleneckcited by 0
  15. 2026Linguistic Bias Mitigation for Spoofing Detection via Gradient Reversal and A Variational Information Bottleneckcited by 0
  16. 2026MADBench: A Benchmark for Modality-Aware Audio Deepfake Detectioncited by 0
  17. 2026Task-Aware Joint Pruning and Distillation for Efficient Audio Deepfake Detectioncited by 0
  18. 2026Adaptive Compression and Targeted Perturbation: A Unified Framework for Generalized Audio Deepfake Detectioncited by 0

Similar, not cited

Close in wording, no citation either way

  1. 2024Speech-Mamba: Long-Context Speech Recognition with Selective State Spaces Models
  2. 2024Mamba-based Decoder-Only Approach with Bidirectional Speech Modeling for Speech Recognition
  3. 2026Hidden State Poisoning Attacks against Mamba-based Language Models
  4. 2025SPBA: Utilizing Speech Large Language Model for Backdoor Attacks on Speech Classification Models
  5. 2023One-Class Knowledge Distillation for Spoofing Speech Detection
  6. 2024Exploring the Capability of Mamba in Speech Applications
  7. 2024Dual-path Mamba: Short and Long-term Bidirectional Selective Structured State Space Models for Speech Separation
  8. 2022Representation Selective Self-distillation and wav2vec 2.0 Feature Exploration for Spoof-aware Speaker Verification