# XLSR-Mamba: A Dual-Column Bidirectional State Space Model for Spoofing Attack Detection

arXiv: https://arxiv.org/abs/2411.10027 · HTML: https://mlsanity.com/paper/2411.10027/

## Key facts

- Cited by 30 papers in the map (data through 14 Oct 2026).
- Placed in Speech and audio SSMs, one of 10 directions in State-space sequence models (S4, Mamba).
- Builds on 24 of its 37 references that are in the map.
- First posted on arXiv 15 Nov 2024.

## Placed in

- State-space sequence models (S4, Mamba) / [Speech and audio SSMs](https://mlsanity.com/ssm/speech-and-audio-ssms/)

## Builds on (most cited first, 24 of 24)

- [Attention Is All You Need](https://mlsanity.com/paper/1706.03762/) (2017)
- [Mamba: Linear-Time Sequence Modeling with Selective State Spaces](https://mlsanity.com/paper/2312.00752/) (2023)
- [wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations](https://mlsanity.com/paper/2006.11477/) (2020)
- [Efficiently Modeling Long Sequences with Structured State Spaces](https://mlsanity.com/paper/2111.00396/) (2021)
- [HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units](https://mlsanity.com/paper/2106.07447/) (2021)
- [Conformer: Convolution-augmented Transformer for Speech Recognition](https://mlsanity.com/paper/2005.08100/) (2020)
- [XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scale](https://mlsanity.com/paper/2111.09296/) (2021)
- [AASIST: Audio Anti-Spoofing using Integrated Spectro-Temporal Graph Attention Networks](https://mlsanity.com/paper/2110.01200/) (2021)
- [End-to-end anti-spoofing with RawNet2](https://mlsanity.com/paper/2011.01108/) (2020)
- [ASVspoof 2021: accelerating progress in spoofed and deepfake speech detection](https://mlsanity.com/paper/2109.00537/) (2021)
- [Does Audio Deepfake Detection Generalize?](https://mlsanity.com/paper/2203.16263/) (2022)
- [Automatic speaker verification spoofing and deepfake detection using wav2vec 2.0 and data augmentation](https://mlsanity.com/paper/2202.12233/) (2022)
- [Voice Conversion Challenge 2020: Intra-lingual semi-parallel and cross-lingual voice conversion](https://mlsanity.com/paper/2008.12527/) (2020)
- [RawBoost: A Raw Data Boosting and Augmentation Method applied to Automatic Speaker Verification Anti-Spoofing](https://mlsanity.com/paper/2111.04433/) (2021)
- [Mamba in Speech: Towards an Alternative to Self-Attention](https://mlsanity.com/paper/2405.12609/) (2024)
- [ASVspoof 2019: spoofing countermeasures for the detection of synthesized, converted and replayed speech](https://mlsanity.com/paper/2102.05889/) (2021)
- [Audio Deepfake Detection with Self-Supervised WavLM and Multi-Fusion Attentive Classifier](https://mlsanity.com/paper/2312.08089/) (2023)
- [RawBMamba: End-to-End Bidirectional State Space Model for Audio Deepfake Detection](https://mlsanity.com/paper/2406.06086/) (2024)
- [Temporal-Channel Modeling in Multi-head Self-Attention for Synthetic Speech Detection](https://mlsanity.com/paper/2406.17376/) (2024)
- [Tandem Assessment of Spoofing Countermeasures and Automatic Speaker Verification: Fundamentals](https://mlsanity.com/paper/2007.05979/) (2020)
- [Mixture of Experts Fusion for Fake Audio Detection Using Frozen wav2vec 2.0](https://mlsanity.com/paper/2409.11909/) (2024)
- [The Attacker's Perspective on Automatic Speaker Verification: An Overview](https://mlsanity.com/paper/2004.08849/) (2020)
- [Improving Short Utterance Anti-Spoofing with AASIST2](https://mlsanity.com/paper/2309.08279/) (2023)
- [TF-Mamba: A Time-Frequency Network for Sound Source Localization](https://mlsanity.com/paper/2409.05034/) (2024)

## Built on by (most cited first, 30 of 30)

- [Speech DF Arena: A Leaderboard for Speech DeepFake Detection Models](https://mlsanity.com/paper/2509.02859/) (2025)
- [Nes2Net: A Lightweight Nested Architecture for Foundation Model Driven Speech Anti-spoofing](https://mlsanity.com/paper/2504.05657/) (2025)
- [Multilingual Source Tracing of Speech Deepfakes: A First Benchmark](https://mlsanity.com/paper/2508.04143/) (2025)
- [Tell me Habibi, is it Real or Fake?](https://mlsanity.com/paper/2505.22581/) (2025)
- [Fake-Mamba: Real-Time Speech Deepfake Detection Using Bidirectional Mamba as Self-Attention's Alternative](https://mlsanity.com/paper/2508.09294/) (2025)
- [Unveiling Audio Deepfake Origins: A Deep Metric learning And Conformer Network Approach With Ensemble Fusion](https://mlsanity.com/paper/2506.02085/) (2025)
- [Do Compact SSL Backbones Matter for Audio Deepfake Detection? A Controlled Study with RAPTOR](https://mlsanity.com/paper/2603.06164/) (2026)
- [WaveVerify: A Novel Audio Watermarking Framework for Media Authentication and Combatting Deepfakes](https://mlsanity.com/paper/2507.21150/) (2025)
- [Multi-level SSL Feature Gating for Audio Deepfake Detection](https://mlsanity.com/paper/2509.03409/) (2025)
- [Addressing Gradient Misalignment in Data-Augmented Training for Robust Speech Deepfake Detection](https://mlsanity.com/paper/2509.20682/) (2025)
- [Evaluating Fake Music Detection Performance Under Audio Augmentations](https://mlsanity.com/paper/2507.10447/) (2025)
- [QAMO: Quality-aware Multi-centroid One-class Learning For Speech Deepfake Detection](https://mlsanity.com/paper/2509.20679/) (2025)
- [Generalizable Speech Deepfake Detection via Information Bottleneck Enhanced Adversarial Alignment](https://mlsanity.com/paper/2509.23618/) (2025)
- [SONAR: Spectral-Contrastive Audio Residuals for Generalizable Deepfake Detection](https://mlsanity.com/paper/2511.21325/) (2025)
- [Investigating the Viability of Employing Multi-modal Large Language Models in the Context of Audio Deepfake Detection](https://mlsanity.com/paper/2601.00777/) (2026)
- [XLSR-MamBo: Scaling the Hybrid Mamba-Attention Backbone for Audio Deepfake Detection](https://mlsanity.com/paper/2601.02944/) (2026)
- [Teffic-Audio: Tell Fact from Fiction](https://mlsanity.com/paper/2607.28351/) (2026)
- [REIMU: Efficient Heterogeneous Hierarchical Reasoning for SSL-Based Speech Deepfake Detection](https://mlsanity.com/paper/2608.00857/) (2026)
- [Keyword Mamba: Spoken Keyword Spotting with State Space Models](https://mlsanity.com/paper/2508.07363/) (2025)
- [Multilingual Dataset Integration Strategies for Robust Audio Deepfake Detection: A SAFE Challenge System](https://mlsanity.com/paper/2508.20983/) (2025)
- [HuLA: Prosody-Aware Anti-Spoofing with Multi-Task Learning for Expressive and Emotional Synthetic Speech](https://mlsanity.com/paper/2509.21676/) (2025)
- [HyperPotter: Spell the Charm of High-Order Interactions in Audio Deepfake Detection](https://mlsanity.com/paper/2602.05670/) (2026)
- [A SUPERB-Style Benchmark of Self-Supervised Speech Models for Audio Deepfake Detection](https://mlsanity.com/paper/2603.01482/) (2026)
- [ICLAD: In-Context Learning with Comparison-Guidance for Audio Deepfake Detection](https://mlsanity.com/paper/2604.16749/) (2026)
- [A Comparison of SSL-Based Feature Extractors and Back-End Classifiers for Spoofing Detection: A Multi-Corpus Training and Cross-Linguistic Analysis](https://mlsanity.com/paper/2606.08669/) (2026)
- [Speaker-Invariant Representation Learning for Spoofing Detection via Gradient Reversal and A Variational Information Bottleneck](https://mlsanity.com/paper/2606.08678/) (2026)
- [Linguistic Bias Mitigation for Spoofing Detection via Gradient Reversal and A Variational Information Bottleneck](https://mlsanity.com/paper/2606.31411/) (2026)
- [MADBench: A Benchmark for Modality-Aware Audio Deepfake Detection](https://mlsanity.com/paper/2608.09593/) (2026)
- [Task-Aware Joint Pruning and Distillation for Efficient Audio Deepfake Detection](https://mlsanity.com/paper/2610.05264/) (2026)
- [Adaptive Compression and Targeted Perturbation: A Unified Framework for Generalized Audio Deepfake Detection](https://mlsanity.com/paper/2610.16049/) (2026)

## Abstract (arXiv)

Transformers and their variants have achieved great success in speech processing. However, their multi-head self-attention mechanism is computationally expensive. Therefore, one novel selective state space model, Mamba, has been proposed as an alternative. Building on its success in automatic speech recognition, we apply Mamba for spoofing attack detection. Mamba is well-suited for this task as it can capture the artifacts in spoofed speech signals by handling long-length sequences. However, Mamba's performance may suffer when it is trained with limited labeled data. To mitigate this, we propose combining a new structure of Mamba based on a dual-column architecture with self-supervised learning, using the pre-trained wav2vec 2.0 model. The experiments show that our proposed approach achieves competitive results and faster inference on the ASVspoof 2021 LA and DF datasets, and on the more challenging In-the-Wild dataset, it emerges as the strongest candidate for spoofing attack detection. The code has been publicly released in https://github.com/swagshaw/XLSR-Mamba.