XLSR-MamBo: Scaling the Hybrid Mamba-Attention Backbone for Audio Deepfake Detection
On the map: State-space sequence models (S4, Mamba) → Speech and audio SSMs
Abstract (arXiv)
Advanced speech synthesis technologies have enabled highly realistic speech generation, posing security risks that motivate research into audio deepfake detection (ADD). While state space models (SSMs) offer linear complexity, pure causal SSMs architectures often struggle with the content-based retrieval required to capture global frequency-domain artifacts. To address this, we explore the scaling properties of hybrid architectures by proposing XLSR-MamBo, a modular framework integrating an XLSR front-end with synergistic Mamba-Attention backbones. We systematically evaluate four topological designs using advanced SSM variants, Mamba, Mamba2, Hydra, and Gated DeltaNet. Experimental results demonstrate that the MamBo-3-Hydra-N3 configuration achieves competitive performance compared to other state-of-the-art systems on the ASVspoof 2021 LA, DF, and In-the-Wild benchmarks. This performance benefits from Hydra's native bidirectional modeling, which captures holistic temporal dependencies more efficiently than the heuristic dual-branch strategies employed in prior works. Furthermore, evaluations on the DFADD dataset demonstrate robust generalization to unseen diffusion- and flow-matching-based synthesis methods. Crucially, our analysis reveals that scaling backbone depth effectively mitigates the performance variance and instability observed in shallower models. These results demonstrate the hybrid framework's ability to capture artifacts in spoofed speech signals, providing an effective method for ADD.
Key facts. Cited by 1 paper in the map (data through 14 Oct 2026). Placed in Speech and audio SSMs, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 33 of its 48 references that are in the map. First posted on arXiv 6 Jan 2026.
Builds on
33 of 48 references.
Closest ancestors · 5
Same direction, newest first
- 2025Fake-Mamba: Real-Time Speech Deepfake Detection Using Bidirectional Mamba as Self-Attention's Alternative12 Aug
- 2025BiCrossMamba-ST: Speech Deepfake Detection with Bidirectional Mamba Spectro-Temporal Cross-Attention20 May
- 2024XLSR-Mamba: A Dual-Column Bidirectional State Space Model for Spoofing Attack Detection15 Nov
- 2024RawBMamba: End-to-End Bidirectional State Space Model for Audio Deepfake Detection10 Jun
- 2024Mamba in Speech: Towards an Alternative to Self-Attention21 May
Other references · 28
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2022FlashAttention: Fast and Memory-Efficient Exact Attention with IO-Awarenesscited by 3,673
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
- 2020GLU Variants Improve Transformercited by 1,804
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
- 2019Root Mean Square Layer Normalizationcited by 1,480
- 2024Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Dualitycited by 1,336
- 2022In-context Learning and Induction Headscited by 964
- 2020On Layer Normalization in the Transformer Architecturecited by 922
- 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 601
- 2024Gated Delta Networks: Improving Mamba2 with Delta Rulecited by 532
16 more
- 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 504
- 2024Simple linear attention language models balance the recall-throughput tradeoffcited by 208
- 2024XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Modelcited by 179
- 2024Samba: Simple Hybrid State Space Models for Efficient Unlimited Context Language Modelingcited by 174
- 2021ASVspoof 2021: accelerating progress in spoofed and deepfake speech detectioncited by 161
- 2024Zamba: A Compact 7B SSM Hybrid Modelcited by 124
- 2024Can Mamba Learn How to Learn? A Comparative Study on In-Context Learning Taskscited by 105
- 2021RawBoost: A Raw Data Boosting and Augmentation Method applied to Automatic Speaker Verification Anti-Spoofingcited by 67
- 2024Hydra: Bidirectional State Space Models Through Generalized Matrix Mixerscited by 44
- 2023AI-Synthesized Voice Detection Using Neural Vocoder Artifactscited by 41
- 2024A Survey on Speech Deepfake Detectioncited by 27
- 2024DFADD: The Diffusion and Flow-Matching Based Audio Deepfake Datasetcited by 20
- 2024People are poorly equipped to detect AI-powered voice clonescited by 13
- 2025Forensic deepfake audio detection using segmental speech featurescited by 8
- 2025Mesh-Attention: A New Communication-Efficient Distributed Attention with Improved Data Localitycited by 2
- 2025XLSR-Kanformer: A KAN-Intergrated model for Synthetic Speech Detectioncited by 1
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2026Task-Aware Joint Pruning and Distillation for Efficient Audio Deepfake Detection
- 2025WaveSP-Net: Learnable Wavelet-Domain Sparse Prompt Tuning for Speech Deepfake Detection
- 2026Interpretable All-Type Audio Deepfake Detection with Audio LLMs via Frequency-Time Reinforcement Learning
- 2025SAM: A Mamba-2 State-Space Audio-Language Model
- 2025AUDETER: A Large-scale Dataset for Deepfake Audio Detection in Open Worlds
- 2026FoeGlass: Simple In-Context Learning Is Enough for Red Teaming Audio Deepfake Detectors
- 2025Mixture of Low-Rank Adapter Experts in Generalizable Audio Deepfake Detection
- 2026HELIX: Scaling Raw Audio Understanding with Hybrid Mamba-Attention Beyond the Quadratic Limit