Fake-Mamba: Real-Time Speech Deepfake Detection Using Bidirectional Mamba as Self-Attention's Alternative
On the map: State-space sequence models (S4, Mamba) → Speech and audio SSMs
Abstract (arXiv)
Advances in speech synthesis intensify security threats, motivating real-time deepfake detection research. We investigate whether bidirectional Mamba can serve as a competitive alternative to Self-Attention in detecting synthetic speech. Our solution, Fake-Mamba, integrates an XLSR front-end with bidirectional Mamba to capture both local and global artifacts. Our core innovation introduces three efficient encoders: TransBiMamba, ConBiMamba, and PN-BiMamba. Leveraging XLSR's rich linguistic representations, PN-BiMamba can effectively capture the subtle cues of synthetic speech. Evaluated on ASVspoof 21 LA, 21 DF, and In-The-Wild benchmarks, Fake-Mamba achieves 0.97%, 1.74%, and 5.85% EER, respectively, representing substantial relative gains over SOTA models XLSR-Conformer and XLSR-Mamba. The framework maintains real-time inference across utterance lengths, demonstrating strong generalization and practical viability. The code is available at https://github.com/xuanxixi/Fake-Mamba.
Key facts. Cited by 6 papers in the map (data through 14 Oct 2026). Placed in Speech and audio SSMs, one of 10 directions in State-space sequence models (S4, Mamba). Builds on 44 of its 68 references that are in the map. First posted on arXiv 12 Aug 2025.
Builds on
44 of 68 references.
Closest ancestors · 13
Same direction, newest first
- 2024XLSR-Mamba: A Dual-Column Bidirectional State Space Model for Spoofing Attack Detection15 Nov
- 2024SepMamba: State-space models for speaker separation using Mamba28 Oct
- 2024Mamba-based Segmentation Model for Speaker Diarization9 Oct
- 2024Speech-Mamba: Long-Context Speech Recognition with Selective State Spaces Models27 Sep
- 2024DeFT-Mamba: Universal Multichannel Sound Separation and Polyphonic Audio Classification19 Sep
- 2024Leveraging Joint Spectral and Spatial Learning with MAMBA for Multichannel Speech Enhancement16 Sep
- 2024RawBMamba: End-to-End Bidirectional State Space Model for Audio Deepfake Detection10 Jun
- 2024Audio Mamba: Bidirectional State Space Model for Audio Representation Learning5 Jun
- 2024Audio Mamba: Selective State Spaces for Self-Supervised Audio Representations4 Jun
- 2024Mamba in Speech: Towards an Alternative to Self-Attention21 May
- 2024SSAMBA: Self-Supervised Audio Representation Learning with Mamba State Space Model20 May
- 2024An Investigation of Incorporating Mamba for Speech Enhancement10 May
1 more
Other references · 31
- 2017Attention Is All You Needcited by 60,361
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,718
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,905
- 2020Conformer: Convolution-augmented Transformer for Speech Recognitioncited by 1,863
- 2024Vision Mamba: Efficient Visual Representation Learning with Bidirectional State Space Modelcited by 1,056
- 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 601
- 2024An Empirical Study of Mamba-based Language Modelscited by 186
- 2021ASVspoof 2021: accelerating progress in spoofed and deepfake speech detectioncited by 161
- 2022Does Audio Deepfake Detection Generalize?cited by 135
- 2024Is Mamba Effective for Time Series Forecasting?cited by 114
- 2024Cobra: Extending Mamba to Multi-Modal Large Language Model for Efficient Inferencecited by 97
- 2021RawBoost: A Raw Data Boosting and Augmentation Method applied to Automatic Speaker Verification Anti-Spoofingcited by 67
19 more
- 2018An Analysis of the t-SNE Algorithm for Data Visualizationcited by 49
- 2021Investigating self-supervised front ends for speech spoofing countermeasurescited by 46
- 2024Codec-SUPERB: An In-Depth Analysis of Sound Codec Modelscited by 26
- 2024Temporal-Channel Modeling in Multi-head Self-Attention for Synthetic Speech Detectioncited by 25
- 2021fairseq S^2: A Scalable and Integrable Speech Synthesis Toolkitcited by 24
- 2024DFADD: The Diffusion and Flow-Matching Based Audio Deepfake Datasetcited by 20
- 2022Revisiting Checkpoint Averaging for Neural Machine Translationcited by 13
- 2024Improving Speech Emotion Recognition in Under-Resourced Languages via Speech-to-Speech Translation with Bootstrapping Data Selectioncited by 10
- 2025FreCT: Frequency-augmented Convolutional Transformer for Robust Time Series Anomaly Detectioncited by 10
- 2023HM-Conformer: A Conformer-based audio deepfake detection system with hierarchical pooling and multi-level classification token aggregation methodscited by 8
- 2024EMO-Codec: An In-Depth Look at Emotion Preservation capacity of Legacy and Neural Codec Models With Subjective and Objective Evaluationscited by 8
- 2025Multilingual Source Tracing of Speech Deepfakes: A First Benchmarkcited by 7
- 2024How to Learn a New Language? An Efficient Solution for Self-Supervised Learning Models Unseen Languages Adaption in Low-Resource Scenariocited by 5
- 2025BreezyVoice: Adapting TTS for Taiwanese Mandarin with Enhanced Polyphone Disambiguation -- Challenges and Insightscited by 5
- 2025Decomposition-based multi-scale transformer framework for time series anomaly detectioncited by 5
- 2024Enhancing Zero-Shot Multi-Speaker TTS with Negated Speaker Representationscited by 3
- 2025Improved Feature Extraction Network for Neuro-Oriented Target Speaker Extractioncited by 3
- 2025PrimeK-Net: Multi-scale Spectral Learning via Group Prime-Kernel Convolutional Neural Networks for Single Channel Speech Enhancementcited by 2
- 2025Addressing Noise and Stochasticity in Fraud Detection for Service Networkscited by 2
Built on by
Citing papers per year: 2025: 1; 2026: 5.
6 papers.
- 2025WaveSP-Net: Learnable Wavelet-Domain Sparse Prompt Tuning for Speech Deepfake Detectioncited by 5
- 2026WaveScat: Wavelet Scattering Front-Ends with Self-Supervised Features for Speech Deepfake Detectioncited by 3
- 2026XLSR-MamBo: Scaling the Hybrid Mamba-Attention Backbone for Audio Deepfake Detectioncited by 1
- 2026Disentangling Speaker Traits for Deepfake Source Verification via Chebyshev Polynomial and Riemannian Metric Learningcited by 1
- 2026Quantizer-Aware Hierarchical Neural Codec Modeling for Speech Deepfake Detectioncited by 0
- 2026HKJudge: A Legal Discourse-Annotated Corpus for Interpreting What Courts Find, How They Reason, and What They Rulecited by 0
- 2026HKJudge: A Legal Discourse-Annotated Corpus for Interpreting What Courts Find, How They Reason, and What They Rule4 Jun 2026
- 2026Disentangling Speaker Traits for Deepfake Source Verification via Chebyshev Polynomial and Riemannian Metric Learning23 Mar 2026
- 2026Quantizer-Aware Hierarchical Neural Codec Modeling for Speech Deepfake Detection10 Mar 2026
- 2026WaveScat: Wavelet Scattering Front-Ends with Self-Supervised Features for Speech Deepfake Detection3 Feb 2026
- 2026XLSR-MamBo: Scaling the Hybrid Mamba-Attention Backbone for Audio Deepfake Detection6 Jan 2026
- 2025WaveSP-Net: Learnable Wavelet-Domain Sparse Prompt Tuning for Speech Deepfake Detection6 Oct 2025
Similar, not cited
Close in wording, no citation either way
- 2025BiCrossMamba-ST: Speech Deepfake Detection with Bidirectional Mamba Spectro-Temporal Cross-Attention
- 2024Speech Slytherin: Examining the Performance and Efficiency of Mamba for Speech Separation, Recognition, and Synthesis
- 2025AUDETER: A Large-scale Dataset for Deepfake Audio Detection in Open Worlds
- 2026MADBench: A Benchmark for Modality-Aware Audio Deepfake Detection
- 2026Task-Aware Joint Pruning and Distillation for Efficient Audio Deepfake Detection
- 2026Eroding Trust in Real Speech: A Large-Scale Study of Human Audio Deepfake Perception
- 2024MASV: Speaker Verification with Global and Local Context Mamba
- 2026HCFD: A Benchmark for Audio Deepfake Detection in Healthcare