mlsanityData to 14 Oct 2026

Attention-based Mixture of Experts for Robust Speech Deepfake Detection

arXiv 2509.17585 ↗First posted 22 Sep 2025cs.SDcited by 2

On the map: Mixture-of-experts → Multimodal MoE models

Abstract (arXiv)

AI-generated speech is becoming increasingly used in everyday life, powering virtual assistants, accessibility tools, and other applications. However, it is also being exploited for malicious purposes such as impersonation, misinformation, and biometric spoofing. As speech deepfakes become nearly indistinguishable from real human speech, the need for robust detection methods and effective countermeasures has become critically urgent. In this paper, we present the ISPL's submission to the SAFE challenge at IH&MMSec 2025, where our system ranked first across all tasks. Our solution introduces a novel approach to audio deepfake detection based on a Mixture of Experts architecture. The proposed system leverages multiple state-of-the-art detectors, combining their outputs through an attention-based gating network that dynamically weights each expert based on the input speech signal. In this design, each expert develops a specialized understanding of the shared training data by learning to capture different complementary aspects of the same input through inductive biases. Experimental results indicate that our method outperforms existing approaches across multiple datasets. We further evaluate and analyze the performance of our system in the SAFE challenge.

Key facts. Cited by 2 papers in the map (data through 14 Oct 2026). Placed in Multimodal MoE models, one of 12 directions in Mixture-of-experts. Builds on 22 of its 34 references that are in the map. First posted on arXiv 22 Sep 2025.

Builds on

22 of 34 references.

Closest ancestors · 2

Same direction, newest first

  1. 2024Leveraging Mixture of Experts for Improved Speech Deepfake Detection24 Sep
  2. 2024Mixture of Experts Fusion for Fake Audio Detection Using Frozen wav2vec 2.018 Sep

Other references · 20

  1. 2017Attention Is All You Needcited by 60,361
  2. 2015Deep Residual Learning for Image Recognitioncited by 52,096
  3. 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,384
  4. 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,380
  5. 2020End-to-end anti-spoofing with RawNet2cited by 164
  6. 2022Does Audio Deepfake Detection Generalize?cited by 135
  7. 2015A Light CNN for Deep Face Representation with Noisy Labelscited by 126
  8. 2022ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wildcited by 121
  9. 2024ASVspoof 5: Crowdsourced Speech Data, Deepfakes, and Adversarial Attacks at Scalecited by 91
  10. 2020Voice Conversion Challenge 2020: Intra-lingual semi-parallel and cross-lingual voice conversioncited by 75
  11. 2018The Voice Conversion Challenge 2018: Promoting Development of Parallel and Nonparallel Methodscited by 68
  12. 2021RawBoost: A Raw Data Boosting and Augmentation Method applied to Automatic Speaker Verification Anti-Spoofingcited by 67
8 more
  1. 2023ADD 2023: the Second Audio Deepfake Detection Challengecited by 64
  2. 2024MLAAD: The Multi-Language Audio Anti-Spoofing Datasetcited by 56
  3. 2024A Survey on Speech Deepfake Detectioncited by 27
  4. 2025ASVspoof 5: Design, Collection and Validation of Resources for Spoofing, Deepfake, and Adversarial Attack Detection Using Crowdsourced Speechcited by 26
  5. 2025Post-training for Deepfake Speech Detectioncited by 11
  6. 2025Unmasking real-world audio deepfakes: A data-centric approachcited by 5
  7. 2024DiffSSD: A Diffusion-Based Dataset For Speech Forensicscited by 4
  8. 2025Anomaly Detection and Localization for Speech Deepfakes via Feature Pyramid Matchingcited by 4

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2026: 2.

2 papers.

Similar, not cited

Close in wording, no citation either way

  1. 2025Mixture of Low-Rank Adapter Experts in Generalizable Audio Deepfake Detection
  2. 2026Domain-Adaptive Dual-Gating Mixture of Experts for Generalizable Speech Deepfake Detection
  3. 2026Leveraging Gradient Reversal Loss and Multitask Learning for Datasets-Aware Audio Deepfake Detection
  4. 2025Wav2DF-TSL: Two-stage Learning with Efficient Pre-training and Hierarchical Experts Fusion for Robust Audio Deepfake Detection
  5. 2025MoLEx: Mixture of LoRA Experts in Speech Self-Supervised Models for Audio Deepfake Detection
  6. 2026Towards Robust Speech Deepfake Detection via Human-Inspired Reasoning
  7. 2026DF-MoE: Generalizable Deepfake Detection via Multimodal Sparse Mixture-of-Experts
  8. 2025Adversarial Attacks on Audio Deepfake Detection: A Benchmark and Comparative Study