Audio-Anchored Fusion of Multi-Ratio DiT Reconstruction Residuals for Cross-Domain Audio Deepfake Detection
Not on the map. Why?
Abstract (arXiv)
Audio deepfake detectors often degrade when generators, corpora, or recording conditions change. We use a Diffusion Transformer (DiT), trained only on bona fide speech, as a frozen reconstruction probe. Reconstructions at masking ratios 0.5, 0.75, and 0.9 yield explicit multi-ratio residual maps. Because these residuals are domain sensitive, our audio-anchored detector passes the projected frozen-WavLM auditory representation into the fusion sum without gate-based attenuation and uses residuals only as a scalar-gated additive correction. The pre-specified seed-42 run obtains 6.5442% EER / 0.18456 min-DCF on ASVspoof 5 Eval and 13.8372% / 0.36921 on ITW Full; three-seed means are 6.8885 (0.3308)% and 15.3328 (2.0719)%. The latter is below a separately optimized WavLM-ResNet18 reference under both supervision settings. Auxiliary supervision raises dynamic competitive fusion from 18.4007% to 25.2968% mean ITW EER, worsening all three seeds. The results support reconstruction residuals as complementary evidence and motivate a non-competitive auditory path for ASVspoof 5-to-ITW transfer, without claiming a componentwise causal ablation of anchoring alone.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Builds on 18 of its 26 references that are in the map. First posted on arXiv 29 Jul 2026.
Builds on
18 of 26 references.
References · 18
- 2021Masked Autoencoders Are Scalable Vision Learnerscited by 7,339
- 2021HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Unitscited by 2,301
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,339
- 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 555
- 2020Leveraging Frequency Analysis for Deep Fake Image Recognitioncited by 501
- 2021Grad-TTS: A Diffusion Probabilistic Model for Text-to-Speechcited by 445
- 2024F5-TTS: A Fairytaler that Fakes Fluent and Faithful Speech with Flow Matchingcited by 353
- 2020End-to-end anti-spoofing with RawNet2cited by 160
- 2024ASVspoof 5: Crowdsourced Speech Data, Deepfakes, and Adversarial Attacks at Scalecited by 88
- 2020One-class Learning Towards Synthetic Voice Spoofing Detectioncited by 59
- 2023Towards generalisable and calibrated synthetic speech detection with self-supervised representationscited by 23
6 more
- 2024SpoofCeleb: Speech Deepfake Detection and SASV In The Wildcited by 22
- 2024Mixture of Experts Fusion for Fake Audio Detection Using Frozen wav2vec 2.0cited by 20
- 2024Cross-Domain Audio Deepfake Detection: Dataset and Analysiscited by 11
- 2024Learn from Real: Reality Defender's Submission to ASVspoof5 Challengecited by 5
- 2026ASVspoof 5: Evaluation of Spoofing, Deepfake, and Adversarial Attack Detection Using Crowdsourced Speechcited by 5
- 2025A Data-Driven Diffusion-based Approach for Audio Deepfake Explanationscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Component-Level Ensemble Fusion for Speech and Environmental Sound Deepfake Detection ↗
- 2026MADBench: A Benchmark for Modality-Aware Audio Deepfake Detection
- 2026X-AVDT: Audio-Visual Cross-Attention for Robust Deepfake Detection
- 2026ToolDF: Tool-Integrated Reasoning for Mixed-Authenticity Audio Deepfake Detection
- 2026Leveraging large multimodal models for audio-video deepfake detection: a pilot study
- 2025AUDETER: A Large-scale Dataset for Deepfake Audio Detection in Open Worlds
- 2025WaveSP-Net: Learnable Wavelet-Domain Sparse Prompt Tuning for Speech Deepfake Detection
- 2024RawBMamba: End-to-End Bidirectional State Space Model for Audio Deepfake Detection