Bridging the SEA Gap: An Initial Benchmark for Neural Audio Codec-Synthesized Speech Deepfakes in South-East Asian Languages
On the map: Speech and audio language models → Anti-spoofing and adversarial audio attacks
Abstract (arXiv)
Codecfakes (CFs) are a type of speech deepfakes generated through Audio Language Models (ALMs), with Neural Audio Codecs (NACs) forming the core mechanism for speech encoding and generation. CFs exhibit distributional characteristics that differ from vocoder-based deepfakes, causing detectors trained on vocoder data to generalize poorly to CFs detection. Although this has led to the development of CF detection benchmarks, existing resources are largely confined to English -- and to a limited extent Chinese -- leaving South-East Asian (SEA) languages unexplored. To bridge this gap, we introduce SEA-CF, the first large-scale benchmark for CF detection spanning multiple SEA languages, diverse speaker profiles, and a wide range of NAC architectures. SEA-CF is constructed by synthesizing publicly available real speech corpora. Our experiments show that state-of-the-art (SOTA) CF detectors trained on English-centric datasets fail to generalize to SEA speech due to language-specific phonetic structures, tonal variations, and rich prosodic diversity. We further conduct a comprehensive zero-shot and fine-tuned evaluation of recent SOTA ALMs on SEA-CF. Fine-tuning the ALMs improves performance, however, these are very large being impractical for real-world application due to their scale, particularly in low-resource and latency-constrained settings. To address this limitation, we propose a novel small-ALM, GARUDA tailored for CF detection, which delivers strong performance while remaining lightweight. Extensive evaluations demonstrate that the proposed Small-ALM outperforms strong end-to-end and ALM-based baselines, establishing a new, practical direction for robust CF detection in SEA languages and beyond.
Key facts. No citing papers in the map yet (data through 20 Oct 2026). Placed in Anti-spoofing and adversarial audio attacks, one of 11 directions in Speech and audio language models. Builds on 37 of its 56 references that are in the map. First posted on arXiv 14 Jun 2026.
Builds on
37 of 56 references.
Closest ancestors · 9
Same direction, newest first
- 2026Indic-CodecFake meets SATYAM: Towards Detecting Neural Audio Codec Synthesized Speech Deepfakes in Indic Languages21 Apr
- 2026Bridging Attribution and Open-Set Detection using Graph-Augmented Instance Learning in Synthetic Speech11 Jan
- 2025Curved Worlds, Clear Boundaries: Generalizing Speech Deepfake Detection using Hyperbolic and Spherical Geometry Spaces13 Nov
- 2025SpeechFake: A Large-Scale Multilingual Speech Deepfake Dataset Incorporating Cutting-Edge Generation Methods29 Jul
- 2024Codecfake: An Initial Dataset for Detecting LLM-based Deepfake Audio12 Jun
- 2024CodecFake: Enhancing Anti-Spoofing Models Against Deepfake Audios from Codec-Based Speech Synthesis Systems11 Jun
- 2024The Codecfake Dataset and Countermeasures for the Universally Detection of Deepfake Audio8 May
- 2024MLAAD: The Multi-Language Audio Anti-Spoofing Dataset17 Jan
- 2022Automatic speaker verification spoofing and deepfake detection using wav2vec 2.0 and data augmentation24 Feb
Other references · 28
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,671
- 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,599
- 2021SoundStream: An End-to-End Neural Audio Codeccited by 988
- 2022High Fidelity Neural Audio Compressioncited by 918
- 2022AudioLM: a Language Modeling Approach to Audio Generationcited by 736
- 2024Moshi: a speech-text foundation model for real-time dialoguecited by 711
- 2023High-Fidelity Audio Compression with Improved RVQGANcited by 619
- 2021AASIST: Audio Anti-Spoofing using Integrated Spectro-Temporal Graph Attention Networkscited by 238
- 2022ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wildcited by 151
- 2024ASVspoof 5: Crowdsourced Speech Data, Deepfakes, and Adversarial Attacks at Scalecited by 121
- 2023AudioDec: An Open-source Streaming High-fidelity Neural Audio Codeccited by 99
- 2023FunCodec: A Fundamental, Reproducible and Integrable Open-source Toolkit for Neural Speech Codeccited by 95
16 more
- 2021ASVspoof 2019: spoofing countermeasures for the detection of synthesized, converted and replayed speechcited by 78
- 2024SNAC: Multi-Scale Neural Audio Codeccited by 73
- 2021Investigating self-supervised front ends for speech spoofing countermeasurescited by 69
- 2022IndicSUPERB: A Speech Processing Universal Performance Benchmark for Indian languagescited by 53
- 2020Multimodal Generative Learning Utilizing Jensen-Shannon-Divergencecited by 51
- 2024GigaSpeech 2: An Evolving, Large-Scale and Multi-domain ASR Corpus for Low-Resource Languages with Automated Crawling, Transcription and Refinementcited by 50
- 2023Improved DeepFake Detection Using Whisper Featurescited by 43
- 2025ALLM4ADD: Unlocking the Capabilities of Audio Large Language Models for Audio Deepfake Detectioncited by 24
- 2024Heterogeneity over Homogeneity: Investigating Multilingual Speech Pre-Trained Models for Detecting Audio Deepfakecited by 21
- 2025SeaLLMs-Audio: Large Audio-Language Models for Southeast Asiacited by 12
- 2025DFALLM: Achieving Generalizable Multitask Deepfake Detection by Optimizing Audio LLM Componentscited by 8
- 2025Reasoning Beyond Majority Vote: An Explainable SpeechLM Framework for Speech Emotion Recognitioncited by 4
- 2025SEA-Spoof: Bridging The Gap in Multilingual Audio Deepfake Detection for South-East Asiancited by 3
- 2025Melody or Machine: Detecting Synthetic Music with Dual-Stream Contrastive Learningcited by 3
- 2025Towards Attribution of Generators and Emotional Manipulation in Cross-Lingual Synthetic Speech using Geometric Learningcited by 1
- 2026HCFD: A Benchmark for Audio Deepfake Detection in Healthcarecited by 1
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2025CodecFake+: Codec-Based Resynthesized Data as a Proxy for Detecting CodecFake Speech
- 2026ML-ITW: A Multilingual in-the-wild Benchmark for Speech Deepfake Detection
- 2025AUDETER: A Large-scale Dataset for Deepfake Audio Detection in Open Worlds
- 2026SEA-SpeechBench: A Large-Scale Multitask Benchmark for Speech Understanding Across Southeast Asia
- 2026What Survives the Codec Shift: Pooled No-Vocals Residuals for Speech Deepfake Detection
- 2025Multilingual Dataset Integration Strategies for Robust Audio Deepfake Detection: A SAFE Challenge System
- 2026Evaluating Pre-trained Speech Encoders for Spontaneous Speech Detection and Out of Domain Synthetic Speech Generalisation in Indic Languages
- 2026Language Orthogonalization for Zero-Shot Cross-Lingual Audio Deepfake Detection