Large Audio Language Models for Spoofing-Aware Speaker Verification
Not on the map. Why?
Abstract (arXiv)
Recent advances in text-to-speech and voice cloning make high-quality spoofing inexpensive and scalable, threatening voice authentication systems, especially automatic speaker verification (ASV). Existing defenses mainly address this threat through binary countermeasures (CMs) for deepfake detection or spoofing-aware speaker verification (SASV), where current systems are dominated by modular ASV-CM fusion and cascaded pipelines. Although large audio language models (LALMs) have shown promise on related audio tasks, including CM and ASV, their use for SASV remains unexplored, despite their capacity to produce natural-language rationales for auditing and robustness beyond discriminative predictions. This work systematically evaluates LALMs for SASV against conventional pipelines under zero-shot prompting, supervised adaptation, reasoning-oriented training, and reinforcement-learning-based optimization. Our results show that pretrained LALMs are near chance in the zero-shot setting, confirming that they are not natively suited to SASV, but that task-specific adaptation closes this gap. We further find that competitive SASV performance can be achieved through several distinct routes. These findings position LALMs as a promising and auditable foundation for unified SASV, while clarifying where conventional cascade systems still lead.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 42 of its 52 references that are in the map. First posted on arXiv 16 Jul 2026.
Builds on
42 of 52 references.
References · 42
- 2024The Llama 3 Herd of Modelscited by 14,715
- 2021LoRA: Low-Rank Adaptation of Large Language Modelscited by 14,380
- 2024DeepSeekMath: Pushing the Limits of Mathematical Reasoning in Open Language Modelscited by 9,379
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,657
- 2024Qwen2-Audio Technical Reportcited by 560
- 2023SALMONN: Towards Generic Hearing Abilities for Large Language Modelscited by 506
- 2023emotion2vec: Self-Supervised Pre-Training for Speech Emotion Representationcited by 205
- 2021AASIST: Audio Anti-Spoofing using Integrated Spectro-Temporal Graph Attention Networkscited by 180
- 2024XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Modelcited by 179
- 2020End-to-end anti-spoofing with RawNet2cited by 164
- 2025CosyVoice 3: Towards In-the-wild Speech Generation via Scaling-up and Post-trainingcited by 150
- 2022Automatic speaker verification spoofing and deepfake detection using wav2vec 2.0 and data augmentationcited by 117
30 more
- 2024ASVspoof 5: Crowdsourced Speech Data, Deepfakes, and Adversarial Attacks at Scalecited by 91
- 2021RawBoost: A Raw Data Boosting and Augmentation Method applied to Automatic Speaker Verification Anti-Spoofingcited by 67
- 2023ADD 2023: the Second Audio Deepfake Detection Challengecited by 64
- 2024Scaling up masked audio encoder learning for general audio classificationcited by 44
- 2025SAKURA: On the Multi-hop Reasoning of Large Audio-Language Models Based on Speech and Audio Informationcited by 42
- 2025Step-Audio-R1 Technical Reportcited by 36
- 2024ECAPA2: A Hybrid Neural Network Architecture and Training Strategy for Robust Speaker Embeddingscited by 22
- 2024SpoofCeleb: Speech Deepfake Detection and SASV In The Wildcited by 22
- 2022SASV 2022: The First Spoofing-Aware Speaker Verification Challengecited by 19
- 2022SAMO: Speaker Attractor Multi-Center One-Class Learning for Voice Anti-Spoofingcited by 18
- 2025ALLM4ADD: Unlocking the Capabilities of Audio Large Language Models for Audio Deepfake Detectioncited by 17
- 2025SpeechLLM-as-Judges: Towards General and Interpretable Speech Quality Evaluationcited by 14
- 2022Baseline Systems for the First Spoofing-Aware Speaker Verification Challenge: Score and Embedding Fusioncited by 6
- 2024a-DCF: an architecture agnostic metric with application to spoofing-robust speaker verificationcited by 6
- 2025CoLMbo: Speaker Language Model for Descriptive Profilingcited by 5
- 2022The DKU-OPPO System for the 2022 Spoofing-Aware Speaker Verification Challengecited by 4
- 2026Towards Robust Speech Deepfake Detection via Human-Inspired Reasoningcited by 4
- 2026Overview of ESDD2: Environment-Aware Speech and Sound Deepfake Detection Challengecited by 4
- 2024Spoofing-Aware Speaker Verification Robust Against Domain and Channel Mismatchescited by 3
- 2026HoliAntiSpoof: Audio LLM for Holistic Speech Anti-Spoofingcited by 3
- 2026Audio Language Model for Deepfake Detection Grounded in Acoustic Chain-of-Thoughtcited by 3
- 2026AT-ADD: All-Type Audio Deepfake Detection Challenge Evaluation Plancited by 3
- 2022Two Methods for Spoofing-Aware Speaker Verification: Multi-Layer Perceptron Score Fusion Model and Integrated Embedding Projectorcited by 2
- 2025Can Audio Large Language Models Verify Speaker Identity?cited by 2
- 2026SpeakerLLM: A Speaker-Specialized Audio-LLM for Speaker Understanding and Verification Reasoningcited by 2
- 2025Joint Optimization of Speaker and Spoof Detectors for Spoofing-Robust Automatic Speaker Verificationcited by 1
- 2025BUT Systems for WildSpoof Challenge: SASV in the Wildcited by 1
- 2026Integrated Spoofing-Robust Automatic Speaker Verification via a Three-Class Formulation and LLRcited by 1
- 2026Alethia: A Foundational Encoder for Voice Deepfakescited by 1
- 2026RADAR Challenge 2026: Robust Audio Deepfake Recognition under Media Transformationscited by 1
Built on by
Not cited yet.