XAI-Grounded Explanation Generation for Speech Deepfake Detection with Training-Free Multimodal Large Language Models
On the map: Multimodal LLMs / vision-language models → MLLM jailbreaks and adversarial robustness
Abstract (arXiv)
Speech deepfake detection (SDD) systems require trustworthy explanations for reliable decision-making. Existing explanation ways mainly fall into two categories. Traditional explainable AI (XAI), such as gradient-based attribution, produces low-level attribution signals tightly coupled with model decisions, and harder to be understood by human than natural language explanations. Meanwhile, large language model (LLM)-based explanation generation often produces generic and ungrounded descriptions due to the lack of heuristic evidence and task-specific supervision, stemming from limited grounded explanation datasets for SDD. We therefore propose a training-free explanation framework that integrates XAI evidence with multimodal LLMs to generate grounded and specific explanations. Using the PartialSpoof dataset, we construct a grounded explanation dataset and show that methods with XAI increase inside accuracy by over 45%, verified through human evaluation and faithfulness checks.
Key facts. No citing papers in the map yet (data through 7 Oct 2026). Placed in MLLM jailbreaks and adversarial robustness, one of 16 directions in Multimodal LLMs / vision-language models. Builds on 20 of its 32 references that are in the map. First posted on arXiv 15 Jun 2026.
Builds on
20 of 32 references.
References · 20
- 2017A Unified Approach to Interpreting Model Predictionscited by 6,488
- 2022Self-Consistency Improves Chain of Thought Reasoning in Language Modelscited by 5,601
- 2016"Why Should I Trust You?": Explaining the Predictions of Any Classifiercited by 5,040
- 2017Axiomatic Attribution for Deep Networkscited by 3,350
- 2022Emergent Abilities of Large Language Modelscited by 2,483
- 2013Deep Inside Convolutional Networks: Visualising Image Classification Models and Saliency Mapscited by 2,348
- 2023A Survey on Evaluation of Large Language Modelscited by 1,227
- 2025Qwen3-Omni Technical Reportcited by 451
- 2024A Comprehensive Survey of Hallucination in Large Language, Image, Video and Audio Foundation Modelscited by 98
- 2024A Survey on Speech Large Language Models for Understandingcited by 71
- 2022The PartialSpoof Database and Countermeasures for the Detection of Short Fake Speech Segments Embedded in an Utterancecited by 47
- 2024LLMs for Relational Reasoning: How Far are We?cited by 21
8 more
- 2025ALLM4ADD: Unlocking the Capabilities of Audio Large Language Models for Audio Deepfake Detectioncited by 17
- 2024A comprehensive study on fidelity metrics for XAIcited by 14
- 2024WavLM model ensemble for audio deepfake detectioncited by 12
- 2024Explainable Artificial Intelligence for Medical Applications: A Reviewcited by 12
- 2026Interpretable All-Type Audio Deepfake Detection with Audio LLMs via Frequency-Time Reinforcement Learningcited by 5
- 2024Toward Robust Real-World Audio Deepfake Detection: Closing the Explainability Gapcited by 3
- 2025DFALLM: Achieving Generalizable Multitask Deepfake Detection by Optimizing Audio LLM Componentscited by 3
- 2024Audio Explanation Synthesis with Generative Foundation Modelscited by 2
Built on by
Not cited yet.
Similar, not cited
Close in wording, no citation either way
- 2026Look Before You Judge: Training-Free Region Mining for Grounded and Explainable Deepfake Detection
- 2026SARA: Stress Test Reasoning in Audio Deepfake Detection
- 2026Towards Robust Speech Deepfake Detection via Human-Inspired Reasoning
- 2025EDVD-LLaMA: Explainable Deepfake Video Detection via Multimodal Large Language Model Reasoning
- 2025PRPO: Paragraph-level Policy Optimization for Vision-Language Deepfake Detection
- 2025Can Multi-modal (reasoning) LLMs work as deepfake detectors?
- 2024X2-DFD: A framework for eXplainable and eXtendable Deepfake Detection
- 2026Investigating the Viability of Employing Multi-modal Large Language Models in the Context of Audio Deepfake Detection