Bridging Attribution and Open-Set Detection using Graph-Augmented Instance Learning in Synthetic Speech
On the map: Speech and audio language models → Anti-spoofing and adversarial audio attacks
Abstract (arXiv)
We propose a unified framework for not only attributing synthetic speech to its source but also for detecting speech generated by synthesizers that were not encountered during training. This requires methods that move beyond simple detection to support both detailed forensic analysis and open-set generalization. To address this, we introduce SIGNAL, a hybrid framework that combines speech foundation models (SFMs) with graph-based modeling and open-set-aware inference. Our framework integrates Graph Neural Networks (GNNs) and a k-Nearest Neighbor (KNN) classifier, allowing it to capture meaningful relationships between utterances and recognize speech that doesn`t belong to any known generator. It constructs a query-conditioned graph over generator class prototypes, enabling the GNN to reason over relationships among candidate generators, while the KNN branch supports open-set detection via confidence-based thresholding. We evaluate SIGNAL using the DiffSSD dataset, which offers a diverse mix of real speech and synthetic audio from both open-source and commercial diffusion-based TTS systems. To further assess generalization, we also test on the SingFake benchmark. Our results show that SIGNAL consistently improves performance across both tasks, with Mamba-based embeddings delivering especially strong results. To the best of our knowledge, this is the first study to unify graph-based learning and open-set detection for tracing synthetic speech back to its origin.
Key facts. Cited by 1 paper in the map (data through 20 Oct 2026). Placed in Anti-spoofing and adversarial audio attacks, one of 11 directions in Speech and audio language models. Builds on 17 of its 26 references that are in the map. First posted on arXiv 11 Jan 2026.
Builds on
17 of 26 references.
Closest ancestors · 3
Same direction, newest first
- 2024Self-Attention and Hybrid Features for Replay and Deep-Fake Audio Detection11 Jan
- 2023Audio Deepfake Detection with Self-Supervised WavLM and Multi-Fusion Attentive Classifier13 Dec
- 2023HM-Conformer: A Conformer-based audio deepfake detection system with hierarchical pooling and multi-level classification token aggregation methods15 Sep
Other references · 14
- 2023Mamba: Linear-Time Sequence Modeling with Selective State Spacescited by 4,885
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,671
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 4,388
- 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 2,137
- 2020DiffWave: A Versatile Diffusion Model for Audio Synthesiscited by 1,394
- 2020ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verificationcited by 984
- 2020FastSpeech 2: Fast and High-Quality End-to-End Text to Speechcited by 948
- 2019ASVspoof 2019: Future Horizons in Spoofed and Fake Audio Detectioncited by 235
- 2019Zero-Shot Multi-Speaker Text-To-Speech with State-of-the-art Neural Speaker Embeddingscited by 108
- 2021UniSpeech-SAT: Universal Speech Representation Learning with Speaker Aware Pre-Trainingcited by 69
- 2024Audio Mamba: Selective State Spaces for Self-Supervised Audio Representationscited by 23
- 2025TADA: Training-free Attribution and Out-of-Domain Detection of Audio Deepfakescited by 9
Built on by
Citing papers per year: 2026: 1.
1 paper.
Similar, not cited
Close in wording, no citation either way
- 2022Transformer-Based Speech Synthesizer Attribution in an Open Set Scenario
- 2025Source Verification for Speech Deepfakes
- 2025Towards Neural Audio Codec Source Parsing
- 2026Anchoring the Unknown: Open-Set Model Attribution via Proxy-Anchor Learning
- 2026Toward Interpretable Speech Deepfake Detection using Artifact-Specific Experts and Calibrated Detection Scores
- 2026Evaluating Pre-trained Speech Encoders for Spontaneous Speech Detection and Out of Domain Synthetic Speech Generalisation in Indic Languages
- 2026GenTraceBench: A Benchmark for Tracing Audio Deepfakes Across Pre- and Post-training Stages
- 2026Towards Zero-Shot Attribution of Synthetic Speech via Audio-Text Contrastive Retrieval