# Towards single integrated spoofing-aware speaker verification embeddings

arXiv: https://arxiv.org/abs/2305.19051 · HTML: https://mlsanity.com/paper/2305.19051/

## Key facts

- Cited by 7 papers in the map (data through 14 Oct 2026).
- Builds on 26 of its 44 references that are in the map.
- First posted on arXiv 30 May 2023.

## Builds on (most cited first, 26 of 26)

- [HiFi-GAN: Generative Adversarial Networks for Efficient and High Fidelity Speech Synthesis](https://mlsanity.com/paper/2010.05646/) (2020)
- [VoxCeleb2: Deep Speaker Recognition](https://mlsanity.com/paper/1806.05622/) (2018)
- [ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verification](https://mlsanity.com/paper/2005.07143/) (2020)
- [WaveGlow: A Flow-based Generative Network for Speech Synthesis](https://mlsanity.com/paper/1811.00002/) (2018)
- [AASIST: Audio Anti-Spoofing using Integrated Spectro-Temporal Graph Attention Networks](https://mlsanity.com/paper/2110.01200/) (2021)
- [DDSP: Differentiable Digital Signal Processing](https://mlsanity.com/paper/2001.04643/) (2020)
- [ASVspoof 2021: accelerating progress in spoofed and deepfake speech detection](https://mlsanity.com/paper/2109.00537/) (2021)
- [In defence of metric learning for speaker recognition](https://mlsanity.com/paper/2003.11982/) (2020)
- [Large-scale Self-Supervised Speech Representation Learning for Automatic Speaker Verification](https://mlsanity.com/paper/2110.05777/) (2021)
- [WaveFake: A Data Set to Facilitate Audio Deepfake Detection](https://mlsanity.com/paper/2111.02813/) (2021)
- [Speaker Recognition Based on Deep Learning: An Overview](https://mlsanity.com/paper/2012.00931/) (2020)
- [MFA-Conformer: Multi-scale Feature Aggregation Conformer for Automatic Speaker Verification](https://mlsanity.com/paper/2203.15249/) (2022)
- [Clova Baseline System for the VoxCeleb Speaker Recognition Challenge 2020](https://mlsanity.com/paper/2009.14153/) (2020)
- [Neural source-filter-based waveform model for statistical parametric speech synthesis](https://mlsanity.com/paper/1810.11946/) (2018)
- [The ins and outs of speaker recognition: lessons from VoxSRC 2020](https://mlsanity.com/paper/2010.15809/) (2020)
- [Spoofed training data for speech spoofing countermeasure can be efficiently created using neural vocoders](https://mlsanity.com/paper/2210.10570/) (2022)
- [SASV 2022: The First Spoofing-Aware Speaker Verification Challenge](https://mlsanity.com/paper/2203.14732/) (2022)
- [Frequency and Multi-Scale Selective Kernel Attention for Speaker Verification](https://mlsanity.com/paper/2204.01005/) (2022)
- [Integrated Replay Spoofing-aware Text-independent Speaker Verification](https://mlsanity.com/paper/2006.05599/) (2020)
- [Baseline Systems for the First Spoofing-Aware Speaker Verification Challenge: Score and Embedding Fusion](https://mlsanity.com/paper/2204.09976/) (2022)
- [The DKU-OPPO System for the 2022 Spoofing-Aware Speaker Verification Challenge](https://mlsanity.com/paper/2207.07510/) (2022)
- [A Probabilistic Fusion Framework for Spoofing Aware Speaker Verification](https://mlsanity.com/paper/2202.05253/) (2022)
- [On the potential of jointly-optimised solutions to spoofing attack detection and automatic speaker verification](https://mlsanity.com/paper/2209.00506/) (2022)
- [SA-SASV: An End-to-End Spoof-Aggregated Spoofing-Aware Speaker Verification System](https://mlsanity.com/paper/2203.06517/) (2022)
- [Backend Ensemble for Speaker Verification and Spoofing Countermeasure](https://mlsanity.com/paper/2207.01802/) (2022)
- [Exposing AI-Synthesized Human Voices Using Neural Vocoder Artifacts](https://mlsanity.com/paper/2302.09198/) (2023)

## Built on by (most cited first, 7 of 7)

- [ASVspoof 5: Crowdsourced Speech Data, Deepfakes, and Adversarial Attacks at Scale](https://mlsanity.com/paper/2408.08739/) (2024)
- [SpoofCeleb: Speech Deepfake Detection and SASV In The Wild](https://mlsanity.com/paper/2409.17285/) (2024)
- [a-DCF: an architecture agnostic metric with application to spoofing-robust speaker verification](https://mlsanity.com/paper/2403.01355/) (2024)
- [Assessing the Impact of Speaker Identity in Speech Spoofing Detection](https://mlsanity.com/paper/2602.20805/) (2026)
- [PhonemeFake: Redefining Deepfake Realism with Language-Driven Segmental Manipulation and Adaptive Bilevel Detection](https://mlsanity.com/paper/2506.22783/) (2025)
- [To what extent can ASV systems naturally defend against spoofing attacks?](https://mlsanity.com/paper/2406.05339/) (2024)
- [WildSpoof Challenge Evaluation Plan](https://mlsanity.com/paper/2508.16858/) (2025)

## Abstract (arXiv)

This study aims to develop a single integrated spoofing-aware speaker verification (SASV) embeddings that satisfy two aspects. First, rejecting non-target speakers' input as well as target speakers' spoofed inputs should be addressed. Second, competitive performance should be demonstrated compared to the fusion of automatic speaker verification (ASV) and countermeasure (CM) embeddings, which outperformed single embedding solutions by a large margin in the SASV2022 challenge. We analyze that the inferior performance of single SASV embeddings comes from insufficient amount of training data and distinct nature of ASV and CM tasks. To this end, we propose a novel framework that includes multi-stage training and a combination of loss functions. Copy synthesis, combined with several vocoders, is also exploited to address the lack of spoofed data. Experimental results show dramatic improvements, achieving a SASV-EER of 1.06% on the evaluation protocol of the SASV2022 challenge.
