AASIST3: KAN-Enhanced AASIST Speech Deepfake Detection using SSL Features and Additional Regularization for the ASVspoof 2024 Challenge
Not on the map. Why?
Abstract (arXiv)
Automatic Speaker Verification (ASV) systems, which identify speakers based on their voice characteristics, have numerous applications, such as user authentication in financial transactions, exclusive access control in smart devices, and forensic fraud detection. However, the advancement of deep learning algorithms has enabled the generation of synthetic audio through Text-to-Speech (TTS) and Voice Conversion (VC) systems, exposing ASV systems to potential vulnerabilities. To counteract this, we propose a novel architecture named AASIST3. By enhancing the existing AASIST framework with Kolmogorov-Arnold networks, additional layers, encoders, and pre-emphasis techniques, AASIST3 achieves a more than twofold improvement in performance. It demonstrates minDCF results of 0.5357 in the closed condition and 0.1414 in the open condition, significantly enhancing the detection of synthetic voices and improving ASV security. textbfThe new version of the model is publicly available at hrefhttps://huggingface.co/lab260/Spectra-AASIST3underlineHuggingFace (2026)
Key facts. Cited by 8 papers in the map (data through 7 Oct 2026). Builds on 34 of its 49 references that are in the map. First posted on arXiv 30 Aug 2024.
Builds on
34 of 49 references.
References · 34
- 2017Attention Is All You Needcited by 59,932
- 2017Squeeze-and-Excitation Networkscited by 4,763
- 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
- 2016WaveNet: A Generative Model for Raw Audiocited by 1,710
- 2020Sharpness-Aware Minimization for Efficiently Improving Generalizationcited by 1,404
- 2024KAN: Kolmogorov-Arnold Networkscited by 634
- 2019Attention Augmented Convolutional Networkscited by 363
- 2021ASAM: Adaptive Sharpness-Aware Minimization for Scale-Invariant Learning of Deep Neural Networkscited by 293
- 2024U-KAN Makes Strong Backbone for Medical Image Segmentation and Generationcited by 176
- 2021AASIST: Audio Anti-Spoofing using Integrated Spectro-Temporal Graph Attention Networkscited by 173
- 2018Speaker Recognition from Raw Waveform with SincNetcited by 166
- 2022ASVspoof 2021: Towards Spoofed and Deepfake Speech Detection in the Wildcited by 118
22 more
- 2022Automatic speaker verification spoofing and deepfake detection using wav2vec 2.0 and data augmentationcited by 110
- 2021LEAF: A Learnable Frontend for Audio Classificationcited by 69
- 2021End-to-End Spectro-Temporal Graph Attention Networks for Speaker Verification Anti-Spoofing and Speech Deepfake Detectioncited by 68
- 2021RawBoost: A Raw Data Boosting and Augmentation Method applied to Automatic Speaker Verification Anti-Spoofingcited by 64
- 2019STC Antispoofing Systems for the ASVspoof2019 Challengecited by 51
- 2022Pushing the limits of raw waveform speaker recognitioncited by 49
- 2024Towards Robust Speech Representation Learning for Thousands of Languagescited by 48
- 2019Deep Residual Neural Networks for Audio Spoofing Detectioncited by 33
- 2024Kolmogorov-Arnold Convolutions: Design Principles and Empirical Studiescited by 26
- 2019ASSERT: Anti-Spoofing with Squeeze-Excitation and Residual neTworkscited by 23
- 2023SingFake: Singing Voice Deepfake Detectioncited by 21
- 2022SAMO: Speaker Attractor Multi-Center One-Class Learning for Voice Anti-Spoofingcited by 18
- 2023LibAUC: A Deep Learning Library for X-Risk Optimizationcited by 15
- 2023Improving Short Utterance Anti-Spoofing with AASIST2cited by 11
- 2020AReLU: Attention-based Rectified Linear Unitcited by 9
- 2021UR Channel-Robust Synthetic Speech Detection System for ASVspoof 2021cited by 8
- 2024ELA: Efficient Local Attention for Deep Convolutional Neural Networkscited by 8
- 2024Generalized Fake Audio Detection via Deep Stable Learningcited by 5
- 2023Robust Audio Anti-Spoofing with Fusion-Reconstruction Learning on Multi-Order Spectrogramscited by 4
- 2023Spatial Reconstructed Local Attention Res2Net with F0 Subband for Fake Speech Detectioncited by 2
- 2024Beyond Silence: Bias Analysis through Loss and Asymmetric Approach in Audio Anti-Spoofingcited by 2
- 2022ConvNeXt Based Neural Network for Audio Anti-Spoofingcited by 1
Built on by
Citing papers per year: 2025: 2; 2026: 6.
8 papers.
- 2026Towards Robust Speech Deepfake Detection via Human-Inspired Reasoningcited by 4
- 2025Discrete Optimal Transport and Voice Conversioncited by 1
- 2026An Intervention-Based Framework for Shortcut Diagnosis in Spoofing Countermeasurescited by 1
- 2025Novel Loss-Enhanced Universal Adversarial Patches for Sustainable Speaker Privacycited by 0
- 2026Probabilistic Verification of Voice Anti-Spoofing Modelscited by 0
- 2026What Do Deepfake Speech Detectors Actually Hear?cited by 0
- 2026SpAArSIST: Sparsified AASIST for Efficient and Reliable Anti-Spoofingcited by 0
- 2026Domain-Adaptive Dual-Gating Mixture of Experts for Generalizable Speech Deepfake Detectioncited by 0
- 2026Domain-Adaptive Dual-Gating Mixture of Experts for Generalizable Speech Deepfake Detection27 Sep 2026
- 2026An Intervention-Based Framework for Shortcut Diagnosis in Spoofing Countermeasures3 Jul 2026
- 2026SpAArSIST: Sparsified AASIST for Efficient and Reliable Anti-Spoofing10 Jun 2026
- 2026What Do Deepfake Speech Detectors Actually Hear?9 Jun 2026
- 2026Towards Robust Speech Deepfake Detection via Human-Inspired Reasoning11 Mar 2026
- 2026Probabilistic Verification of Voice Anti-Spoofing Models11 Mar 2026
- 2025Novel Loss-Enhanced Universal Adversarial Patches for Sustainable Speaker Privacy26 May 2025
- 2025Discrete Optimal Transport and Voice Conversion7 May 2025