# Replay and Synthetic Speech Detection with Res2net Architecture

arXiv: https://arxiv.org/abs/2010.15006 · HTML: https://mlsanity.com/paper/2010.15006/

## Key facts

- Cited by 39 papers in the map (data through 14 Oct 2026).
- First posted on arXiv 28 Oct 2020.

## Built on by (most cited first, 30 of 39)

- [AASIST: Audio Anti-Spoofing using Integrated Spectro-Temporal Graph Attention Networks](https://mlsanity.com/paper/2110.01200/) (2021)
- [Deepfakes Generation and Detection: State-of-the-art, open challenges, countermeasures, and way forward](https://mlsanity.com/paper/2103.00484/) (2021)
- [Temporal-Channel Modeling in Multi-head Self-Attention for Synthetic Speech Detection](https://mlsanity.com/paper/2406.17376/) (2024)
- [Channel-wise Gated Res2Net: Towards Robust Detection of Synthetic Speech Attacks](https://mlsanity.com/paper/2107.08803/) (2021)
- [Improving the Adversarial Robustness for Speaker Verification by Self-Supervised Learning](https://mlsanity.com/paper/2106.00273/) (2021)
- [Partially Fake Audio Detection by Self-attention-based Fake Span Discovery](https://mlsanity.com/paper/2202.06684/) (2022)
- [Learning From Yourself: A Self-Distillation Method for Fake Speech Detection](https://mlsanity.com/paper/2303.01211/) (2023)
- [I Can Hear You: Selective Robust Training for Deepfake Audio Detection](https://mlsanity.com/paper/2411.00121/) (2024)
- [BiCrossMamba-ST: Speech Deepfake Detection with Bidirectional Mamba Spectro-Temporal Cross-Attention](https://mlsanity.com/paper/2505.13930/) (2025)
- [Partially-Connected Differentiable Architecture Search for Deepfake and Spoofing Detection](https://mlsanity.com/paper/2104.03123/) (2021)
- [Multi-Dataset Co-Training with Sharpness-Aware Optimization for Audio Anti-spoofing](https://mlsanity.com/paper/2305.19953/) (2023)
- [FairSSD: Understanding Bias in Synthetic Speech Detectors](https://mlsanity.com/paper/2404.10989/) (2024)
- [FastAudio: A Learnable Audio Front-End for Spoof Speech Detection](https://mlsanity.com/paper/2109.02774/) (2021)
- [USTC-KXDIGIT System Description for ASVspoof5 Challenge](https://mlsanity.com/paper/2409.01695/) (2024)
- [An Overview of Recent Work in Media Forensics: Methods and Threats](https://mlsanity.com/paper/2204.12067/) (2022)
- [Towards Quantifying and Reducing Language Mismatch Effects in Cross-Lingual Speech Anti-Spoofing](https://mlsanity.com/paper/2409.08346/) (2024)
- [DSVAE: Interpretable Disentangled Representation for Synthetic Speech Detection](https://mlsanity.com/paper/2304.03323/) (2023)
- [Dual-Branch Knowledge Distillation for Noise-Robust Synthetic Speech Detection](https://mlsanity.com/paper/2310.08869/) (2023)
- [Robust Audio Anti-Spoofing with Fusion-Reconstruction Learning on Multi-Order Spectrograms](https://mlsanity.com/paper/2308.09302/) (2023)
- [DiffSSD: A Diffusion-Based Dataset For Speech Forensics](https://mlsanity.com/paper/2409.13049/) (2024)
- [Phase-Aware Spoof Speech Detection Based on Res2Net with Phase Network](https://mlsanity.com/paper/2203.10793/) (2022)
- [Audio Anti-spoofing Using a Simple Attention Module and Joint Optimization Based on Additive Angular Margin Loss and Meta-learning](https://mlsanity.com/paper/2211.09898/) (2022)
- [Spoofing-Aware Speaker Verification by Multi-Level Fusion](https://mlsanity.com/paper/2203.15377/) (2022)
- [Deep Spectro-temporal Artifacts for Detecting Synthesized Speech](https://mlsanity.com/paper/2210.05254/) (2022)
- [Targeted Augmented Data for Audio Deepfake Detection](https://mlsanity.com/paper/2407.07598/) (2024)
- [Learn from Balance: Rectifying Knowledge Transfer for Long-Tailed Scenarios](https://mlsanity.com/paper/2409.07694/) (2024)
- [Efficient Attention Branch Network with Combined Loss Function for Automatic Speaker Verification Spoof Detection](https://mlsanity.com/paper/2109.02051/) (2021)
- [Tackling Spoofing-Aware Speaker Verification with Multi-Model Fusion](https://mlsanity.com/paper/2206.09131/) (2022)
- [ConvNeXt Based Neural Network for Audio Anti-Spoofing](https://mlsanity.com/paper/2209.06434/) (2022)
- [Synthetic Voice Detection and Audio Splicing Detection using SE-Res2Net-Conformer Architecture](https://mlsanity.com/paper/2210.03581/) (2022)

## Abstract (arXiv)

Existing approaches for replay and synthetic speech detection still lack generalizability to unseen spoofing attacks. This work proposes to leverage a novel model structure, so-called Res2Net, to improve the anti-spoofing countermeasure's generalizability. Res2Net mainly modifies the ResNet block to enable multiple feature scales. Specifically, it splits the feature maps within one block into multiple channel groups and designs a residual-like connection across different channel groups. Such connection increases the possible receptive fields, resulting in multiple feature scales. This multiple scaling mechanism significantly improves the countermeasure's generalizability to unseen spoofing attacks. It also decreases the model size compared to ResNet-based models. Experimental results show that the Res2Net model consistently outperforms ResNet34 and ResNet50 by a large margin in both physical access (PA) and logical access (LA) of the ASVspoof 2019 corpus. Moreover, integration with the squeeze-and-excitation (SE) block can further enhance performance. For feature engineering, we investigate the generalizability of Res2Net combined with different acoustic features, and observe that the constant-Q transform (CQT) achieves the most promising performance in both PA and LA scenarios. Our best single system outperforms other state-of-the-art single systems in both PA and LA of the ASVspoof 2019 corpus.