# Robust Channel Learning for Large-Scale Radio Speaker Verification

arXiv: https://arxiv.org/abs/2406.10956 · HTML: https://mlsanity.com/paper/2406.10956/

## Key facts

- Cited by 2 papers in the map (data through 14 Oct 2026).
- Builds on 29 of its 64 references that are in the map.
- First posted on arXiv 16 Jun 2024.

## Builds on (most cited first, 29 of 29)

- [wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representations](https://mlsanity.com/paper/2006.11477/) (2020)
- [Domain-Adversarial Training of Neural Networks](https://mlsanity.com/paper/1505.07818/) (2015)
- [HuBERT: Self-Supervised Speech Representation Learning by Masked Prediction of Hidden Units](https://mlsanity.com/paper/2106.07447/) (2021)
- [WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processing](https://mlsanity.com/paper/2110.13900/) (2021)
- [SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognition](https://mlsanity.com/paper/1904.08779/) (2019)
- [ECAPA-TDNN: Emphasized Channel Attention, Propagation and Aggregation in TDNN Based Speaker Verification](https://mlsanity.com/paper/2005.07143/) (2020)
- [MUSAN: A Music, Speech, and Noise Corpus](https://mlsanity.com/paper/1510.08484/) (2015)
- [SpeechBrain: A General-Purpose Speech Toolkit](https://mlsanity.com/paper/2106.04624/) (2021)
- [AISHELL-1: An Open-Source Mandarin Speech Corpus and A Speech Recognition Baseline](https://mlsanity.com/paper/1709.05522/) (2017)
- [Transfer Learning from Speaker Verification to Multispeaker Text-To-Speech Synthesis](https://mlsanity.com/paper/1806.04558/) (2018)
- [Additive Margin Softmax for Face Verification](https://mlsanity.com/paper/1801.05599/) (2018)
- [CAM++: A Fast and Efficient Network for Speaker Verification Using Context-Aware Masking](https://mlsanity.com/paper/2303.00332/) (2023)
- [Wespeaker: A Research and Production oriented Speaker Embedding Learning Toolkit](https://mlsanity.com/paper/2210.17016/) (2022)
- [MixStyle Neural Networks for Domain Generalization and Adaptation](https://mlsanity.com/paper/2107.02053/) (2021)
- [Utterance-level Aggregation For Speaker Recognition In The Wild](https://mlsanity.com/paper/1902.10107/) (2019)
- [CN-CELEB: a challenging Chinese speaker recognition dataset](https://mlsanity.com/paper/1911.01799/) (2019)
- [Transfer Learning from Speech Synthesis to Voice Conversion with Non-Parallel Training Data](https://mlsanity.com/paper/2009.14399/) (2020)
- [3D-Speaker: A Large-Scale Multi-Device, Multi-Distance, and Multi-Dialect Corpus for Speech Representation Disentanglement](https://mlsanity.com/paper/2306.15354/) (2023)
- [The INTERSPEECH 2020 Far-Field Speaker Verification Challenge](https://mlsanity.com/paper/2005.08046/) (2020)
- [Playing a Part: Speaker Verification at the Movies](https://mlsanity.com/paper/2010.15716/) (2020)
- [Learning Noise-Invariant Representations for Robust Speech Recognition](https://mlsanity.com/paper/1807.06610/) (2018)
- [The CORAL+ Algorithm for Unsupervised Domain Adaptation of PLDA](https://mlsanity.com/paper/1812.10260/) (2018)
- [Parameter-efficient transfer learning of pre-trained Transformer models for speaker verification using adapters](https://mlsanity.com/paper/2210.16032/) (2022)
- [HI-MIA : A Far-field Text-Dependent Speaker Verification Database and the Baselines](https://mlsanity.com/paper/1912.01231/) (2019)
- [Robust speaker recognition using unsupervised adversarial invariance](https://mlsanity.com/paper/1911.00940/) (2019)
- [Adversarial Network Bottleneck Features for Noise Robust Speaker Verification](https://mlsanity.com/paper/1706.03397/) (2017)
- [Adapting End-to-End Neural Speaker Verification to New Languages and Recording Conditions with Adversarial Training](https://mlsanity.com/paper/1811.03055/) (2018)
- [Training Multi-Task Adversarial Network for Extracting Noise-Robust Speaker Embedding](https://mlsanity.com/paper/1811.09355/) (2018)
- [A Generalized Framework for Domain Adaptation of PLDA in Speaker Recognition](https://mlsanity.com/paper/2008.08815/) (2020)

## Built on by (most cited first, 2 of 2)

- [Channel-Aware Domain-Adaptive Generative Adversarial Network for Robust Speech Recognition](https://mlsanity.com/paper/2409.12386/) (2024)
- [Universal Robust Speech Adaptation for Cross-Domain Speech Recognition and Enhancement](https://mlsanity.com/paper/2602.04307/) (2026)

## Abstract (arXiv)

Recent research in speaker verification has increasingly focused on achieving robust and reliable recognition under challenging channel conditions and noisy environments. Identifying speakers in radio communications is particularly difficult due to inherent limitations such as constrained bandwidth and pervasive noise interference. To address this issue, we present a Channel Robust Speaker Learning (CRSL) framework that enhances the robustness of the current speaker verification pipeline, considering data source, data augmentation, and the efficiency of model transfer processes. Our framework introduces an augmentation module that mitigates bandwidth variations in radio speech datasets by manipulating the bandwidth of training inputs. It also addresses unknown noise by introducing noise within the manifold space. Additionally, we propose an efficient fine-tuning method that reduces the need for extensive additional training time and large amounts of data. Moreover, we develop a toolkit for assembling a large-scale radio speech corpus and establish a benchmark specifically tailored for radio scenario speaker verification studies. Experimental results demonstrate that our proposed methodology effectively enhances performance and mitigates degradation caused by radio transmission in speaker verification tasks. The code will be available on Github.
