mlsanityData to 7 Oct 2026

How Does Pre-trained Wav2Vec 2.0 Perform on Domain Shifted ASR? An Extensive Benchmark on Air Traffic Control Communications

arXiv 2203.16822 ↗First posted 31 Mar 2022eess.AS cs.CL cs.LGcited by 30

Not on the map. Why?

Abstract (arXiv)

Recent work on self-supervised pre-training focus on leveraging large-scale unlabeled speech data to build robust end-to-end (E2E) acoustic models (AM) that can be later fine-tuned on downstream tasks e.g., automatic speech recognition (ASR). Yet, few works investigated the impact on performance when the data properties substantially differ between the pre-training and fine-tuning phases, termed domain shift. We target this scenario by analyzing the robustness of Wav2Vec 2.0 and XLS-R models on downstream ASR for a completely unseen domain, air traffic control (ATC) communications. We benchmark these two models on several open-source and challenging ATC databases with signal-to-noise ratio between 5 and 20 dB. Relative word error rate (WER) reductions between 20% to 40% are obtained in comparison to hybrid-based ASR baselines by only fine-tuning E2E acoustic models with a smaller fraction of labeled data. We analyze WERs on the low-resource scenario and gender bias carried by one ATC dataset.

Key facts. Cited by 30 papers in the map (data through 7 Oct 2026). Builds on 25 of its 57 references that are in the map. First posted on arXiv 31 Mar 2022.

Builds on

25 of 57 references.

References · 25

  1. 2018Representation Learning with Contrastive Predictive Codingcited by 7,662
  2. 2020wav2vec 2.0: A Framework for Self-Supervised Learning of Speech Representationscited by 3,853
  3. 2016Gaussian Error Linear Units (GELUs)cited by 3,431
  4. 2021WavLM: Large-Scale Self-Supervised Pre-Training for Full Stack Speech Processingcited by 1,609
  5. 2019SpecAugment: A Simple Data Augmentation Method for Automatic Speech Recognitioncited by 1,355
  6. 2022data2vec: A General Framework for Self-supervised Learning in Speech, Vision and Languagecited by 718
  7. 2021XLS-R: Self-supervised Cross-lingual Speech Representation Learning at Scalecited by 589
  8. 2021Datasets: A Community Library for Natural Language Processingcited by 526
  9. 2019Libri-Light: A Benchmark for ASR with Limited or No Supervisioncited by 462
  10. 2019vq-wav2vec: Self-Supervised Learning of Discrete Speech Representationscited by 335
  11. 2021Robust wav2vec 2.0: Analyzing Domain Shift in Self-Supervised Pre-Trainingcited by 148
  12. 2021Unsupervised Speech Recognitioncited by 147
13 more
  1. 2020Cascaded encoders for unifying streaming and non-streaming ASRcited by 51
  2. 2020Learning Robust and Multilingual Speech Representationscited by 39
  3. 2021Don't speak too fast: The impact of data bias on self-supervised speech modelscited by 20
  4. 2022A Noise-Robust Self-supervised Pre-training Model Based Speech Representation Learning for Automatic Speech Recognitioncited by 20
  5. 2020Automatic Speech Recognition Benchmark for Air-Traffic Communicationscited by 17
  6. 2021ASR4REAL: An extended benchmark for speech modelscited by 14
  7. 2021Contextual Semi-Supervised Learning: An Approach To Leverage Air-Surveillance and Untranscribed ATC Data in ASR Systemscited by 12
  8. 2021XLST: Cross-lingual Self-training to Learn Multilingual Representation for Low Resource Speech Recognitioncited by 11
  9. 2021Improving callsign recognition with air-surveillance data in air-traffic communicationcited by 11
  10. 2022Endpoint Detection for Streaming End-to-End Multi-talker ASRcited by 10
  11. 2022A two-step approach to leverage contextual data: speech recognition in air-traffic communicationscited by 8
  12. 2020Lattice-Free MMI Adaptation Of Self-Supervised Pretrained Acoustic Modelscited by 5
  13. 2021Comparing CTC and LFMMI for out-of-domain adaptation of wav2vec 2.0 acoustic modelcited by 5

Built on by

Cited by year (2026 to 7 Oct)

Citing papers per year: 2022: 3; 2023: 12; 2024: 11; 2025: 3; 2026: 1.

30 papers.

Sort:

  1. 2022ATCO2 corpus: A Large-Scale Dataset for Research on Automatic Speech Recognition and Natural Language Understanding of Air Traffic Control Communicationscited by 19
  2. 2023Fine-tuning Strategies for Faster Inference using Speech Self-Supervised Models: A Comparative Studycited by 15
  3. 2023Improving Accented Speech Recognition with Multi-Domain Trainingcited by 5
  4. 2024Keyword-Guided Adaptation of Automatic Speech Recognitioncited by 5
  5. 2022Global Performance Disparities Between English-Language Accents in Automatic Speech Recognitioncited by 4
  6. 2023Implementing contextual biasing in GPU decoder for online ASRcited by 4
  7. 2024Pre-Trained Foundation Model representations to uncover Breathing patterns in Speechcited by 4
  8. 2023A Virtual Simulation-Pilot Agent for Training of Air Traffic Controllerscited by 3
  9. 2024Automatic Speech Recognition (ASR) for the Diagnosis of pronunciation of Speech Sound Disorders in Korean childrencited by 3
  10. 2022Speech and Natural Language Processing Technologies for Pseudo-Pilot Simulatorcited by 2
  11. 2023Some voices are too common: Building fair speech recognition systems using the Common Voice datasetcited by 2
  12. 2023Spatial HuBERT: Self-supervised Spatial Speech Representation Learning for a Single Talker from Multi-channel Audiocited by 2
18 more
  1. 2023Self-supervised Adaptive Pre-training of Multilingual Speech Models for Language and Dialect Identificationcited by 2
  2. 2025BEST-RQ-Based Self-Supervised Learning for Whisper Domain Adaptationcited by 2
  3. 2023Political corpus creation through automatic speech recognition on EU debatescited by 1
  4. 2023Lessons Learned in ATCO2: 5000 hours of Air Traffic Control Communications for Robust Automatic Speech Recognition and Understandingcited by 1
  5. 2024Fast Streaming Transducer ASR Prototyping via Knowledge Distillation with Whispercited by 1
  6. 2025In-domain SSL pre-training and streaming ASRcited by 1
  7. 2023Enhancing Multilingual Speech Recognition through Language Prompt Tuning and Frame-Level Language Adaptercited by 0
  8. 2023GMTR: Graph Matching Transformerscited by 0
  9. 2023DarkShot: Lighting Dark Images with Low-Compute and High-Qualitycited by 0
  10. 2024TRLS: A Time Series Representation Learning Framework via Spectrogram for Medical Signal Processingcited by 0
  11. 2024TEN-GUARD: Tensor Decomposition for Backdoor Attack Detection in Deep Neural Networkscited by 0
  12. 2024T-Pixel2Mesh: Combining Global and Local Transformer for 3D Mesh Generation from a Single Imagecited by 0
  13. 2024Strategic Arms with Side Communication Prevail Over Low-Regret MAB Algorithmscited by 0
  14. 2024Towards General Deepfake Detection with Dynamic Curriculumcited by 0
  15. 2024Attr-Int: A Simple and Effective Entity Alignment Framework for Heterogeneous Knowledge Graphscited by 0
  16. 2024End-to-End Transformer-based Automatic Speech Recognition for Northern Kurdish: A Pioneering Approachcited by 0
  17. 2025Mask6D: Masked Pose Priors For 6D Object Pose Estimationcited by 0
  18. 2026Synthetic Audio Generation Framework for Air Traffic Control Speech Recognitioncited by 0