ATCO2 corpus: A Large-Scale Dataset for Research on Automatic Speech Recognition and Natural Language Understanding of Air Traffic Control Communications
Not on the map. Why?
Abstract (arXiv)
Personal assistants, automatic speech recognizers and dialogue understanding systems are becoming more critical in our interconnected digital world. A clear example is air traffic control (ATC) communications. ATC aims at guiding aircraft and controlling the airspace in a safe and optimal manner. These voice-based dialogues are carried between an air traffic controller (ATCO) and pilots via very-high frequency radio channels. In order to incorporate these novel technologies into ATC (low-resource domain), large-scale annotated datasets are required to develop the data-driven AI systems. Two examples are automatic speech recognition (ASR) and natural language understanding (NLU). In this paper, we introduce the ATCO2 corpus, a dataset that aims at fostering research on the challenging ATC field, which has lagged behind due to lack of annotated data. The ATCO2 corpus covers 1) data collection and pre-processing, 2) pseudo-annotations of speech data, and 3) extraction of ATC-related named entities. The ATCO2 corpus is split into three subsets. 1) ATCO2-test-set corpus contains 4 hours of ATC speech with manual transcripts and a subset with gold annotations for named-entity recognition (callsign, command, value). 2) The ATCO2-PL-set corpus consists of 5281 hours of unlabeled ATC data enriched with automatic transcripts from an in-domain speech recognizer, contextual information, speaker turn information, signal-to-noise ratio estimate and English language detection score per sample. Both available for purchase through ELDA at http://catalog.elra.info/en-us/repository/browse/ELRA-S0484. 3) The ATCO2-test-set-1h corpus is a one-hour subset from the original test set corpus, that we are offering for free at https://www.atco2.org/data. We expect the ATCO2 corpus will foster research on robust ASR and NLU not only in the field of ATC communications but also in the general research community.
Key facts. Cited by 19 papers in the map (data through 14 Oct 2026). Builds on 22 of its 80 references that are in the map. First posted on arXiv 8 Nov 2022.
Builds on
22 of 80 references.
References · 22
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2019RoBERTa: A Robustly Optimized BERT Pretraining Approachcited by 13,372
- 2019DistilBERT, a distilled version of BERT: smaller, faster, cheaper and lightercited by 4,307
- 2016Gaussian Error Linear Units (GELUs)cited by 3,502
- 2020DeBERTa: Decoding-enhanced BERT with Disentangled Attentioncited by 2,181
- 2019Common Voice: A Massively-Multilingual Speech Corpuscited by 1,384
- 2021Datasets: A Community Library for Natural Language Processingcited by 530
- 2018Snips Voice Platform: an embedded Spoken Language Understanding system for private-by-design voice interfacescited by 377
- 2019A Survey on Recent Advances in Named Entity Recognition from Deep Learning modelscited by 117
- 2020Bayesian HMM clustering of x-vector sequences (VBx) in speaker diarization: theory, implementation and analysis on standard taskscited by 73
- 2022How Does Pre-trained Wav2Vec 2.0 Perform on Domain Shifted ASR? An Extensive Benchmark on Air Traffic Control Communicationscited by 30
- 2020Automatic Speech Recognition Benchmark for Air-Traffic Communicationscited by 17
10 more
- 2018The Airbus Air Traffic Control speech recognition 2018 challenge: towards ATC automatic transcription and call sign detectioncited by 13
- 2021BERTraffic: BERT-based Joint Speaker Role and Speaker Change Detection for Air Traffic Control Communicationscited by 13
- 2020A Survey on Recent Advances in Sequence Labeling from Deep Learning Modelscited by 12
- 2021Contextual Semi-Supervised Learning: An Approach To Leverage Air-Surveillance and Untranscribed ATC Data in ASR Systemscited by 12
- 2021Improving callsign recognition with air-surveillance data in air-traffic communicationcited by 11
- 2022What do we Really Know about State of the Art NER?cited by 10
- 2022A two-step approach to leverage contextual data: speech recognition in air-traffic communicationscited by 8
- 2021Detecting English Speech in the Air Traffic Control Voice Communicationcited by 4
- 2022Comparing supervised and self-supervised embedding for ExVo Multi-Task learning trackcited by 4
- 2022Call-sign recognition and understanding for noisy air-traffic transcripts using surveillance informationcited by 2
Built on by
Citing papers per year: 2022: 1; 2023: 4; 2024: 1; 2025: 4; 2026: 9.
19 papers.
Sort:
By area:
- 2024TartanAviation: Image, Speech, and ADS-B Trajectory Datasets for Terminal Airspace Operationscited by 7
- 2023Implementing contextual biasing in GPU decoder for online ASRcited by 4
- 2023A Virtual Simulation-Pilot Agent for Training of Air Traffic Controllerscited by 3
- 2025Adapting Automatic Speech Recognition for Accented Air Traffic Control Communicationscited by 3
- 2022Speech and Natural Language Processing Technologies for Pseudo-Pilot Simulatorcited by 2
- 2025BEST-RQ-Based Self-Supervised Learning for Whisper Domain Adaptationcited by 2
- 2023Lessons Learned in ATCO2: 5000 hours of Air Traffic Control Communications for Robust Automatic Speech Recognition and Understandingcited by 1
- 2023On the N-gram Approximation of Pre-trained Language Modelscited by 1
- 2025In-domain SSL pre-training and streaming ASRcited by 1
- 2026Air Traffic Control Using Large Language Models: Prompt Engineering, Architecture, and Evaluationcited by 1
- 2025A Modular, Data-Free Pipeline for Multi-Label Intention Recognition in Transportation Agentic AI Applicationscited by 0
- 2026RECOVER: Robust Entity Correction via agentic Orchestration of hypothesis Variants for Evidence-based Recoverycited by 0
7 more
- 2026SCOPE: A Lightweight-training LLM Framework for Air Traffic Control Readback Monitoringcited by 0
- 2026MoDiCoL: A Modular Diagnostic Continual Learning Dataset for Robust Speech Recognitioncited by 0
- 2026ASTRA: A Scalable Next-Generation ATCO Training Simulator with Autonomous Simpilotscited by 0
- 2026Synthetic Audio Generation Framework for Air Traffic Control Speech Recognitioncited by 0
- 2026Beyond Semantic Accuracy: Consequence-Aware Evaluation for Safety-Critical Language Understandingcited by 0
- 2026Formal, Executable and Explainable Runtime Monitoring of Spoken Air Traffic Control Operational Procedurescited by 0
- 2026V2TATC: Joint Voice-Trajectory Embedding and Dataset for Air Traffic Controller Situational Awarenesscited by 0
- 2026V2TATC: Joint Voice-Trajectory Embedding and Dataset for Air Traffic Controller Situational Awareness29 Aug 2026
- 2026Formal, Executable and Explainable Runtime Monitoring of Spoken Air Traffic Control Operational Procedures26 Aug 2026
- 2026Beyond Semantic Accuracy: Consequence-Aware Evaluation for Safety-Critical Language Understanding25 Aug 2026
- 2026Air Traffic Control Using Large Language Models: Prompt Engineering, Architecture, and Evaluation19 Aug 2026
- 2026Synthetic Audio Generation Framework for Air Traffic Control Speech Recognition19 Jun 2026
- 2026ASTRA: A Scalable Next-Generation ATCO Training Simulator with Autonomous Simpilots16 Jun 2026
- 2026MoDiCoL: A Modular Diagnostic Continual Learning Dataset for Robust Speech Recognition12 Jun 2026
- 2026SCOPE: A Lightweight-training LLM Framework for Air Traffic Control Readback Monitoring28 May 2026
- 2026RECOVER: Robust Entity Correction via agentic Orchestration of hypothesis Variants for Evidence-based Recovery17 Mar 2026
- 2025A Modular, Data-Free Pipeline for Multi-Label Intention Recognition in Transportation Agentic AI Applications5 Nov 2025
- 2025BEST-RQ-Based Self-Supervised Learning for Whisper Domain Adaptation28 Oct 2025
- 2025In-domain SSL pre-training and streaming ASR15 Sep 2025
7 more
- 2025Adapting Automatic Speech Recognition for Accented Air Traffic Control Communications27 Feb 2025
- 2024TartanAviation: Image, Speech, and ADS-B Trajectory Datasets for Terminal Airspace Operations5 Mar 2024
- 2023Implementing contextual biasing in GPU decoder for online ASR23 Jun 2023
- 2023On the N-gram Approximation of Pre-trained Language Models12 Jun 2023
- 2023Lessons Learned in ATCO2: 5000 hours of Air Traffic Control Communications for Robust Automatic Speech Recognition and Understanding2 May 2023
- 2023A Virtual Simulation-Pilot Agent for Training of Air Traffic Controllers16 Apr 2023
- 2022Speech and Natural Language Processing Technologies for Pseudo-Pilot Simulator14 Dec 2022
- 2024TartanAviation: Image, Speech, and ADS-B Trajectory Datasets for Terminal Airspace Operationscited by 7
- 2023Implementing contextual biasing in GPU decoder for online ASRcited by 4
- 2023A Virtual Simulation-Pilot Agent for Training of Air Traffic Controllerscited by 3
- 2025Adapting Automatic Speech Recognition for Accented Air Traffic Control Communicationscited by 3
- 2022Speech and Natural Language Processing Technologies for Pseudo-Pilot Simulatorcited by 2
- 2025BEST-RQ-Based Self-Supervised Learning for Whisper Domain Adaptationcited by 2
- 2023Lessons Learned in ATCO2: 5000 hours of Air Traffic Control Communications for Robust Automatic Speech Recognition and Understandingcited by 1
- 2023On the N-gram Approximation of Pre-trained Language Modelscited by 1
- 2025In-domain SSL pre-training and streaming ASRcited by 1
- 2026Air Traffic Control Using Large Language Models: Prompt Engineering, Architecture, and Evaluationcited by 1
- 2026SCOPE: A Lightweight-training LLM Framework for Air Traffic Control Readback Monitoringcited by 0
- 2026MoDiCoL: A Modular Diagnostic Continual Learning Dataset for Robust Speech Recognitioncited by 0
12 most cited of 17 All 17 (JSON)
- 2026V2TATC: Joint Voice-Trajectory Embedding and Dataset for Air Traffic Controller Situational Awareness29 Aug 2026
- 2026Formal, Executable and Explainable Runtime Monitoring of Spoken Air Traffic Control Operational Procedures26 Aug 2026
- 2026Beyond Semantic Accuracy: Consequence-Aware Evaluation for Safety-Critical Language Understanding25 Aug 2026
- 2026Air Traffic Control Using Large Language Models: Prompt Engineering, Architecture, and Evaluation19 Aug 2026
- 2026Synthetic Audio Generation Framework for Air Traffic Control Speech Recognition19 Jun 2026
- 2026ASTRA: A Scalable Next-Generation ATCO Training Simulator with Autonomous Simpilots16 Jun 2026
- 2026MoDiCoL: A Modular Diagnostic Continual Learning Dataset for Robust Speech Recognition12 Jun 2026
- 2026SCOPE: A Lightweight-training LLM Framework for Air Traffic Control Readback Monitoring28 May 2026
- 2025BEST-RQ-Based Self-Supervised Learning for Whisper Domain Adaptation28 Oct 2025
- 2025In-domain SSL pre-training and streaming ASR15 Sep 2025
- 2025Adapting Automatic Speech Recognition for Accented Air Traffic Control Communications27 Feb 2025
- 2024TartanAviation: Image, Speech, and ADS-B Trajectory Datasets for Terminal Airspace Operations5 Mar 2024
12 newest of 17 All 17 (JSON)