mlsanityData to 14 Oct 2026

BERTraffic: BERT-based Joint Speaker Role and Speaker Change Detection for Air Traffic Control Communications

arXiv 2110.05781 ↗First posted 12 Oct 2021eess.AS cs.CL cs.LGcited by 13

Not on the map. Why?

Abstract (arXiv)

Automatic speech recognition (ASR) allows transcribing the communications between air traffic controllers (ATCOs) and aircraft pilots. The transcriptions are used later to extract ATC named entities, e.g., aircraft callsigns. One common challenge is speech activity detection (SAD) and speaker diarization (SD). In the failure condition, two or more segments remain in the same recording, jeopardizing the overall performance. We propose a system that combines SAD and a BERT model to perform speaker change detection and speaker role detection (SRD) by chunking ASR transcripts, i.e., SD with a defined number of speakers together with SRD. The proposed model is evaluated on real-life public ATC databases. Our BERT SD model baseline reaches up to 10% and 20% token-based Jaccard error rate (JER) in public and private ATC databases. We also achieved relative improvements of 32% and 7.7% in JERs and SD error rate (DER), respectively, compared to VBx, a well-known SD system.

Key facts. Cited by 13 papers in the map (data through 14 Oct 2026). Builds on 20 of its 50 references that are in the map. First posted on arXiv 12 Oct 2021.

Builds on

20 of 50 references.

References · 20

  1. 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
  2. 2016Gaussian Error Linear Units (GELUs)cited by 3,502
  3. 2021Datasets: A Community Library for Natural Language Processingcited by 530
  4. 2019A Survey on Recent Advances in Named Entity Recognition from Deep Learning modelscited by 117
  5. 2019End-to-End Neural Speaker Diarization with Permutation-Free Objectivescited by 88
  6. 2019End-to-End Neural Speaker Diarization with Self-attentioncited by 77
  7. 2020Bayesian HMM clustering of x-vector sequences (VBx) in speaker diarization: theory, implementation and analysis on standard taskscited by 73
  8. 2020End-to-End Speaker Diarization for an Unknown Number of Speakers with Encoder-Decoder Based Attractorscited by 71
  9. 2019Joint Speech Recognition and Speaker Diarization via Sequence Transductioncited by 49
  10. 2019The Second DIHARD Diarization Challenge: Dataset, task, and baselinescited by 39
  11. 2021Turn-to-Diarize: Online Speaker Diarization Constrained by Transformer Transducer Speaker Turn Detectioncited by 32
  12. 2020Speech Recognition and Multi-Speaker Diarization of Long Conversationscited by 23
8 more
  1. 2020Automatic Speech Recognition Benchmark for Air-Traffic Communicationscited by 17
  2. 2018The Airbus Air Traffic Control speech recognition 2018 challenge: towards ATC automatic transcription and call sign detectioncited by 13
  3. 2018Multimodal Speaker Segmentation and Diarization using Lexical and Acoustic Cues via Sequence to Sequence Neural Networkscited by 12
  4. 2021Contextual Semi-Supervised Learning: An Approach To Leverage Air-Surveillance and Untranscribed ATC Data in ASR Systemscited by 12
  5. 2020BW-EDA-EEND: Streaming End-to-End Neural Speaker Diarization for a Variable Number of Speakerscited by 11
  6. 2021Improving callsign recognition with air-surveillance data in air-traffic communicationcited by 11
  7. 2020Speech Activity Detection Based on Multilingual Speech Recognition Systemcited by 4
  8. 2019Incremental Transfer Learning in Two-pass Information Bottleneck based Speaker Diarization System for Meetingscited by 1

Built on by

Cited by year (2026 to 14 Oct)

Citing papers per year: 2022: 2; 2023: 5; 2024: 3; 2025: 1; 2026: 2.

13 papers.

Sort:

  1. 2022ATCO2 corpus: A Large-Scale Dataset for Research on Automatic Speech Recognition and Natural Language Understanding of Air Traffic Control Communicationscited by 19
  2. 2024Performance evaluation of SLAM-ASR: The Good, the Bad, the Ugly, and the Way Forwardcited by 17
  3. 2023Exploring Speaker-Related Information in Spoken Language Understanding for Better Speaker Diarizationcited by 5
  4. 2023A Virtual Simulation-Pilot Agent for Training of Air Traffic Controllerscited by 3
  5. 2023Improving Speaker Diarization using Semantic Information: Joint Pairwise Constraints Propagationcited by 3
  6. 2022Speech and Natural Language Processing Technologies for Pseudo-Pilot Simulatorcited by 2
  7. 2023Developing Speech Processing Pipelines for Police Accountabilitycited by 2
  8. 2023Lessons Learned in ATCO2: 5000 hours of Air Traffic Control Communications for Robust Automatic Speech Recognition and Understandingcited by 1
  9. 2024Joint vs Sequential Speaker-Role Detection and Automatic Speech Recognition for Air-traffic Controlcited by 1
  10. 2024Race and Privacy in Broadcast Police Communicationscited by 1
  11. 2025ASR-Synchronized Speaker-Role Diarizationcited by 0
  12. 2026CineSRD: Leveraging Visual, Acoustic, and Linguistic Cues for Open-World Visual Media Speaker Diarizationcited by 0
1 more
  1. 2026V2TATC: Joint Voice-Trajectory Embedding and Dataset for Air Traffic Controller Situational Awarenesscited by 0