ASTRA: A Scalable Next-Generation ATCO Training Simulator with Autonomous Simpilots
Not on the map. Why?
Abstract (arXiv)
Air Traffic Control Operators (ATCOs) are vital in ensuring the safe, orderly, and efficient flow of air traffic, yet training capacity is constrained by reliance on specialized human trainers known as simpilots, who must role-play both pilots and ATCOs in a simulated airspace. Existing automated solutions rely on Western-centric speech models that perform poorly in Singaporean operational contexts, with off-the-shelf systems exhibiting Word Error Rates (WER) of up to 107.80% on Singaporean-accented aviation speech. We introduce ASTRA, an end-to-end training simulator that automates these simpilot roles through a pipeline that transcribes ATCO speech, interprets instructions, and generates appropriate pilot and ATCO responses using locally adapted voice models. Our fine-tuned Automatic Speech Recognition (ASR) pipeline reduces WER to 23.45%, substantially outperforming existing approaches in this domain. Beyond traffic simulation, ASTRA incorporates an AI-assisted performance evaluation framework that assesses trainee radiotelephony communications across accuracy, brevity, and completeness, achieving post-optimization scores of 91.7%, 88.2%, and 86.9%, respectively. Built on open-source foundations such as DSPy and Unsloth, this approach enables scalable, standardized ATCO assessment while reducing instructor workload.
Key facts. No citing papers in the map yet (data through 14 Oct 2026). Builds on 18 of its 36 references that are in the map. First posted on arXiv 16 Jun 2026.
Builds on
18 of 36 references.
References · 18
- 2018BERT: Pre-training of Deep Bidirectional Transformers for Language Understandingcited by 40,399
- 2023Judging LLM-as-a-Judge with MT-Bench and Chatbot Arenacited by 8,626
- 2019BERTScore: Evaluating Text Generation with BERTcited by 5,512
- 2022Robust Speech Recognition via Large-Scale Weak Supervisioncited by 4,057
- 2023DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelinescited by 832
- 2021Conditional Variational Autoencoder with Adversarial Learning for End-to-End Text-to-Speechcited by 561
- 2024XTTS: a Massively Multilingual Zero-Shot Text-to-Speech Modelcited by 179
- 2025Canary-1B-v2 & Parakeet-TDT-0.6B-v3: Efficient and High-Performance Models for Multilingual ASR and ASTcited by 60
- 2017A Hybrid DSP/Deep Learning Approach to Real-Time Full-Band Speech Enhancementcited by 34
- 2019Domain Adaptation of Neural Machine Translation by Lexicon Inductioncited by 33
- 2023Can Contextual Biasing Remain Effective with Whisper and GPT-2?cited by 21
- 2022ATCO2 corpus: A Large-Scale Dataset for Research on Automatic Speech Recognition and Natural Language Understanding of Air Traffic Control Communicationscited by 19
6 more
- 2023Accented Text-to-Speech Synthesis with Limited Datacited by 12
- 2021Assessing Evaluation Metrics for Speech-to-Speech Translationcited by 10
- 2025Advancing Singlish Understanding: Bridging the Gap with Datasets and Multimodal Modelscited by 8
- 2025Robust and Efficient Autoregressive Speech Synthesis with Dynamic Chunk-wise Prediction Policycited by 4
- 2023A Virtual Simulation-Pilot Agent for Training of Air Traffic Controllerscited by 3
- 2022Speech and Natural Language Processing Technologies for Pseudo-Pilot Simulatorcited by 2
Built on by
Not cited yet.